One of the largest and most recognised Hedge Funds are looking for a Big Data expert to be part of the team building the next generation of compute platforms. The team is already responsible for running compute in the 100K+ core range and pushing the boundaries of scalability and elasticity. Working across technology groups you will be exposed to many different aspects of the business and will have a very direct and immediate business impact.
Key Responsibilities:
- Design and build production cloud based batch and streaming data processing systems
- Provide infrastructure tooling for cloud and hybrid computing
- Provide operational support for your production systems
- Run and debug complex distributed environments.
- Evaluate new technologies by building and running PoCs
- Asses and communicate potential business impact of those technologies
- Act as a cloud architectural consultant for internal application teams
- Working with Front Office IT teams through entire project lifecycles.
Candidate Requirements:
- Experience designing and running large batch and streaming data processing systems, e.g. Hadoop, Spark, or batch systems.
- Experience building and running large data stores, e.g. Cassandra, MongoDB, Riak, HBase.
- Experience with DevOps practices such as configuration management and infrastructure automation, (e.g. Ansible, packer, Jenkins etc...)
- Experience building production systems on open source platforms.
- Solid knowledge of various languages, preferably Python, C++ or Java.
- Designed and deployed elastic applications to public or private clouds (AWS, GCE, Openstack).
- Solid understanding of encryption and security.
- Solid Linux systems knowledge.
Education
- Undergraduate degree in Mathematics, Computer Science, or related engineering or science curriculum
If you would like to be considered for the position of Big Data Cluster Engineer or wish to discuss it further please leave your details below. Your resume will be held in confidence until you connect with a member of our search
