Our client is searching for an experienced Data Engineer to join them in New York. This team is at the forefront of big data, stream processing and building cutting-edge tools and techniques. They have a direct impact on profitability of the firm by enabling competitive investment decisions through modern and highly scalable data acquisition and processing pipelines. High value is placed on the exchange of ideas, creativity and innovation, and they are seeking passionate technologists who thrive in an impactful, and fast-paced environment.
Responsibilities:
- Understand business challenges and drive technical solutions
- Partner with investment professionals and data analysts/scientists to define priorities and deliver custom solutions
- Build robust, fault-tolerant data pipelines to cleanse, transform, enrich and model acquired data
- Acquire data from vendors, APIs or website scraping for analysis
- Enhance and extend data pipeline platforms and frameworks to accelerate data delivery
- Integrate data and insights into models, reports and the investment process
- Measure, analyse, and improve internal data quality
Requirements:
- Expertise in more than one programming languages such as Java, Scala, JavaScript, Python, R, or similar
- Strong database programming expertise and strong SQL skills
- Strong personal drive and evidence of entrepreneurial initiative
- Great communication skills, both written and verbal
- Strong Linux and broad computer science expertise
Nice to have:
- Web data scraping experience
- Vertica, Greenplum, Redshift, BigQuery, Mongo, ElasticSearch, Hadoop experience
- AWS experience including EMR
- Machine learning and real-time preditive model execution platforms
- Jupyter and Anaconda
- PySpark and Zeppelin
- Data Warehousing and Modeling expertise
- Tableau, BI Tools, Excel
- Large scale text analytics processing
Education:
- Minimum Bachelor’s degree in Computer Science or related field
If you would like to be considered for the position of Data Engineer, or wish to discuss the role further then please leave your details below. Your resume will be held in confidence until you connect with a member of our team
