Job description
Job Overview
The Research Systems Data Engineer will work in a development team that builds data driven solutions to support the quantitative investment Research group. As a systematic asset manager, Arrowstreet must identify investable trading strategies and implement them quickly and with the highest quality. The rapid integration of novel data sources is a vital competitive advantage for the Research group and essential to the continued success of the firm, as is the ability to extract useful information through high-performance data transformations and analytics.
In this role, the candidate will contribute to the creation and build of the next evolution of the Data Engineering Platform. The candidate will build features that will make it possible to rapidly on-board new data at very large scale that can be governed, tracked and integrated into a variety of uses.
Responsibilities
-
Build a platform that can support batch and real-time data sets using modern data processing frameworks.
-
Build features for data discovery, lineage, governance, ingestion operation, cost management, performance, etc.
-
Assist the team in investigating potential improvements achieved by adopting new data technologies and frameworks.
-
Achieve high quality metrics through automated testing, robust operational tooling and reliable designs.
-
Production support of the platform to avoid disruption to investment processes.
Qualifications
-
Bachelor’s degree in Computer Science, Computer Engineering or a related discipline
-
At least 3 years of experience working with data lakes, data warehousing, and/or database systems, including processing frameworks like Spark, Hadoop, Presto, etc.
-
You strive to write elegant code, and you're comfortable with picking up new technologies independently
-
You are proficient in at least one major programming language (e.g. Python, Java, Scala) and comfortable working with SQL
-
You have experience working with one of the major cloud providers (e.g. AWS, Azure, GCP) and k8s, and automation through infrastructure as code with one of the Terraform, Pulumi, Cloudformation and CDK etc.
-
You have experience with any workflow orchestration frameworks such as Apache Airflow, Prefect, Argo workflows.
-
(Preferred) You have experience with data catalog, lineage and/or governance tools, e.g. Apache Atlas, DataHub, Amundsen, etc. and familiar with Openlineage.
-
(Optional) You have experience with real-time streaming processing with Kafka, Kinesis, and Apache Flink etc.
We maintain a friendly, team-oriented environment and place a high value on professionalism, attitude and initiative.
seankuhnke.com is the go-to platform for job seekers looking for the best job postings from around the web. With a focus on quality, the platform guarantees that all job postings are from reliable sources and are up-to-date. It also offers a variety of tools to help users find the perfect job for them, such as searching by location and filtering by industry. Furthermore, seankuhnke.com provides helpful resources like resume tips and career advice to give job seekers an edge in their search. With its commitment to quality and user-friendliness, seankuhnke.com is the ideal place to find your next job.