Job description

Day1 Onsite

Sr Data/Spark Engineer

Durham, NC

Full time

Job Description:

Dats/Spark Engineer

We are currently sourcing for a Java/Spark Engineer to work in Durham, NC!

The Role

As part of UAP (Unified Acquisition Platform) team you will be working on enhancing the next generation in-house acquisition platform using cloud technologies. UAP will be built using Java Spark and Python programming language and use AWS EMR as the infrastructure for execution. You would be developing lambda, Spark, Python utilities for managing end to end feed flow. We will focus on building tools and capabilities to accelerate acquisition, compare data across vendors, externalize rules for data conversion, build inventory/registry of feeds and track lineage.

You would be focusing on:

• Develop new application for managing feed inventory and tracking their usage
• Developing application interface using Java Spark for converting vendor feeds into business-friendly format
• Develop accelerators for new feed acquisition
• Develop accelerators for data comparison reports
• Developing Lambda triggers for event driven and batch driven use case
• Supporting production during warranty period
• Participate in code review and define standard methodology
• Manage branching and deployments without conflicts
• Provide L3 production support
• Enhancing framework for future needs and make it a more generic product.

The Expertise and Skills You Bring

• Bachelor in information technology
• 6+ years of experience with application development and hands on experience with Spark/Scala
• Expertise in providing leadership support by providing technical solutions
• Expertise in handling huge dataset
• Expertise in code reviews for standards and efficient coding practices
• Expertise in building monitoring and alerting tools to report failure or potential performance degradation
• · Experience with TDD (Test driven development) to build unit testing and robust regression test suite

Job Type: Full-time

Pay: $120,000.00 - $130,000.00 per year

Benefits:

• 401(k)
• Dental insurance
• Health insurance
• Paid time off
• Vision insurance

Schedule:

• 8 hour shift
• Monday to Friday

Work Location: In person

Speak with the employer
+91 847-474-3706

seankuhnke.com is the go-to platform for job seekers looking for the best job postings from around the web. With a focus on quality, the platform guarantees that all job postings are from reliable sources and are up-to-date. It also offers a variety of tools to help users find the perfect job for them, such as searching by location and filtering by industry. Furthermore, seankuhnke.com provides helpful resources like resume tips and career advice to give job seekers an edge in their search. With its commitment to quality and user-friendliness, seankuhnke.com is the ideal place to find your next job.