-
Job Description
Design and innovate scalable data engineering systems for a large data lake, leveraging Java and AWS, and big data technologies like Spark, EMR, and Athena.
About the Role
The Analytics & Data Management (ADM) team owns the central data lake for Advertising, unifying Petabytes of data generated across the Ads pipeline into a single scalable repository.
Key Responsibilities:
- Engage with key decision makers to understand customer requirements and brainstorm solutions.
- Design, code, and deploy components and micro-services for the core job management pipeline.
- Ensure testability, maintainability, and low operational footprint for your code.
- Innovate on AWS technology to improve latency, reduce cost, and operations.
- Automate monitoring of data availability, quality, and usability via simplified metrics and drive innovations to improve guarantees for our customers.
- Build frugal solutions that will help make Spektr data lake the cost-wise leanest data lake.
About the Team
The Analytics & Data Management (ADM) team is responsible for providing data that helps the advertising organization make informed analyses and decisions for our customers.
Requirements
- 3+ years of non-internship professional software development experience.
- 2+ years of non-internship design or architecture experience.
- Experience programming with at least one software programming language.
- 3+ years of full software development life cycle experience.
- Bachelor's degree in computer science or equivalent.