Job Description
Job Title: Senior Big Data Developer
Duration - 11 Months
Location - Belfast
Hybrid - 3 days in the office
Job Description:
We are seeking a highly motivated and detail-oriented Big Data Platform Development Engineer.
The ideal candidate will be responsible for onboarding new users and clients, setting up build pipelines, reviewing code and queries, and performing coding, testing and performance tuning of jobs. The candidate should have a strong technical background in Big Data technologies, such as Hadoop, Spark, and Hive, and be comfortable working with complex systems. The candidate should also have excellent communication and organizational skills to collaborate with both internal and external stakeholders.
Key Responsibilities:
- Onboard new users and clients to the Big Data platform.
- Collaborate with cross-functional teams to identify and prioritize data requirements, data quality issues, and performance bottlenecks
- Setup build pipelines to automate the build and deployment process.
- Responsible for conducting code reviews, detecting suboptimal queries and performance issues.
- Guide teams to follow most optimal industry standard practices.
- Design and develop highly scalable and fault-tolerant big data solutions on the Cloudera platform.
- Monitor and optimize risk data platform for performance, scalability and cost-effectiveness
Qualifications:
- Bachelor's or master's degree in Computer Science, Information Systems, or a related field
- 5+ years of experience in big data technologies, with at least 3 years of experience in Apache Spark and Cloudera
- Strong knowledge of big data technologies, including Hadoop, Hive, HBase, Kafka, and YARN
- Excellent programming skills in Python and/or Scala
- Strong analytical, problem-solving, and communication skills
- Ability to work independently and collaboratively in a fast-paced, agile environment
Morgan McKinley is acting as an Employment Agency and references to pay rates are indicative.
Morgan McKinley encourages applications from all qualified candidates who represent the full diversity of communities in the UK. Accommodations are available on request for candidates taking part in all aspects of the selection process.
BY APPLYING FOR THIS ROLE YOU ARE AGREEING TO OUR TERMS OF SERVICE WHICH TOGETHER WITH OUR PRIVACY STATEMENT GOVERN YOUR USE OF MORGAN MCKINLEY SERVICES.