-
Job Description
In this role you will be responsible for the development of new code that will deploy new Data Platforms such as Dynamo DB, Big Table, Kafka, Kinesis, Red Shift, and the like in the Cloud. You will also take part of a on-call rotation on the DRE Team to respond to critical issues and outages. You will support existing databases, Redis caches and Kafka clusters at SXM/P, automate operational toil via scripting, infrastructure-as-code utilities and third-party applications, and ensure adequate monitoring and alerting are in place for our supported Data Platforms.
- Automate operational toil via scripting, infrastructure-as-code utilities and third-party applications
- Support existing databases, Redis caches and Kafka clusters at SXM/P
- Ensure adequate monitoring and alerting are in place for our supported Data Platforms
- Troubleshoot outages and performance problems
- Participate in the development of Root Cause Analysis for any Data Platform outages or severe performance degradations
Required qualifications:
- 5+ years scripting experience in Python, Bash, Go Lang, preferably in Python
- Java coding skills is a plus
- Experience utilizing monitoring tools like Prometheus, Grafana, ELK Stack, Google Cloud Monitoring, and Cloud Watch
- Experience with one or more of the following:
- Open source SQL databases like Postgre SQL
- Data streaming platform technologies - Kafka, Kafka Connect, KStreams, KSQL
- In-memory key-value Stores like Redis
- No SQL Databases like Big Table, Dynamo DB, and Cassendra
- Experience with monitoring, alerting, infra deployment, and cost optimization in Cloud Platforms such as AWS and GCP
- Familiar with Infrastructure as Code using tools such as Terraform, Cloud Formation, and Ansible
- Ability to quickly learn the architecture of complex and distributed systems
- Ability to quickly diagnose problems in complex and distributed systems
- Familiar with CI/CD pipelines and capable of tailoring them for specific needs
- Experience with monitoring, alerting, Infra deployment, and cost optimization in Cloud Platforms such as AWS and GCP
- Familiarity with networking (TCP/IP) and Firewalls
- Developing SQL applications of significant complexity
- Experience creating REST APIs using frameworks like DJango, Flask, or similar
- Knowledge of how to build and deploy Docker containers
- Experience with container orchestration such has ECS, Kubernetes, and Nomad are a plus
- Experience with Service Meshes and Service Discovery in general
- Experience with tools/services that provide secret management to avoid storing passwords in the open
- Knowledge of SSL/TLS
- Knowledge of Load Balancing
- Familiarity with change control systems such as Bit Bucket
- Interpersonal skills and ability to interact and work with staff at all levels
- Excellent written and verbal communication skills
- Ability to work independently and in a team environment
- Ability to project professionalism over the phone and in person
- Ability to handle multiple tasks in a fast-paced environment
- Commitment to 'internal client' and customer service principles
- Willingness to take initiative and to follow through on projects
- Excellent time management skills, with the ability to prioritize and multi-task, and work under shifting deadlines in a fast-paced environment