Platform Engineer - Databricks and Cloud
About the job
EXL is seeking an experienced Platform Engineer to design, implement, automate and operate cloud infrastructure for large scale analytics and data engineering workloads. This role focuses on building and managing Databricks on AWS, Infrastructure-as-Code, CI/CD automation, platform reliability, and cloud governance. The ideal candidate will bring strong hands-on experience across AWS cloud services, Terraform, DevOps practices, and a solid understanding of data engineering platforms, pipelines, and workload orchestration.
Responsibilities
Architect and implement highly available cloud solutions using AWS services (EC2, EKS, Lambda, API Gateway, VPC, IAM, Redshift, Glue, etc.)
Define cloud architecture standards, best practices, and governance aligned with AWS Well-Architected principles.
Drive Infrastructure-as-Code (IaC) adoption using Terraform or AWS CDK with reusable and modular designs.
Define and manage CI/CD strategies including multi-environment deployments, automated testing, and rollback mechanisms,
Design secure cloud environments covering IAM, network security, encryption, secrets management, and compliance.
Collaborate with data engineering teams to build platforms using AWS Glue, Databricks, Redshift, and DynamoDB.
Implement observability frameworks (monitoring, logging, alerting) using tools like CloudWatch, Prometheus, Grafana, Datadog, or ELK.
Optimize cloud environments for performance, scalability, reliability, and cost (FinOps practices).
Lead client discussions, translate business requirements into architecture solutions, and provide strategic guidance.
Guide engineering teams to follow architectural standards and DevOps best practices.
Support multi-account cloud strategies using AWS Organizations, Control Tower, or Landing Zone patterns.
Qualifications
Must have:
Strong experience designing enterprise-scale AWS cloud architectures.
Expertise in Infrastructure-as-Code (Terraform / AWS CDK) with modular design practices.
Deep understanding of microservices, serverless, and container-based architectures.
Hands-on experience with Kubernetes (EKS) and container orchestration.
Strong knowledge of CI/CD pipelines and DevOps methodologies.
Proficiency in Python, Bash, or similar scripting languages.
Experience implementing cloud security and compliance control.
Strong networking knowledge (VPC design, hybrid connectivity, security)
Experience with modern data platforms (Databricks, AWS Glue, Redshift, etc.)
Strong communication and stakeholder management skills.
Ability to lead teams and drive architectural decisions.
Good to Have:
Experience with multi-cloud environments (AWS + Azure)
Knowledge of FinOps and cost optimization strategies.
Exposure to enterprise cloud governance frameworks.
Experience in platform engineering or internal developer platforms.
Familiarity with Agile delivery in consulting environments.
AWS certifications (Solutions Architect, DevOps Engineer, etc.)
Eligibility:
Bachelor’s or Master’s degree in Computer Science, Engineering, Information Systems, or related field.
Significant hands-on experience in AWS cloud architecture and DevOps environments.
Experience working in enterprise or consulting setups with client-facing responsibilities.
