Cloud Data Engineer

1 Client round of interviews :

• Client L1 :  Technical evaluation – focused on

o Terraform

o Kubernetes

o Azure infrastructure knowledge

o Best practices in operations and maintainability

Job Summary and Technology Stack

CUSTOMER intends to introduce Trino (open-source distributed SQL engine)  as a shared service to provide teams with secure, scalable access to Azure Data Lake tables via a SQL TCP endpoint .

The deployment will be based on Azure Kubernetes Service (AKS) , with high availability, modern authentication, multi-tenancy support, and strong workload isolation.

Integration with Azure DevOps  will drive CI / CD automation. Observability and telemetry will be key focus areas, working closely with the SRE and observability teams  to ensure production-grade reliability.

The service must successfully pass CUSTOMER’s Service Launch Criteria process , including security, networking, and cloud cost reviews.

The selected engineers will be responsible for :

• Designing, deploying, and maintaining Trino clusters on AKS with HA and workload isolation.
• Implementing authentication, authorization, and tenancy features for multi-team usage.
• Ensuring seamless integration with Azure Data Lake  and internal security standards.
• Collaborating with observability / telemetry teams to implement monitoring, alerting, and tracing.
• Working with the SRE team to troubleshoot production issues and maintain service SLAs.
• Driving compliance with internal Service Launch Criteria (security reviews, cost approvals, etc.).

Key Responsibilities of the selected candidate

• Deploy and scale Trino clusters on Azure AKS  with HA setup.
• Configure secure access to Azure Data Lake via SQL endpoint .
• Implement multi-tenancy and workload isolation for multiple team use.
• Integrate Azure AD / modern auth  for user and service identity management.
• Collaborate on observability : metrics, logs, distributed tracing.
• Troubleshoot and resolve production issues across networking, authentication, and workloads.
• Manage infrastructure automation using Azure DevOps pipelines .
• Contribute to internal governance, security review, and cost approval processes.

Skills and experience :

• 8+ years of experience in Cloud Infrastructure / DevOps Engineering.
• 5+ years of Kubernetes experience (AKS preferred) covering deployment, scaling, security, RBAC, and HA workloads.
• Strong knowledge of Azure services : AKS, Azure AD, Networking (VNet, NSG, Subnets), Storage, Key Vault, Monitoring, and Cost Management.
• Experience with SQL engines, preferably Trino, Presto, or similar distributed query engines .
• Hands-on experience with infrastructure as code (Terraform) .
• Experience integrating with observability platforms  (Prometheus, Grafana, Azure Monitor, or similar).
• Strong troubleshooting experience in production distributed systems .
• Experience in CI / CD pipelines  with Azure DevOps.

Must to have skillsets :

• Kubernetes (AKS) HA deployment and operations.
• Strong Azure Cloud expertise (networking, auth, storage, monitoring).
• Infrastructure as Code (Terraform, Azure DevOps).
• Production troubleshooting skills (networking, auth, distributed systems).

Good to have skillsets

• Experience with SQL engines (Trino, Presto, or equivalent).
• Experience with multi-tenant service design .
• Observability / telemetry tooling expertise.
• Knowledge of data engineering / lakehouse patterns .

Soft skills :

• Strong problem-solving and troubleshooting abilities.
• Ability to work independently and collaborate across multiple teams (SRE, observability, data engineering).
• Clear communication and documentation skills for cross-team coordination.
• Flexibility to adapt in a dynamic environment with evolving requirements.
• Proactive mindset for automation, cost optimization, and security.

Share your CV at kaushalraj.choudhary@latentbridge.com with subject - Cloud Data Engineer