Senior Data Engineer (Python + Polars)

Our client is looking for a Senior Python Data Engineer who not only builds pipelines but also understands business context, data modeling, and why certain schemas or architectures are used. They expect strong Python problem-solving, practical experience with Polars (Must have) , Pandas, Duck DB, and the ability to design data pipelines end-to-end. The role also requires solid skills in API development (Fast API) and deployment automation using IaC tools like Bicep or Terraform. Overall, someone with technical depth, architectural understanding, and real ownership of their past projects

Key Responsibilities :

• Min 5+ yrs of Python development (Fast API, background jobs, automation)
• Strong experience with data processing ( Polars (Must have) / Pandas / OpenPyXL / Duck DB)
• Expertise in data engineering pipelines (Data Lake, Medallion, Star Schema)
• Hands-on Azure development (Container Apps, Storage, Service Bus, SignalR)
• Experience with CI / CD pipelines (GitHub Actions)
• Knowledge of IaC (Bicep preferred; Terraform / AWS CDK good to have)

Nice to have :