Python (Airflow/DBT) EngineerLuxoft • madurai, tamil nadu, in
No longer accepting applications
Python (Airflow / DBT) Engineer
Luxoft • madurai, tamil nadu, in
9 days ago
Job description
Project Description :
This project is part of a strategic initiative to migrate legacy on-premises data systems to a modern, scalable cloud-based data platform using Snowflake on Azure. The goal is to enhance data accessibility, performance, and governance while enabling advanced analytics and automation.
The resource will join an ongoing effort to accelerate the migration and modernization process, contributing to data pipeline development, orchestration, and optimization using tools like Airflow, DBT, and Docker, with strong emphasis on Python scripting and database engineering.
Responsibilities :
Data Pipeline Development : Build and optimize ETL / ELT pipelines using Python, Airflow, and DBT to ingest, transform, and load data into Snowflake.
Cloud Migration Support : Assist in migrating existing on-prem data workflows and databases to Snowflake on Azure, ensuring minimal disruption and high data fidelity.
Data Modeling & Transformation : Design and implement robust data models and transformation logic using DBT and SQL, aligned with business requirements.
Containerization : Use Docker to containerize data services and workflows for consistent deployment across environments.
Database Engineering : Apply strong SQL and Snowflake expertise to optimize queries, manage schemas, and ensure data quality and performance.
Version Control & Collaboration : Use Git / GitHub for source control, code reviews, and CI / CD integration.
Monitoring & Troubleshooting : Monitor pipeline performance, troubleshoot issues, and implement logging and alerting mechanisms.
Security & Governance : Ensure data security, compliance, and governance standards are met throughout the migration process.
Scope - resource will help expedite work already in progress as part of cloud migration of our on-prem data systems to Cloud (snowflake on Azure).
Nice-to-Have Skills Description :
Certifications
Languages :
English : Proficient
Create a job alert for this search
Engineer Python • madurai, tamil nadu, in
Related jobs
Senior Python / / AI Engineer
Luxoft • Madurai, IN
Our client, one of the leading Agriculture Companies, is modernising their landscape and adopting AI and innovations in their process.
We are seeking a highly skilled and innovative Python / AI Engine...Show more
Last updated: 2 days ago • Promoted
Python Automation Engineer
XpertDox India Pvt Ltd • Madurai, IN
Strong Python programming skills with at least two years of hands-on experience in the automation of tasks & GUI (using Selenium or other known shadow DOM).
Familiarity with Windows and Linux fundam...Show more
Last updated: 30+ days ago • Promoted
DFT Lead Engineer
Proxelera • Madurai, IN
Proxelera is India’s premium chip and system software product engineering partner.Our engineers take extreme passion in your assignments and deliver through their years of high quality experience t...Show more
Last updated: 2 days ago • Promoted
Senior Snowflake + DBT Engineer (8+ Years)
MindBrain • madurai, tamil nadu, in
Job Opportunity : Snowflake + DBT Engineer.We are seeking a highly skilled Snowflake + DBT Engineer to design, build, and optimize scalable cloud-based data platforms.
The ideal candidate will have s...Show more
Last updated: 6 hours ago • Promoted • New!
Senior AI / ML Engineer
Luxoft • Madurai, IN
Our client, one of the leading Agriculture Companies, is modernising their landscape and adopting AI and innovations in their process.
We are seeking a highly skilled and innovative Python / AI Engine...Show more
Last updated: 20 days ago • Promoted
Python Developer
VAYUZ Technologies • Madurai, Tamil Nadu, India
Responsibilities Develop and maintain scalable backend services using Python , Django , and AWS.Build responsive, high-performing front-end interfaces using React.
Design and optimize RESTful A...Show more
Last updated: less than 1 hour ago • Promoted • New!
Engineer, GitHub Copilot
Asteya Technologies • Madurai, IN
Generative AI & Tool Expertise, including MCP usage and Agentic Orchestration.Expert-level knowledge of GitHub Copilot and Amazon Q features, including Copilot Chat agents and Amazon Q’s / dev comma...Show more
Last updated: 14 days ago • Promoted
Senior / Lead / Principal SDET - Python automation(Storage)
DDN • Madurai, IN
This is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades.
DataDirect Networks (DDN) is a globa...Show more
Last updated: 10 days ago • Promoted
Senior Data Engineer
Intellify Solutions • Madurai, IN
Total years of experience : 10+ years.Required : Bachelor’s degree or relevant experience.Required : Prior experience as a software engineer or data engineer in a.
Required : Cloud Data Warehouse experi...Show more
Platform Engineer – Python / Databricks / Notebooks / Kubernetes.Syntasa is seeking a high-caliber and dedicated.Syntasa Technologies India Private Limited.
This position offers an exciting opportuni...Show more
Last updated: 30+ days ago • Promoted
AI Engineer (Backend) - Python
Edstem Technologies • Madurai, IN
We are building the next generation of AI-powered applications that deliver actionable financial and marketing insights to our clients.
As an AI Engineer focused on backend development, you'll be in...Show more
Last updated: 9 days ago • Promoted
Backend Python Engineer - 17852
Turing • Madurai, IN
We’re looking for experienced Python engineers to collaborate with one of the world’s top Large Language Model (LLM) companies.
Your work will directly help improve how AI models think, reason, and ...Show more
Last updated: 22 days ago • Promoted
AI Engineer (Data Pipelines & RAG)
BeGig • Madurai, IN
Job Role- AI Engineer (Data Pipelines & RAG).Work Mode- Remote(6 days working).We are looking for a hands-on AI / Data Engineer (4–7 years) to build and scale data pipelines powering GenAI and agenti...Show more
Last updated: 10 days ago • Promoted
Data Engineer
Mastek • Madurai, IN
Deep hands-on experience with Unity Catalog — creating and managing catalogs, schemas, and tables.Experience automating data onboarding and metadata registration via Unity Catalog APIs or Databrick...Show more
Last updated: 17 days ago • Promoted
Data Engineer
Aceolution • Madurai, IN
Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show more
Last updated: 30+ days ago • Promoted
Python Automation Developer - PAN India
Concentrix • Madurai, IN
Looking for Python Expertise with minimum 6+ years of experience with having below must have skills : .Experience in automating business processes using Python.
Integrate bots with databases (SQL, Pos...Show more
Last updated: 3 days ago • Promoted
Senior Python Developers (Machine Learning)
MillionLogics • madurai, tamil nadu, in
MillionLogics is a trusted Oracle Partner with a global presence, combining innovation, expertise, and strategic vision.Based in London, UK, with a development hub in Hyderabad, India, MillionLogic...Show more
Last updated: 1 day ago • Promoted
Applied AI Engineer
Strategic Talent Partner • Madurai, IN
Design and deploy advanced multi-agent pipelines for credit analysis.Optimize inference and prompt chains using frameworks like DSPy, GEPA, and LangChain.
Implement reasoning techniques (CoT, ToT, G...Show more