Senior Data Engineer [T500-21405]

About ADM :

We are one of the world’s largest nutrition companies and a global leader in human and animal nutrition. We unlock the power of nature to provide nourishing quality of life by transforming crops into ingredients and solutions for foods, beverages, supplements, livestock, aquaculture, and pets.

About ADM India Hub :

At ADM, we have long recognized the strength and potential of India’s talent pool, which is why we have maintained a presence in the country for more than 25 years. Building on this foundation, we have now established ADM India Hub, our first GCC in India.

At ADM India Hub, we are hiring for IT and finance roles across diverse technology and business functions. We stand at the intersection of global expertise and local excellence, enabling us to drive innovation and support our larger purpose of unlocking the power of nature to enrich quality of life.

Job Title : Senior Data Engineer

Overview :

We are seeking a skilled and motivated Azure Databricks Data Engineer to join our dynamic team. The ideal candidate will have strong experience with Python, Spark programming, and expertise in building and optimizing data pipelines in Azure Databricks. You will play a pivotal role in leveraging Databricks workflows, Databricks Asset Bundles, and CI / CD pipelines using GitHub to deliver high-performance data solutions. A solid understanding of Data Warehousing and Data Mart architecture in Databricks is critical for success in this role. If you’re passionate about data engineering, cloud technologies, and scalable data architecture, we’d love to hear from you!

Key Responsibilities :

Required Qualifications :

Python and Spark Programming :

• Minimum of 7 years of experience in Python programming, especially in data engineering, ETL processes, and distributed computing.
• Solid experience using Apache Spark (PySpark) for large-scale data processing and transformation within Databricks.
• Proficiency in writing and optimizing Spark-based jobs for high performance on large datasets.

Databricks Workflows :

Databricks Asset Bundles :

CI / CD for Databricks Artifacts using GitHub :

Data Warehousing & Data Mart Experience :

Cloud Experience :

Data Engineering Best Practices :

Collaboration and Communication :

Preferred Qualifications :

Cloud Certifications :

Data Science / ML Experience :