Talent.com
Azure Data Engineer
Azure Data EngineerRainier Softech Solutions Pvt Ltd • India
Azure Data Engineer

Azure Data Engineer

Rainier Softech Solutions Pvt Ltd • India
2 days ago
Job description

Sr. Data Engineer (Databricks)

About the Role

We’re looking for a hands-on Data Engineer to build reliable, scalable data pipelines on Databricks. You’ll turn requirements into production-grade ELT / ETL jobs, Delta Lake tables, and reusable components that speed up our teams. In this role, you’ll implement and improve reference patterns, optimize Spark for performance and cost, apply best practices with Unity Catalog and workflow orchestration, and ship high-quality code others can build on. If you love solving data problems at scale and empowering teammates through clean, well-documented solutions, you’ll thrive here.

Core Qualifications :

  • Bachelor’s degree in computer science, Engineering, or a related field
  • 7+ years of experience in software / data engineering, including at least 2 years working with Databricks and Apache Spark
  • Strong proficiency in Python, SQL, and PySpark
  • Deep understanding of AWS and Azure Cloud service
  • Experience with Databricks Data LakeHouse, Databricks Workflows, and Databricks SQL, dbt
  • Solid grasp of data Lakehouse and warehousing architecture
  • Prior experience supporting AI / ML workflows, including training data pipelines and model deployment support
  • Familiarity with infrastructure-as-code tools like Terraform or CloudFormation
  • Strong analytical and troubleshooting skills in a fast-paced, agile environment
  • Excellent collaboration skills for interfacing with both technical and non-technical customer stakeholders
  • Clear communicator with strong documentation habits
  • Comfortable leading discussions, offering strategic input, and mentoring others

Key Responsibilities :

  • The ideal candidate will have a strong background in building scalable data pipelines, optimizing big data workflows, and integrating Databricks with cloud services
  • This role will play a pivotal part in enabling the customer’s data engineering and analytics initiatives—especially those tied to AI-driven solutions and projects—by implementing cloud-native architectures that fuel innovation and sustainability
  • Partner directly with the customer’s data engineering team to design and deliver scalable, cloud-based data solutions
  • Execute complex ad-hoc queries using Databricks SQL to explore large lakehouse datasets and uncover actionable insights
  • Leverage Databricks notebooks to develop robust data transformation workflows using PySpark and SQL
  • Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks
  • Build ETL / ELT workflows with AWS and Azure Services
  • Optimize Spark jobs for both performance and cost within the customer’s cloud infrastructure
  • Collaborate with data scientists, ML engineers, and business analysts to support AI and machine learning use cases, including data preparation, feature engineering, and model operationalization
  • Contribute to the development of AI-powered solutions that improve operational efficiency, route optimization, and predictive maintenance in the waste management domain
  • Implement CI / CD pipelines for Databricks jobs using GitHub Actions, Azure DevOps, or Jenkins
  • Ensure data quality, lineage, and compliance through tools like Unity Catalog, Delta Lake, and AWS Lake Formation
  • Troubleshoot and maintain production data pipelines
  • Provide mentorship and share best practices with both internal and customer teams
  • Create a job alert for this search

    Azure Data Engineer • India

    Related jobs
    Azure Data Engineer

    Azure Data Engineer

    Kumaran Systems • Republic Of India, IN
    We are seeking a skilled Azure Databricks with strong hands-on experience in Microsoft Azure services such as Data Factory, Storage, Synapse, and Key Vault. The candidate should be proficient in Dat...Show more
    Last updated: 7 days ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Softobiz • India
    Dynamics 365 Customer Insights & Power BI.Starts from 7 : 00 AM IST (Australian shift).As a Data Engineer specialising in Microsoft Dynamics 365 Customer Insights and Power BI, you will play the role...Show more
    Last updated: 2 days ago • Promoted
    Sr. Azure Data Engineer

    Sr. Azure Data Engineer

    Persistent Systems • Pune, Republic Of India, IN
    We're seeking an experienced Snowflake Data Engineer to join our team.As a Azure Data Engineer, you will be responsible for designing, building, and maintaining large-scale data warehouses and data...Show more
    Last updated: 12 days ago • Promoted
    6221 Azure Data Engineer

    6221 Azure Data Engineer

    EXL • Pune, Republic Of India, IN
    Key Role and Responsibilities : .Design and develop ETL / ELT pipelines using Azure Data Factory, Snowflake, and DBT.Build and maintain data integration workflows from various data sources to Snowflake...Show more
    Last updated: 7 days ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy Services • India
    TCS is conducting Weekend Virtual drive for the role of.Years of experience : 7 to 10 yrs.Location : Bangalore, Chennai, Hyderabad, Pune. Date of Interview : 1st Nov, 2025.Time of Interview : 10 AM to 2...Show more
    Last updated: 2 days ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tech Mahindra • India
    We have opening for Azure data engineer , azure data lead , Azure data Architect.Expertise in CI-CD, Pyspark, SQL.Expertise in ADF, ADLS & ADB (Mandatory). Experience in "Azure Services / Key Vault"...Show more
    Last updated: 7 hours ago • Promoted • New!
    Lead Azure Data Engineer

    Lead Azure Data Engineer

    Persistent Systems • Pune, Republic Of India, IN
    We're seeking an experienced Snowflake Data Engineer to join our team.As a Azure Data Engineer, you will be responsible for designing, building, and maintaining large-scale data warehouses and data...Show more
    Last updated: 12 days ago • Promoted
    Azure Data Solutions Engineer

    Azure Data Solutions Engineer

    C5i • Republic Of India, IN
    We are seeking a highly skilled and experienced Data Engineering Lead to join our team.The ideal candidate will have a strong background in data engineering, data architecture, and team leadership....Show more
    Last updated: 30+ days ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Infarsight • Pune, Republic Of India, IN
    Infarsight helps enterprises scale strategic business transformation through automation,.We streamline operations with platforms like Task Sight, Trip. Sight, and Fleet Sight, turning complexity int...Show more
    Last updated: 15 days ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    PROCYON TECHNOSTRUCTURE • India
    Quick Apply
    MessageBody"> Key Responsibilities Design, develop, and maintain data in...Show more
    Last updated: 4 days ago
    Azure Data Engineer

    Azure Data Engineer

    Confidential • India
    With a focus on leveraging cutting-edge cloud platforms, data engineering, and analytics, the company prides itself on fostering a collaborative environment that promotes continuous learning and pr...Show more
    Last updated: 26 days ago • Promoted
    Azure Data Engineer (Walk-In-Interview)

    Azure Data Engineer (Walk-In-Interview)

    Tata Consultancy Services • Chennai, Republic Of India, IN
    Pyspark and Azure Synapse Analytics / Azure Databricks.Proficiency in integrating, transforming, and consolidating data from various structured and unstructured data sources.Good experience in SQL or...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer (Airflow, Azure)

    Data Engineer (Airflow, Azure)

    Luxoft • Chennai, Republic Of India, IN
    This project is part of a strategic initiative to migrate legacy on-premises data systems to a modern, scalable cloud-based data platform using Snowflake on Azure. The goal is to enhance data access...Show more
    Last updated: 1 day ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Capgemini Invent • India
    At Capgemini Invent, we believe difference drives change.As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to...Show more
    Last updated: 2 days ago • Promoted
    Azure Data Solutions Engineer

    Azure Data Solutions Engineer

    All European Careers • Republic Of India, IN
    For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show more
    Last updated: 7 days ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    C5i • India
    We are seeking a highly skilled and experienced Data Engineering Lead to join our team.The ideal candidate will have a strong background in data engineering, data architecture, and team leadership....Show more
    Last updated: 2 days ago • Promoted
    Senior Azure Data Engineer

    Senior Azure Data Engineer

    Programmers.io • India
    Job Title : Senior Azure Data Engineer.Skills Required : Azure Synapse, Azure Data Factory, Azure Databricks, and ADLS Gen2, PySpark, SQL,Microsoft Fabrics. Experience Range : 8 Years - 12 years.We are...Show more
    Last updated: 2 days ago • Promoted
    (Senior) Azure Data Engineer - Full remote - contractor in USD

    (Senior) Azure Data Engineer - Full remote - contractor in USD

    All European Careers • India, India
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show more
    Last updated: 8 days ago • Promoted