Talent.com
Azure Data Engineer
Azure Data EngineerRainier Softech Solutions Pvt Ltd • Bengaluru, Karnataka, India
Azure Data Engineer

Azure Data Engineer

Rainier Softech Solutions Pvt Ltd • Bengaluru, Karnataka, India
7 days ago
Job description

Sr. Data Engineer (Databricks)

About the Role

We’re looking for a hands-on Data Engineer to build reliable, scalable data pipelines on Databricks. You’ll turn requirements into production-grade ELT / ETL jobs, Delta Lake tables, and reusable components that speed up our teams. In this role, you’ll implement and improve reference patterns, optimize Spark for performance and cost, apply best practices with Unity Catalog and workflow orchestration, and ship high-quality code others can build on. If you love solving data problems at scale and empowering teammates through clean, well-documented solutions, you’ll thrive here.

Core Qualifications :

  • Bachelor’s degree in computer science, Engineering, or a related field
  • 7+ years of experience in software / data engineering, including at least 2 years working with Databricks and Apache Spark
  • Strong proficiency in Python, SQL, and PySpark
  • Deep understanding of AWS and Azure Cloud service
  • Experience with Databricks Data LakeHouse, Databricks Workflows, and Databricks SQL, dbt
  • Solid grasp of data Lakehouse and warehousing architecture
  • Prior experience supporting AI / ML workflows, including training data pipelines and model deployment support
  • Familiarity with infrastructure-as-code tools like Terraform or CloudFormation
  • Strong analytical and troubleshooting skills in a fast-paced, agile environment
  • Excellent collaboration skills for interfacing with both technical and non-technical customer stakeholders
  • Clear communicator with strong documentation habits
  • Comfortable leading discussions, offering strategic input, and mentoring others

Key Responsibilities :

  • The ideal candidate will have a strong background in building scalable data pipelines, optimizing big data workflows, and integrating Databricks with cloud services
  • This role will play a pivotal part in enabling the customer’s data engineering and analytics initiatives—especially those tied to AI-driven solutions and projects—by implementing cloud-native architectures that fuel innovation and sustainability
  • Partner directly with the customer’s data engineering team to design and deliver scalable, cloud-based data solutions
  • Execute complex ad-hoc queries using Databricks SQL to explore large lakehouse datasets and uncover actionable insights
  • Leverage Databricks notebooks to develop robust data transformation workflows using PySpark and SQL
  • Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks
  • Build ETL / ELT workflows with AWS and Azure Services
  • Optimize Spark jobs for both performance and cost within the customer’s cloud infrastructure
  • Collaborate with data scientists, ML engineers, and business analysts to support AI and machine learning use cases, including data preparation, feature engineering, and model operationalization
  • Contribute to the development of AI-powered solutions that improve operational efficiency, route optimization, and predictive maintenance in the waste management domain
  • Implement CI / CD pipelines for Databricks jobs using GitHub Actions, Azure DevOps, or Jenkins
  • Ensure data quality, lineage, and compliance through tools like Unity Catalog, Delta Lake, and AWS Lake Formation
  • Troubleshoot and maintain production data pipelines
  • Provide mentorship and share best practices with both internal and customer teams
  • Create a job alert for this search

    Azure Data Engineer • Bengaluru, Karnataka, India

    Related jobs
    Azure Data Engineer

    Azure Data Engineer

    LTIMindtree • Bengaluru, Karnataka, India
    Seeking an experienced Senior Specialist with 7 to 11 years of expertise in Azure Data Factory and Azure SQL to design and manage scalable data integration solutions. Design develop and maintain sca...Show more
    Last updated: 30+ days ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Talent Worx • Bengaluru, KA, IN
    Quick Apply
    Global consulting firm seeking an Azure Data Engineer to join our dynamic team.As an Azure Data Engineer, you will be responsible for designing and implementing robust data pipelines and workflows ...Show more
    Last updated: 30+ days ago
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy Services • bangalore, karnataka, in
    Interview Date : Weekend Virtual Drive 15-Nov-25.Extensive coding experience (3+ years) including Python / Pyspark (1 years +). Experience developing in Azure with key data technologies (e.ADLS, ADF, A...Show more
    Last updated: 30+ days ago • Promoted
    Azure Data Engineer-Technical Lead

    Azure Data Engineer-Technical Lead

    Sigmoid • Bengaluru, Karnataka, India
    Kindly find the Job Description Below.Job Title : Technical Lead-Azure Data Engineer.Years of Experience : 10+ years of experience. We are looking for a detailed oriented self-starter to assist our eng...Show more
    Last updated: 6 days ago • Promoted
    Azure Data Solutions Engineer

    Azure Data Solutions Engineer

    Sigmoid • Bengaluru, Republic Of India, IN
    We are seeking a highly skilled and motivated Data Engineer to join our dynamic team.You will be responsible for designing, implementing, and maintaining data pipelines to support our organization'...Show more
    Last updated: 18 days ago • Promoted
    Senior Azure Data Engineer

    Senior Azure Data Engineer

    Confidential • Bengaluru, Republic Of India, IN
    We are seeking a skilled and motivated Azure Data Architect with 8-12 years of relevant experience.Candidate will play a pivotal role in designing, implementing, and optimizing large-scale data sol...Show more
    Last updated: 16 days ago • Promoted
    Azure Data Engineer - Synapse Analytics / Apache Airflow

    Azure Data Engineer - Synapse Analytics / Apache Airflow

    Nazztec Private Limited • Bangalore
    Job Title : Azure data engineer Location : Bangalore Experience : 6- 8 years ...Show more
    Last updated: 30+ days ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    E-Solutions • Bengaluru, Karnataka, India
    Location : Bangalore, Chennai , Hyderabad.Azure Data Factory, Azure Databricks, Pyspark / Scala, Logic App, Azure SQL, ADLS Gen 2. Azure key Vault, T-SQL, Stored Procedure.Developing, managing and opti...Show more
    Last updated: 1 day ago • Promoted
    Senior Azure Data Engineer

    Senior Azure Data Engineer

    Wissen Infotech • Bengaluru, Karnataka, India
    Azure Data Engineer Know anyone who is interested!! Share your resumes to adilakshmi.Wissen Infotech is hiring for Bangalore. Job Title : Azure Data Engineer.Years of Experience : 8 plus years.Locatio...Show more
    Last updated: 30+ days ago • Promoted
    Lead Azure Data Engineer

    Lead Azure Data Engineer

    IQVIA • Bengaluru, Karnataka, India
    Data Engineering, Python, Azure Databricks, Database, People management experience.Manages a team of professional-level employees. Develops and communicates plans and priorities to meet team perform...Show more
    Last updated: 16 days ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Capgemini Invent • Bengaluru, Karnataka, India
    At Capgemini Invent, we believe difference drives change.As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to...Show more
    Last updated: 6 days ago • Promoted
    Data Engineer (Airflow, Azure)

    Data Engineer (Airflow, Azure)

    Luxoft • Bengaluru, Karnataka, India
    This project is part of a strategic initiative to migrate legacy on-premises data systems to a modern, scalable cloud-based data platform using Snowflake on Azure. The goal is to enhance data access...Show more
    Last updated: 2 days ago • Promoted
    Azure Data Engineer - Databricks

    Azure Data Engineer - Databricks

    Confidential • Bengaluru / Bangalore
    Role- Azure Data Engineer - Databricks.Build the solution for optimal extraction, transformation, and loading of data from a wide variety of data sources using Azure data ingestion and transformati...Show more
    Last updated: 30+ days ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Confidential • Bengaluru / Bangalore
    Azure Data Engineering Stack (Data Factory, Databricks, Synapse, Event Hub, Cosmos DB, ADLS Gen2, Function app).Good understanding of other Azure services. Good understanding of Data Warehouse Archi...Show more
    Last updated: 30+ days ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Trigent Software Private Limited • Bengaluru, Karnataka, India
    AZure Python SQL Factory (ADF) : For orchestrating and automating data movement and transformation.Databricks / Apache Spark : For big data processing and large-scale ETL / ELT.Synapse Analytics : For da...Show more
    Last updated: 30+ days ago • Promoted
    Azure Data Engineer ( Azure Databricks)

    Azure Data Engineer ( Azure Databricks)

    Confidential • Bengaluru / Bangalore
    Design, develop, and optimize large-scale data pipelines using Azure Data Factory, Azure Databricks, and Azure Synapse.Implement data lake solutions and work with structured and unstructured datase...Show more
    Last updated: 27 days ago • Promoted
    Azure data engineer

    Azure data engineer

    Tata Consultancy Services • Bengaluru, Karnataka, India
    We await your innovation at TCS : Hiring |.Greetings from TCS!! We are Hiring for Azure Data Engineer.Required Experience : 8-12 years. Work location : Chennai, Bangalore.Required technical Skills : Azu...Show more
    Last updated: 23 days ago • Promoted
    Senior Azure Data Solutions Engineer

    Senior Azure Data Solutions Engineer

    Capgemini Invent • Bengaluru, Republic Of India, IN
    At Capgemini Invent, we believe difference drives change.As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to...Show more
    Last updated: 6 days ago • Promoted