Talent.com
Databricks Engineer
Databricks EngineerTTC Group • indore, madhya pradesh, in
No longer accepting applications
Databricks Engineer

Databricks Engineer

TTC Group • indore, madhya pradesh, in
4 days ago
Job description

Role : Databricks Engineer

Position : Remote

Type : Contract

Duration : 3 - 6 months (extendable)

Role Overview

We are seeking a Mid-Level Databricks Engineer with strong data engineering fundamentals and hands-on experience building scalable data pipelines on the Databricks platform. The ideal candidate will be comfortable working with distributed data processing, designing Delta Lake architectures, implementing CI / CD for data workloads, and optimizing Spark jobs for performance and reliability.

Required Skills

  • Strong hands-on experience in building data pipeline using scripting language includes Python, PySpark and SQL
  • Strong working experience with Databricks (Unity Catalog is plus) and Azure Data Factory (ADF)
  • Hands-on working experience with Azure DevOps Repo and CI / CD
  • Strong understanding of modern Data Architecture, Data Warehousing concepts, Data Modelling and ETL / ELT processes
  • Understanding of Agile ways of working
  • Any experience working in DBT is a plus
  • Working with Retail Domain is a plus

Platform Engineering & Operations

  • Configure and optimize Databricks clusters, including autoscaling, cluster sizing, and runtime selection.
  • Manage databases, schemas, and Delta Lake tables, including vacuuming, Z-ordering, partitioning, and optimization.
  • Work with catalogs, Unity Catalog (UC), and access controls for secure data governance.
  • Monitor and troubleshoot performance issues across jobs, clusters, and workflows.
  • CI / CD & DevOps

  • Implement CI / CD pipelines for Databricks workflows using GitHub Actions / Azure DevOps / GitLab.
  • Work with Databricks Repos and Git workflows (branching, PRs, code reviews).
  • Version and promote data pipelines across environments.
  • Cloud & Integration

  • Integrate Databricks with cloud services such as :
  • Azure : ADLS Gen2, Key Vault, ADF, Event Hub, Synapse
  • AWS : S3, Glue, IAM, Lambda, Kinesis (depending on cloud environment)
  • Work with data ingestion frameworks, messaging systems, and event-driven architectures.
  • Quality, Testing & Documentation

  • Implement unit tests and integration tests using pytest, SQL tests, or dbx testing frameworks.
  • Maintain pipeline documentation, data dictionaries, and technical design artifacts.
  • Ensure high data quality, reliability, and observability.
  • Create a job alert for this search

    Engineer • indore, madhya pradesh, in

    Related jobs
    Databricks Data Architect

    Databricks Data Architect

    Tata Consultancy Services • indore, madhya pradesh, in
    Experience with machine learning frameworks and pipelines, particularly in Databricks.Familiarity with containerized environments (e. Docker, Kubernetes) for deploying data workflows.Should be able ...Show more
    Last updated: 20 days ago • Promoted
    Customer Engineer (Data Engineer)

    Customer Engineer (Data Engineer)

    Konecta • indore, madhya pradesh, in
    In this role, you will be the technical point of contact for the customer – a trusted partner for their IT leadership – as the primary engineer on the project, working with multifunctional teams bo...Show more
    Last updated: 1 day ago • Promoted
    Databricks Engineer

    Databricks Engineer

    DataE2E Technologies • indore, madhya pradesh, in
    We are looking for an experienced.The ideal candidate has hands-on experience in Databricks production environments, along with. You will collaborate with cross-functional teams to create robust dat...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Digitalzone • indore, madhya pradesh, in
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show more
    Last updated: 20 days ago • Promoted
    Senior AWS Data Engineer_Exp : 5+ Years

    Senior AWS Data Engineer_Exp : 5+ Years

    Atyeti Inc • indore, madhya pradesh, in
    Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.Python; strong SQL and clo...Show more
    Last updated: 20 days ago • Promoted
    Senior Snowflake Data Engineer

    Senior Snowflake Data Engineer

    Luxoft • indore, madhya pradesh, in
    We are seeking a highly skilled Snowflake Data Engineer with 7 years of IT experience to design, build, and optimize scalable data pipelines and cloud-based solutions across AWS, Azure, and GCP.The...Show more
    Last updated: 11 hours ago • Promoted • New!
    Databricks Data Engineer Lead – Sustainability Project

    Databricks Data Engineer Lead – Sustainability Project

    Blue Cloud Softech Solutions Limited • indore, madhya pradesh, in
    BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level ...Show more
    Last updated: 6 days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy Services • indore, madhya pradesh, in
    Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show more
    Last updated: 29 days ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy Services • indore, madhya pradesh, in
    TCS is Hiring for Azure Data Engineer.Primary : Azure Data Factory (ADF), Azure Databricks (ADB).Secondary : SSIS (SQL Server Integration Services). Strong expertise in Azure Data Engineering & ETL Co...Show more
    Last updated: 30+ days ago • Promoted
    Snowflake Data Engineer

    Snowflake Data Engineer

    Live Connections • indore, madhya pradesh, in
    Role - Snowflake Data Engineer.Required Notice Period - Immediate Joiner.To apply, connect with Abhishek via abhishek.Show more
    Last updated: 10 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Live Connections • indore, madhya pradesh, in
    Hiring : Data Engineer | 9-12 Years Experience | Remote (India).Python, SQL, Big Data, Cloud, Snowflake.We are looking for an experienced. The ideal candidate will have deep experience in.Python, SQL...Show more
    Last updated: 30+ days ago • Promoted
    Bioinformatics Data Engineer

    Bioinformatics Data Engineer

    Vista Applied Solutions Group Inc • indore, madhya pradesh, in
    Client is looking for Bioinformatics Data Engineer and this is remote position from India.Build acquisition pipelines from systems including Oracle, SAP, and SQL databases.Transform data to support...Show more
    Last updated: 11 hours ago • Promoted • New!
    (Senior) Azure Data Engineer - Full remote - contractor in USD

    (Senior) Azure Data Engineer - Full remote - contractor in USD

    All European Careers • indore, madhya pradesh, in
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show more
    Last updated: 6 days ago • Promoted
    Azure Databricks

    Azure Databricks

    Kumaran Systems • indore, madhya pradesh, in
    We are seeking a skilled Azure Databricks with strong hands-on experience in Microsoft Azure services such as Data Factory, Storage, Synapse, and Key Vault. The candidate should be proficient in Dat...Show more
    Last updated: 6 days ago • Promoted
    Data Engineer

    Data Engineer

    System Soft Technologies • indore, madhya pradesh, in
    Location : Remote (3–4-hour time zone overlaps with EST if off shore).Experience with next flow is required, as the consultant will make targeted enhancements to existing workflows and pipelines.Whi...Show more
    Last updated: 11 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    Tata Consultancy Services • indore, madhya pradesh, in
    TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show more
    Last updated: 30+ days ago • Promoted
    Azure data engineer

    Azure data engineer

    Stratus • indore, madhya pradesh, in
    Lead a team of data engineers to develop data analytic solutions such as data warehouse and data marts on Azure Databricks. Experience with Agile development methodologies and tools, such as Jira, t...Show more
    Last updated: 14 days ago • Promoted
    Data Engineer

    Data Engineer

    MyData Insights Pvt Ltd • indore, madhya pradesh, in
    The ideal candidate has a strong background in building scalable data solutions on.CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices.Design, bu...Show more
    Last updated: 4 days ago • Promoted