Talent.com
Databricks SME
Databricks SMEDataE2E Technologies • Palakkad, IN
Databricks SME

Databricks SME

DataE2E Technologies • Palakkad, IN
18 hours ago
Job description

Salary - Upto 25 LPA

Key Responsibilities

  • Design, develop, and maintain data pipelines and ETL processes on Databricks .
  • Lead the architecture and implementation of scalable, secure, and high-performance data solutions.
  • Collaborate with business stakeholders, data scientists, and analysts to gather requirements and deliver actionable data solutions.
  • Optimize data workflows for performance, cost-efficiency, and reliability .
  • Integrate data from multiple structured and unstructured sources into Delta Lake and cloud data warehouses.
  • Implement best practices in data governance, security, and quality management.
  • Mentor junior engineers and provide technical leadership in data engineering best practices.
  • Troubleshoot and resolve issues in data pipelines, ensuring high data availability and integrity .

Required Skills & Experience

  • 7+ years of experience in Data Engineering .
  • Proven Subject Matter Expertise in Databricks (including Databricks SQL, Delta Lake, and MLflow).
  • Strong experience with PySpark , Spark SQL , and Scala .
  • Hands-on experience with cloud platforms (Azure preferred; AWS / GCP a plus).
  • Proficiency in data modeling, ETL development , and data warehousing concepts.
  • Solid understanding of big data ecosystems (Hadoop, Kafka, etc.).
  • Strong SQL development skills with a focus on performance tuning .
  • Experience in implementing CI / CD pipelines for data solutions.
  • Create a job alert for this search

    Sme • Palakkad, IN

    Related jobs
    Azure Databricks+Pyspark

    Azure Databricks+Pyspark

    Tata Consultancy Services • Coimbatore, IN
    TCS is conducting Virtual Drive for Azure Data Engineer + Pyspark.Years of Experience : 6 to 10yrs.Location : Bangalore & Hyderabad. Kindly apply if there is a skill match with 6+yrs of experience.Ove...Show more
    Last updated: 14 days ago • Promoted
    Databricks SQL Engineer with Commercial Pharma

    Databricks SQL Engineer with Commercial Pharma

    Keasis • Palakkad, IN
    Job Title : Databricks SQL Engineer with Commercial Pharma.We are looking for a Databricks SQL Engineer to design, develop, and optimize data solutions using Databricks SQL.The ideal candidate will ...Show more
    Last updated: 30+ days ago • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    CYAN360 • Coimbatore, IN
    Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Digitalzone • Thrissur, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show more
    Last updated: 14 days ago • Promoted
    Databricks Data Architect

    Databricks Data Architect

    Tata Consultancy Services • coimbatore, tamil nadu, in
    Experience with machine learning frameworks and pipelines, particularly in Databricks.Familiarity with containerized environments (e. Docker, Kubernetes) for deploying data workflows.Should be able ...Show more
    Last updated: 13 days ago • Promoted
    Dashboard Engineer – Datadog & Power BI

    Dashboard Engineer – Datadog & Power BI

    Mogra.ai • Palakkad, IN
    Month (with possibility of extension).Monday to Friday, 5 PM – 8 PM IST.This is a short-term contract (1 month) focused on helping our technical and business teams translate system and infrastructu...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Recro • Coimbatore, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer (GCP)

    Data Engineer (GCP)

    HISH IT SERVICES • Palakkad, IN
    We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery). This role requires a hands-on developer who can collaborate closely wit...Show more
    Last updated: 5 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AI • Palakkad, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
    Last updated: 30+ days ago • Promoted
    Data Architect - Snowflake

    Data Architect - Snowflake

    Reflections Info Systems • Palakkad, IN
    We are looking for 10 + year experienced Data Architect with strong background in Snowflake, demonstrating leadership in technical design, architecture, and implementation of complex data solutions...Show more
    Last updated: 4 days ago • Promoted
    Enterprise Data Architect

    Enterprise Data Architect

    DBiz.ai • Coimbatore, IN
    You will ensure that data is modeled, structured and integrated across the organization to support analytics and AI / ML initiatives at scale. You will work closely with business stakeholders and tech...Show more
    Last updated: 25 days ago • Promoted
    Sr Data Engineer

    Sr Data Engineer

    Mitchell Martin Inc. • Coimbatore, IN
    Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer to design, build, and optimize data pipelines and systems that power our analytics, reporting, and data-driven decision-mak...Show more
    Last updated: 27 days ago • Promoted
    Senior Data Platform Engineer

    Senior Data Platform Engineer

    Black Dog Labs • Coimbatore, IN
    Remote (collaboration across time zones), India or LATAM preferred.Proficient English communication.Data Engineering / Backend Engineering / DevOps. We’re looking for a hands-on Senior Data Platform...Show more
    Last updated: 30+ days ago • Promoted
    Azure Databricks Admin

    Azure Databricks Admin

    Greymatter Innovationz • Coimbatore, IN
    Greymatter Innovationz helps you stay digitally relevant across domains, technologies, and skillsets, every day.Location : Anywhere in India / Bangalore preferred. Databricks Platform Support and capa...Show more
    Last updated: 28 days ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    People Consultancy Services (PCS) • Palakkad, IN
    Shift Timing : 11 : 00 AM – 8 : 00 PM (India Time).Looking for 5+ Years experience in Advanced SQL, Azure Data Factory (ADF), Databricks (with PySpark). Experience with Azure Synapse (added advantage).St...Show more
    Last updated: 8 days ago • Promoted
    Data Engineering Role

    Data Engineering Role

    100x.inc • Thrissur, IN
    At least 3 years of professional experience in Data Engineering.Demonstrated end-to-end ownership of ETL pipelines.Deep, hands-on experience with AWS services : EC2, Athena, Lambda, and Step Functio...Show more
    Last updated: 30+ days ago • Promoted
    Data Modeler

    Data Modeler

    Stratus • Palakkad, IN
    Lead a team of data engineers to develop data analytic solutions such as data warehouse and data marts on Azure Databricks. Experience with Agile development methodologies and tools, such as Jira, t...Show more
    Last updated: 5 days ago • Promoted
    AWS Data Architect

    AWS Data Architect

    ACL Digital • Coimbatore, IN
    AWS (S3, Redshift, Glue, Lake Formation, IAM).Proficient in data modeling, performance tuning, and security best practices. .AWS Certified Solutions Architect preferred.Show more
    Last updated: 4 days ago • Promoted