Talent.com
No longer accepting applications
Databricks SME

Databricks SME

DataE2E Technologiescoimbatore, tamil nadu, in
2 days ago
Job description

Salary - Upto 25 LPA

Key Responsibilities

  • Design, develop, and maintain data pipelines and ETL processes on Databricks .
  • Lead the architecture and implementation of scalable, secure, and high-performance data solutions.
  • Collaborate with business stakeholders, data scientists, and analysts to gather requirements and deliver actionable data solutions.
  • Optimize data workflows for performance, cost-efficiency, and reliability .
  • Integrate data from multiple structured and unstructured sources into Delta Lake and cloud data warehouses.
  • Implement best practices in data governance, security, and quality management.
  • Mentor junior engineers and provide technical leadership in data engineering best practices.
  • Troubleshoot and resolve issues in data pipelines, ensuring high data availability and integrity .

Required Skills & Experience

  • 7+ years of experience in Data Engineering .
  • Proven Subject Matter Expertise in Databricks (including Databricks SQL, Delta Lake, and MLflow).
  • Strong experience with PySpark , Spark SQL , and Scala .
  • Hands-on experience with cloud platforms (Azure preferred; AWS / GCP a plus).
  • Proficiency in data modeling, ETL development , and data warehousing concepts.
  • Solid understanding of big data ecosystems (Hadoop, Kafka, etc.).
  • Strong SQL development skills with a focus on performance tuning .
  • Experience in implementing CI / CD pipelines for data solutions.
  • Create a job alert for this search

    Sme • coimbatore, tamil nadu, in

    Related jobs
    • Promoted
    Databricks Data Engineer Lead – Sustainability Project

    Databricks Data Engineer Lead – Sustainability Project

    Blue Cloud Softech Solutions LimitedCoimbatore, IN
    BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level ...Show moreLast updated: 1 day ago
    • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    CYAN360Coimbatore, IN
    Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Vista Applied Solutions Group IncTiruppur, IN
    Job Summary for AWS Data Engineer : .Job Qualification and Responsibilities for AWS Data Engineer : .Advanced SQL (performance tuning, joins, windows functions). Hands-on with AWS : Glue, Lambda, Redshif...Show moreLast updated: 1 day ago
    • Promoted
    (Senior) Azure Data Engineer - Full remote - contractor in USD

    (Senior) Azure Data Engineer - Full remote - contractor in USD

    All European CareersPalakkad, IN
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Associate Director, Data Architecture (Snowflake • Databricks • AWS • CPG / FMCG • Enterprise Data)

    Associate Director, Data Architecture (Snowflake • Databricks • AWS • CPG / FMCG • Enterprise Data)

    Sky Systems, Inc. (SkySys)Tiruppur, IN
    Associate Director, Data Architecture.Full-Time Contract (40hrs / week).Months+ (with a possibility of Contract-to-Hire). Marketing, Product, Finance, Supply Chain, and global business teams.This role...Show moreLast updated: 8 hours ago
    • Promoted
    Senior Solutions Architect (Data)

    Senior Solutions Architect (Data)

    Hillview Consulting SolutionsCoimbatore, IN
    If candidate is in Mumbai this would be onsite in Andheri East, Mumbai, Maharashtra.We’re looking for a senior, hands-on. You’ll own architecture for ETL / ELT, data warehousing, analytics pipelines, ...Show moreLast updated: 1 day ago
    • Promoted
    Azure Databricks Admin

    Azure Databricks Admin

    Greymatter InnovationzPalakkad, IN
    Greymatter Innovationz helps you stay digitally relevant across domains, technologies, and skillsets, every day.Location : Anywhere in India / Bangalore preferred. Databricks Platform Support and capa...Show moreLast updated: 29 days ago
    • Promoted
    • New!
    Senior Data Architect - Snowflake

    Senior Data Architect - Snowflake

    Reflections Info SystemsPalakkad, IN
    We are looking for 10 + year experienced Data Architect with strong background in Snowflake, demonstrating leadership in technical design, architecture, and implementation of complex data solutions...Show moreLast updated: 20 hours ago
    • Promoted
    AWS Data Architect

    AWS Data Architect

    ACL DigitalPalakkad, IN
    AWS (S3, Redshift, Glue, Lake Formation, IAM).Proficient in data modeling, performance tuning, and security best practices. .AWS Certified Solutions Architect preferred.Show moreLast updated: 6 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DonyatiPalakkad, IN
    We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer (GCP)

    Data Engineer (GCP)

    HISH IT SERVICESPalakkad, IN
    We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery). This role requires a hands-on developer who can collaborate closely wit...Show moreLast updated: 7 days ago
    • Promoted
    Azure Databricks

    Azure Databricks

    Kumaran SystemsCoimbatore, IN
    We are seeking a skilled Azure Databricks with strong hands-on experience in Microsoft Azure services such as Data Factory, Storage, Synapse, and Key Vault. The candidate should be proficient in Dat...Show moreLast updated: 1 day ago
    • Promoted
    Sr. Azure Data Architect & Presales Solution

    Sr. Azure Data Architect & Presales Solution

    Programmers.ioPalakkad, IN
    Job Title : Azure Data Architect.Location : Hyderabad, Pune, Jaipur.Experience required : 12+ years.We are seeking a highly experienced. The ideal candidate should bring strong expertise in SQL, ETL / EL...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    DigitalzonePalakkad, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 15 days ago
    • Promoted
    Data Modeler

    Data Modeler

    StratusCoimbatore, IN
    Lead a team of data engineers to develop data analytic solutions such as data warehouse and data marts on Azure Databricks. Experience with Agile development methodologies and tools, such as Jira, t...Show moreLast updated: 7 days ago
    • Promoted
    Dashboard Engineer – Datadog & Power BI

    Dashboard Engineer – Datadog & Power BI

    Mogra.aiTiruppur, IN
    Month (with possibility of extension).Monday to Friday, 5 PM – 8 PM IST.This is a short-term contract (1 month) focused on helping our technical and business teams translate system and infrastructu...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Oracle Data Engineer

    Senior Oracle Data Engineer

    Strattek ConsultingCoimbatore, IN
    This role centers on architecting robust data pipelines across on-prem and cloud Oracle ecosystems, automating ingestion from varied sources including APIs. Exposure to Oracle FDI (Fusion Data Intel...Show moreLast updated: 1 day ago
    • Promoted
    Enterprise Data Architect

    Enterprise Data Architect

    DBiz.aiTiruppur, IN
    You will ensure that data is modeled, structured and integrated across the organization to support analytics and AI / ML initiatives at scale. You will work closely with business stakeholders and tech...Show moreLast updated: 26 days ago