Talent.com
Databricks SME
Databricks SMEDataE2E Technologies • Prayagraj(Allahabad), IN
Databricks SME

Databricks SME

DataE2E Technologies • Prayagraj(Allahabad), IN
10 days ago
Job description

Salary - Upto 25 LPA

Key Responsibilities

  • Design, develop, and maintain data pipelines and ETL processes on Databricks .
  • Lead the architecture and implementation of scalable, secure, and high-performance data solutions.
  • Collaborate with business stakeholders, data scientists, and analysts to gather requirements and deliver actionable data solutions.
  • Optimize data workflows for performance, cost-efficiency, and reliability .
  • Integrate data from multiple structured and unstructured sources into Delta Lake and cloud data warehouses.
  • Implement best practices in data governance, security, and quality management.
  • Mentor junior engineers and provide technical leadership in data engineering best practices.
  • Troubleshoot and resolve issues in data pipelines, ensuring high data availability and integrity .

Required Skills & Experience

  • 7+ years of experience in Data Engineering .
  • Proven Subject Matter Expertise in Databricks (including Databricks SQL, Delta Lake, and MLflow).
  • Strong experience with PySpark , Spark SQL , and Scala .
  • Hands-on experience with cloud platforms (Azure preferred; AWS / GCP a plus).
  • Proficiency in data modeling, ETL development , and data warehousing concepts.
  • Solid understanding of big data ecosystems (Hadoop, Kafka, etc.).
  • Strong SQL development skills with a focus on performance tuning .
  • Experience in implementing CI / CD pipelines for data solutions.
  • Create a job alert for this search

    Sme • Prayagraj(Allahabad), IN

    Related jobs
    AWS Data Architect

    AWS Data Architect

    ACL Digital • Prayagraj(Allahabad), IN
    AWS (S3, Redshift, Glue, Lake Formation, IAM).Proficient in data modeling, performance tuning, and security best practices. .AWS Certified Solutions Architect preferred.Show more
    Last updated: 14 days ago • Promoted
    Data Engineer

    Data Engineer

    Vriba Solutions • Prayagraj(Allahabad), IN
    Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions. Data validation, quality & cleansing.Translate busin...Show more
    Last updated: 30+ days ago • Promoted
    Azure Databricks Engineer

    Azure Databricks Engineer

    Philodesign Technologies Inc • Prayagraj(Allahabad), IN
    Job Opening : Azure Databricks Engineer (7+ Years Experience) | Budget : ₹1 LPM | Remote / Hybrid.We are seeking a highly skilled. This role is ideal for professionals who have deep expertise in buildin...Show more
    Last updated: 1 day ago • Promoted
    Sr. Azure Data Architect & Presales Solution

    Sr. Azure Data Architect & Presales Solution

    Programmers.io • Prayagraj(Allahabad), IN
    Job Title : Azure Data Architect.Location : Hyderabad, Pune, Jaipur.Experience required : 12+ years.We are seeking a highly experienced. The ideal candidate should bring strong expertise in SQL, ETL / EL...Show more
    Last updated: 9 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    RapidBrains • Prayagraj(Allahabad), IN
    Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer with deep expertise in Azure Data Engineering to design, build, and optimize large-scale data pipelines.The ideal candidate...Show more
    Last updated: 14 days ago • Promoted
    Senior Data Engineer (Snowflake)

    Senior Data Engineer (Snowflake)

    Redwolf + Rosch • AU
    We are seeking an experienced Senior Data Engineer who is passionate about automation and committed to building scalable, repeatable processes. Your efforts will focus on optimising workflows and re...Show more
    Last updated: 17 days ago
    Databricks Engineer

    Databricks Engineer

    Accenture • AU
    Databricks Data Engineer Consultant.You’ll work on cutting-edge cloud and hybrid data projects, developing scalable pipelines and transforming raw data into meaningful insights.You’ll be hands-on f...Show more
    Last updated: 30+ days ago
    Data Engineer

    Data Engineer

    IntraEdge • Prayagraj(Allahabad), IN
    We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show more
    Last updated: 30+ days ago • Promoted
    Data Support Engineer ( Azure, Databricks )

    Data Support Engineer ( Azure, Databricks )

    Kumaran Systems • Prayagraj(Allahabad), IN
    We’re looking for a skilled Data Support Engineer with.The ideal candidate will serve as the escalation point for data ingestion, pipeline, and consumption issues while ensuring high system stabili...Show more
    Last updated: 2 days ago • Promoted
    Databricks Data Engineer Manager

    Databricks Data Engineer Manager

    Accenture • AU
    Join our dynamic Data & AI practice as a.Databricks Data Engineering Manager.You will guide high-performing teams to design and implement scalable data solutions leveraging Databricks and cloud...Show more
    Last updated: 30+ days ago
    Databricks Data Engineer Lead – Sustainability Project

    Databricks Data Engineer Lead – Sustainability Project

    Blue Cloud Softech Solutions Limited • Prayagraj(Allahabad), IN
    BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level ...Show more
    Last updated: 9 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Mindlance • Prayagraj(Allahabad), IN
    We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show more
    Last updated: 7 days ago • Promoted
    Databricks - Data Platform Architect

    Databricks - Data Platform Architect

    Accenture • AU
    We work with one shared purpose : to deliver on the promise of technology and human ingenuity.Every day, more than 775,000 of us help our stakeholders continuously reinvent.Together, we drive positi...Show more
    Last updated: 30+ days ago
    Senior Solutions Architect (Data)

    Senior Solutions Architect (Data)

    Hillview Consulting Solutions • Prayagraj(Allahabad), IN
    If candidate is in Mumbai this would be onsite in Andheri East, Mumbai, Maharashtra.We’re looking for a senior, hands-on. You’ll own architecture for ETL / ELT, data warehousing, analytics pipelines, ...Show more
    Last updated: 9 days ago • Promoted
    Azure Databricks

    Azure Databricks

    Kumaran Systems • Prayagraj(Allahabad), IN
    We are seeking a skilled Azure Databricks with strong hands-on experience in Microsoft Azure services such as Data Factory, Storage, Synapse, and Key Vault. The candidate should be proficient in Dat...Show more
    Last updated: 9 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Donyati • Prayagraj(Allahabad), IN
    We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show more
    Last updated: 9 days ago • Promoted
    Associate Director, Data Architecture (Snowflake • Databricks • AWS • CPG / FMCG • Enterprise Data)

    Associate Director, Data Architecture (Snowflake • Databricks • AWS • CPG / FMCG • Enterprise Data)

    Sky Systems, Inc. (SkySys) • Prayagraj(Allahabad), IN
    Associate Director, Data Architecture.Full-Time Contract (40hrs / week).Months+ (with a possibility of Contract-to-Hire). Marketing, Product, Finance, Supply Chain, and global business teams.This role...Show more
    Last updated: 8 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AI • Prayagraj(Allahabad), IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
    Last updated: 30+ days ago • Promoted