Talent.com
Databricks SME
Databricks SMEDataE2E Technologies • Lucknow, IN
Databricks SME

Databricks SME

DataE2E Technologies • Lucknow, IN
1 day ago
Job description

Salary - Upto 25 LPA

Key Responsibilities

  • Design, develop, and maintain data pipelines and ETL processes on Databricks .
  • Lead the architecture and implementation of scalable, secure, and high-performance data solutions.
  • Collaborate with business stakeholders, data scientists, and analysts to gather requirements and deliver actionable data solutions.
  • Optimize data workflows for performance, cost-efficiency, and reliability .
  • Integrate data from multiple structured and unstructured sources into Delta Lake and cloud data warehouses.
  • Implement best practices in data governance, security, and quality management.
  • Mentor junior engineers and provide technical leadership in data engineering best practices.
  • Troubleshoot and resolve issues in data pipelines, ensuring high data availability and integrity .

Required Skills & Experience

  • 7+ years of experience in Data Engineering .
  • Proven Subject Matter Expertise in Databricks (including Databricks SQL, Delta Lake, and MLflow).
  • Strong experience with PySpark , Spark SQL , and Scala .
  • Hands-on experience with cloud platforms (Azure preferred; AWS / GCP a plus).
  • Proficiency in data modeling, ETL development , and data warehousing concepts.
  • Solid understanding of big data ecosystems (Hadoop, Kafka, etc.).
  • Strong SQL development skills with a focus on performance tuning .
  • Experience in implementing CI / CD pipelines for data solutions.
  • Create a job alert for this search

    Sme • Lucknow, IN

    Related jobs
    Azure Databricks+Pyspark

    Azure Databricks+Pyspark

    Tata Consultancy Services • Lucknow, IN
    TCS is conducting Virtual Drive for Azure Data Engineer + Pyspark.Years of Experience : 6 to 10yrs.Location : Bangalore & Hyderabad. Kindly apply if there is a skill match with 6+yrs of experience.Ove...Show more
    Last updated: 14 days ago • Promoted
    Databricks Data Architect

    Databricks Data Architect

    Tata Consultancy Services • lucknow, uttar pradesh, in
    Experience with machine learning frameworks and pipelines, particularly in Databricks.Familiarity with containerized environments (e. Docker, Kubernetes) for deploying data workflows.Should be able ...Show more
    Last updated: 14 days ago • Promoted
    Senior Solutions Architect (Data)

    Senior Solutions Architect (Data)

    Hillview Consulting Solutions • Lucknow, IN
    If candidate is in Mumbai this would be onsite in Andheri East, Mumbai, Maharashtra.We’re looking for a senior, hands-on. You’ll own architecture for ETL / ELT, data warehousing, analytics pipelines, ...Show more
    Last updated: 14 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    Veraxion • Lucknow, IN
    We are looking for a Senior Data Engineer who can design, build, and scale modern data platforms that power analytics, decision-making, and AI across the organization. If you love solving complex da...Show more
    Last updated: 14 hours ago • Promoted • New!
    AI and Databricks

    AI and Databricks

    Quantum Integrators • Lucknow, IN
    Role : AI and Databricks Engineer.Strong experience developing industry grade LLM and Gen-AI applications using OpenAI, Anthropic (Claude), or other major providers. Spark, Delta Lake, MLflow, Databr...Show more
    Last updated: 14 hours ago • Promoted • New!
    Azure + Databricks

    Azure + Databricks

    PwC India • Lucknow, IN
    Job Title : Azure Data Engineer.As a Manager in the Data Engineering practice, you will lead teams and client engagements to design, architect, and deliver enterprise-grade data platforms.You’ll dri...Show more
    Last updated: 14 hours ago • Promoted • New!
    SAP BW + Databricks,Snowflake

    SAP BW + Databricks,Snowflake

    PGC Digital (India) : CMMI Level 3 Company • Lucknow, IN
    PGC Digital – PradeepIT Global Consulting Pvt.AI-powered Digital, Cloud, and Talent Solutions.India, Singapore, USA, UK, UAE, and Canada. We believe storytelling is not just marketing — it’s how peo...Show more
    Last updated: 14 hours ago • Promoted • New!
    Azure Databricks

    Azure Databricks

    Kumaran Systems • Lucknow, IN
    We are seeking a skilled Azure Databricks with strong hands-on experience in Microsoft Azure services such as Data Factory, Storage, Synapse, and Key Vault. The candidate should be proficient in Dat...Show more
    Last updated: 14 hours ago • Promoted • New!
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy Services • Lucknow, IN
    TCS is Hiring AWS Data Engineer Bangalore location.Strong hands-on experience in Python programming and PySpark.Experience using AWS services (RedShift, Glue, EMR, S3 & Lambda).Experience working w...Show more
    Last updated: 14 days ago • Promoted
    Data Engineer

    Data Engineer

    Natlov Technologies Pvt Ltd • Lucknow, IN
    Hiring : Cloud Data Engineer | Remote | Full-Time | Immediate Joiner.Ltd is looking for a Cloud Data Engineer with strong AWS expertise and working experience in Azure. In this role, you will design,...Show more
    Last updated: 14 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    EXL • Lucknow, IN
    Develop high quality, secure and scalable data pipelines using spark, Scala / Python / Java on Hadoop or object storage like MinIO. Leverage technologies and solutions to innovate with increasingly larg...Show more
    Last updated: 30+ days ago • Promoted
    AI and Databricks Engineer

    AI and Databricks Engineer

    Quantum Integrators • Lucknow, IN
    Please find the detailed Job Description below : .Strong experience developing industry grade LLM and Gen-AI applications using OpenAI, Anthropic (Claude), or other major providers.Hands-on experienc...Show more
    Last updated: 14 hours ago • Promoted • New!
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    CYAN360 • Lucknow, IN
    Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show more
    Last updated: 30+ days ago • Promoted
    Sr. Azure Data Architect & Presales Solution

    Sr. Azure Data Architect & Presales Solution

    Programmers.io • Lucknow, IN
    Job Title : Azure Data Architect.Location : Hyderabad, Pune, Jaipur.Experience required : 12+ years.We are seeking a highly experienced. The ideal candidate should bring strong expertise in SQL, ETL / EL...Show more
    Last updated: 14 hours ago • Promoted • New!
    Senior Databricks Engineer (AWS,Spark / databricks, SQL)

    Senior Databricks Engineer (AWS,Spark / databricks, SQL)

    SID Information Technologies • Lucknow, IN
    Role : Senior Data Engineer (Python, Spark / Databricks, SQL, AWS).Hybrid (3 days / week in-office).S3, Glue, Redshift, EMR, Lambda. Strong SQL skills for data transformation and analytics.Expertise in s...Show more
    Last updated: 14 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    TekIT Software Solutions Pvt. Ltd. (India & USA) • Lucknow, IN
    Job Title : Senior Data Engineer.Kochi / Trivandrum / Bangalore.We are seeking a highly skilled.Spark, Kafka, modern cloud platforms (AWS / GCP / Azure), ETL processes, SQL, and Databricks.The ideal can...Show more
    Last updated: 5 days ago • Promoted
    Senior Data Architect

    Senior Data Architect

    Tata Consultancy Services • Lucknow, IN
    TCS is a leading global IT services, consulting, and business solutions organization that delivers real results to global businesses, ensuring a level of certainty no other firm can match.TCS is hi...Show more
    Last updated: 14 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    One Tapp Consulting • Lucknow, IN
    Design and Development : Design, build, and maintain robust, scalable, and optimized ETL / ELT.Python and standard data warehousing principles. Data Platform Management : Implement and manage data proce...Show more
    Last updated: 14 hours ago • Promoted • New!