Talent.com
Data Engineer

Data Engineer

PwC IndiaKarnataka, India
18 hours ago
Job description

About the Company : We are seeking a talented Data Engineer with strong expertise in Databricks, specifically in Unity Catalog, PySpark, and SQL, to join our data team. You’ll play a key role in building secure, scalable data pipelines and implementing robust data governance strategies using Unity Catalog.

Level : Manager / Senior Associates

Years of experience : 6-11 years

Location : Bangalore

Notice : Immediate joiners / Serving notice period

About the Role : Hiring for Azure Data Engineer / Architect (Databricks)

Responsibilities :

  • Design and implement ETL / ELT pipelines using Databricks and PySpark.
  • Work with Unity Catalog to manage data governance, access controls, lineage, and auditing across data assets.
  • Develop high-performance SQL queries and optimize Spark jobs.
  • Collaborate with data scientists, analysts, and business stakeholders to understand data needs.
  • Ensure data quality and compliance across all stages of the data lifecycle.
  • Implement best practices for data security and lineage within the Databricks ecosystem.
  • Participate in CI / CD, version control, and testing practices for data pipelines.

Qualifications :

  • Proven experience with Databricks and Unity Catalog (data permissions, lineage, audits).
  • Strong hands-on skills with PySpark and Spark SQL.
  • Solid experience writing and optimizing complex SQL queries.
  • Familiarity with Delta Lake, data lakehouse architecture, and data partitioning.
  • Experience with cloud platforms like Azure or AWS.
  • Understanding of data governance, RBAC, and data security standards.
  • Preferred Skills :

  • Databricks Certified Data Engineer Associate or Professional.
  • Experience with tools like Airflow, Git, Azure Data Factory, or dbt.
  • Exposure to streaming data and real-time processing.
  • Knowledge of DevOps practices for data engineering.
  • Create a job alert for this search

    Data Engineer • Karnataka, India

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    Alp Consulting Ltd.Karnataka, India
    Architect and maintain our Amazon Redshift Serverless data warehouse.Design and implement ETL pipelines from operational Redshift to staging (DSA), landing (DLA), and TDW layers.Model data using st...Show moreLast updated: 25 days ago
    • Promoted
    AWS Analytics || 12+years || Bangalore

    AWS Analytics || 12+years || Bangalore

    client of NeerInfo SolutionsKarnataka, India
    Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing.Create data pipelines, ensure data quality, and implement ETL (extract, transf...Show moreLast updated: 3 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy ServicesKarnataka, India, India
    Locations : Hyderabad, Kolkata, Noida, Chennai, Bangalore.Designing and building Databricks data pipelines is required.Experience in transforming the data using Azure Databricks & Delta lake.Hands-o...Show moreLast updated: 5 days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    VIDA Digital IdentityKarnataka, India
    At VIDA we’re building the future of digital identity.As a Data Engineer you’ll work across the stack—from platform and infrastructure to data pipelines and end-user tooling.You’ll help us moderniz...Show moreLast updated: 10 hours ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    ImpetusKarnataka, India
    We are looking for an experienced.The ideal candidate will be responsible for designing, building, and optimizing scalable data pipelines and analytics solutions that drive business insights.Design...Show moreLast updated: 25 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    TruecallerKarnataka, India
    Hello, Truecaller is calling you from Bangalore, India! Ready to pick up?.Our goal is to make communication smarter, safer, and more efficient, while building trust across the world.With our roots ...Show moreLast updated: 5 days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Atyeti IncKarnataka, India
    Looking for Data Engineer who will be responsible for design, build and maintenance of data pipelines running on Airflow, Spark on the AWS Cloud platform. Build and maintain all facets of Data Pipel...Show moreLast updated: 3 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    VeraxionKarnataka, India
    We are looking for a Senior Data Engineer who can design, build, and scale modern data platforms that power analytics, decision-making, and AI across the organization. If you love solving complex da...Show moreLast updated: 3 days ago
    • Promoted
    Palantir Foundry Data Engineer - 5+ Yrs - Bangalore

    Palantir Foundry Data Engineer - 5+ Yrs - Bangalore

    USTKarnataka, India
    CCTC | ECTC | Notice Period | Location Preference.Act fast for immediate attention! ⏳📩.Strong hands-on experience with.Ability to design, build and optimize large-scale data pipelines.Familiarity ...Show moreLast updated: 5 days ago
    • Promoted
    Generative AI Engineer

    Generative AI Engineer

    CapgeminiKarnataka, India, India
    Experience with NLP And Machine Learning.Understanding RAG, AI / ML Concepts.Experience Google Vertex AI, Langchain.Show moreLast updated: 7 days ago
    • Promoted
    • New!
    Azure Data Engineer-Technical Lead

    Azure Data Engineer-Technical Lead

    SigmoidKarnataka, India
    Kindly find the Job Description Below.Job Title : Technical Lead-Azure Data Engineer.Years of Experience : 10+ years of experience. We are looking for a detailed oriented self-starter to assist our eng...Show moreLast updated: 18 hours ago
    • Promoted
    Neo4j / Knowledge Graph Engineer

    Neo4j / Knowledge Graph Engineer

    PineQ Lab TechnologyKarnataka, India, India
    Looking for an experienced Knowledge Graph / Neo4j engineer to design, implement and operate graph-based data platforms and integrations. The role involves graph data modelling, building ETL pipelin...Show moreLast updated: 3 days ago
    • Promoted
    Backend Python Engineer - 17852

    Backend Python Engineer - 17852

    Turingkarnataka, karnataka, in
    We’re looking for experienced Python engineers to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improve how AI models think, reason, and ...Show moreLast updated: 5 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Flexton Inc.Karnataka, India
    San Jose, CA with development centers in India at multiple locations.We are a leading professional services company offering a unique product mix that extends into Technology, Consulting, Digital a...Show moreLast updated: 14 days ago
    • Promoted
    AI Data Engineer - 17852

    AI Data Engineer - 17852

    Turingkarnataka, karnataka, in
    We’re looking for experienced AI data engineers skilled in Python to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improve how AI models ...Show moreLast updated: 5 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Quess IT StaffingKarnataka, India
    We are looking for a highly skilled.The ideal candidate should have deep expertise in.Snowflake, PySpark, SQL, DBT, Airflow.Show moreLast updated: 3 days ago
    • Promoted
    • New!
    Senior Data Engineer / Architect - Snowflake

    Senior Data Engineer / Architect - Snowflake

    Aezion, IncKarnataka, India
    We are seeking a highly skilled Snowflake Data Engineer with expertise in DBT, Airbyte, and Airflow, combined with strong experience in Kimball dimensional modeling. The ideal candidate will design ...Show moreLast updated: 18 hours ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Ubique SystemsKarnataka, India
    Primary skills : Python, SQL, data lakes, azure.Pipeline Development & Automation.Design, build, and maintain CI / CD pipelines to automate deployment of DQ rules and data services across environments...Show moreLast updated: 18 hours ago