Talent.com
Data Engineer
Data EngineerUbique Systems • Bengaluru, Republic Of India, IN
Data Engineer

Data Engineer

Ubique Systems • Bengaluru, Republic Of India, IN
7 days ago
Job description

Primary skills : Python, SQL, data lakes, azure

Experience : 4+ years

Immediate Joiner

Key Responsibilities

Pipeline Development & Automation

  • Design, build, and maintain CI / CD pipelines to automate deployment of DQ rules and data services across environments.
  • Optimize data pipelines and jobs for efficiency, scalability, and enterprise-grade reliability within Azure and Databricks.
  • Implement best practices in version control, testing, and automated deployments.

Data Quality & Rule Development

  • Develop, optimize, and maintain DQ rules in PySpark / Python for self-serve capabilities.
  • Design and implement profiling frameworks for rule generation and automated remediation.
  • Ensure DQ frameworks align with enterprise standards, governance, and audit requirements.
  • UI & Self-Serve Integration

  • Collaborate with front-end teams (Node.Js / Angular) to enable rule configuration, validation, and monitoring via a low-code UI.
  • Develop APIs and services to expose DQ results and outputs for dashboards and self-service tools.
  • Collaboration & Governance

  • Partner with Data Stewards, GPOs, and business owners to translate requirements into technical solutions.
  • Contribute to BRDs, SRDs, and design reviews for DQ rules and pipelines.
  • Provide inputs on governance, compliance, and change management processes.
  • Support periodic reviews and continuous improvements of pipelines, rules, and dashboards.
  • Required Skills & Qualifications

  • Strong programming skills in PySpark, Python, and SQL.
  • Hands-on experience with Databricks (clusters, notebooks, Delta Lake).
  • Experience designing and implementing CI / CD pipelines (Azure DevOps / GitHub Actions / Jenkins).
  • Familiarity with Node.Js & Angular for UI integration.
  • Solid understanding of data governance, DQ frameworks, and MDM concepts.
  • Strong analytical, problem-solving, and stakeholder engagement skills.
  • Cloud expertise, preferably Azure Data Lake, Data Factory, and Synapse.
  • Education & Experience

  • Bachelor’s or Master’s degree in Computer Science, Information Systems, or related field.
  • 4–8 years of relevant experience in data engineering, CI / CD, and DQ rule development.
  • Proven expertise in Databricks, Azure data services, and low-code self-serve frameworks.
  • Create a job alert for this search

    Data Engineer • Bengaluru, Republic Of India, IN

    Related jobs
    Data Engineer 2

    Data Engineer 2

    Yubi • Bangalore Urban, Karnataka, India
    As a Data Engineer, you will be part of a highly talented Data Engineering team.Responsible for developing reusable capabilities and tools to automate various types of data processing pipelines.You...Show more
    Last updated: 30+ days ago • Promoted
    Customer Engineer (Data Engineer)

    Customer Engineer (Data Engineer)

    Konecta • Bangalore, IN
    In this role, you will be the technical point of contact for the customer – a trusted partner for their IT leadership – as the primary engineer on the project, working with multifunctional teams bo...Show more
    Last updated: 4 days ago • Promoted
    Data Engineer I

    Data Engineer I

    Licious • Bengaluru, Republic Of India, IN
    SDE 1 – Data Platform Engineer.We are looking for a passionate and motivated.Software Development Engineer (SDE 1) – Data Platform. Data Platform Engineering team at.In this role, you’ll design, bui...Show more
    Last updated: 5 days ago • Promoted
    Data Engineer

    Data Engineer

    Insight Global • Bangalore, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer, CMT Dataplatform & Analytics

    Data Engineer, CMT Dataplatform & Analytics

    Amazon • Bengaluru, Karnataka, India
    This job is with Amazon, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly.DESCRIPTION : Amaz...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Confidential • Bengaluru / Bangalore, Chandigarh
    Collaborate with other engineers, customers to brainstorm and develop impactful data.Leverage AI and machine learning techniques to integrate intelligent features into our.Develop, and optimize end...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    AppsForBharat • Bengaluru, Karnataka, India
    We are looking for a Senior Data Engineer to lead the design and development of a next-generation data platform that powers real-time and batch applications at scale. This platform supports business...Show more
    Last updated: 23 days ago • Promoted
    Data Engineer

    Data Engineer

    The Customization Group • Bengaluru, Karnataka, India
    An information technology firm that provides consulting services in IT, software, and advanced areas such as Artificial Intelligence. By leveraging latest technologies, we offer.We have a brand-new ...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Synechron • Bengaluru, Republic Of India, IN
    We have immediate opportunity for AWS data engineer.At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innova...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Recro • Bengaluru, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer [T500-21309]

    Lead Data Engineer [T500-21309]

    ANSR • Bengaluru, Karnataka, India
    ANSR is hiring for one of its clients.Martens is an iconic British brand founded in 1960 in Northamptonshire.Produced originally for workers looking for tough, durable boots, the brand was quickly ...Show more
    Last updated: 21 days ago • Promoted
    Data Engineer I, CMT Dataplatform & Analytics

    Data Engineer I, CMT Dataplatform & Analytics

    Amazon • Bengaluru, Karnataka, India
    This job is with Amazon, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly.DESCRIPTION : Amaz...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer 1

    Data Engineer 1

    Aqilea (formerly Soltia) • Bangalore, Karnataka, India
    We are a consulting company with a bunch of technology-interested and happy people!.We love technology we love design and we love quality. Our diversity makes us unique and creates an inclusive and ...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Selector • Bengaluru, Karnataka, India
    Selector is building an operational intelligence platform for digital infrastructure.By adopting an AI / ML-based analytics approach, the platform provides actionable multi-dimensional.It enables ope...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Grid Dynamics • Bengaluru, Karnataka, India
    Grid Dynamics (Nasdaq : GDYN) is a digital-native technology services provider that accelerates growth and bolsters competitive advantage for Fortune 1000 companies. Grid Dynamics provides digital tra...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    RAOS INFOSOFT JOIN PRIVATE LIMITED • Bengaluru, India
    Looking to hire a data engineer with the following : .Born programmer, Strong in Python frameworks.Strong in SQL and RDBMS concepts. Should join within 1 week from the time interview is scheduled.Idea...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Veca Consulting Pvt Ltd • Bengaluru, India
    Location : Bangalore(No relocation).Notice Period : 20-30 days(who are currently serving).As a Data Engineer on our team, you will work on our Hadoop-based data warehouse, contributing to scalable ...Show more
    Last updated: 13 days ago • Promoted
    Data Engineer

    Data Engineer

    Mareana • Bengaluru, Karnataka, India
    Data Engineer Bangalore / Full-Time Job Description Mareana is looking for experienced Data Engineer with a strong development background using, RDMS, graph database and NoSQL platforms.This role...Show more
    Last updated: 30+ days ago • Promoted