Talent.com
Data Engineer
Data EngineerUbique Systems • bangalore, karnataka, in
Data Engineer

Data Engineer

Ubique Systems • bangalore, karnataka, in
5 days ago
Job description

Primary skills : Python, SQL, data lakes, azure

Experience : 4+ years

Immediate Joiner

Key Responsibilities

Pipeline Development & Automation

  • Design, build, and maintain CI / CD pipelines to automate deployment of DQ rules and data services across environments.
  • Optimize data pipelines and jobs for efficiency, scalability, and enterprise-grade reliability within Azure and Databricks.
  • Implement best practices in version control, testing, and automated deployments.

Data Quality & Rule Development

  • Develop, optimize, and maintain DQ rules in PySpark / Python for self-serve capabilities.
  • Design and implement profiling frameworks for rule generation and automated remediation.
  • Ensure DQ frameworks align with enterprise standards, governance, and audit requirements.
  • UI & Self-Serve Integration

  • Collaborate with front-end teams (Node.js / Angular) to enable rule configuration, validation, and monitoring via a low-code UI.
  • Develop APIs and services to expose DQ results and outputs for dashboards and self-service tools.
  • Collaboration & Governance

  • Partner with Data Stewards, GPOs, and business owners to translate requirements into technical solutions.
  • Contribute to BRDs, SRDs, and design reviews for DQ rules and pipelines.
  • Provide inputs on governance, compliance, and change management processes.
  • Support periodic reviews and continuous improvements of pipelines, rules, and dashboards.
  • Required Skills & Qualifications

  • Strong programming skills in PySpark, Python, and SQL.
  • Hands-on experience with Databricks (clusters, notebooks, Delta Lake).
  • Experience designing and implementing CI / CD pipelines (Azure DevOps / GitHub Actions / Jenkins).
  • Familiarity with Node.js & Angular for UI integration.
  • Solid understanding of data governance, DQ frameworks, and MDM concepts.
  • Strong analytical, problem-solving, and stakeholder engagement skills.
  • Cloud expertise, preferably Azure Data Lake, Data Factory, and Synapse.
  • Education & Experience

  • Bachelor’s or Master’s degree in Computer Science, Information Systems, or related field.
  • 4–8 years of relevant experience in data engineering, CI / CD, and DQ rule development.
  • Proven expertise in Databricks, Azure data services, and low-code self-serve frameworks.
  • Create a job alert for this search

    Data Engineer • bangalore, karnataka, in

    Related jobs
    Data Engineer 2

    Data Engineer 2

    Yubi • Bangalore Urban, Karnataka, India
    As a Data Engineer, you will be part of a highly talented Data Engineering team.Responsible for developing reusable capabilities and tools to automate various types of data processing pipelines.You...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    TEKsystems • Bengaluru, Karnataka, India
    Years of experience : 5+ yrs Role Description About the role : The position is open with DaaS Core Data Assets Development and Support team, they focus on the serving external customers / clients and...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Insight Global • Bangalore, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Recro • Bangalore, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Mareana • Bengaluru, Karnataka, India
    Mareana is looking for experienced Data Engineer with a strong development background using, RDMS, graph database and NoSQL platforms. This role is responsible for developing and enhancing Mareana’s...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    HCLTech • Greater Bengaluru Area, India
    F2F Hackathon scheduled on 22nd Nov 2025.If you are passionate about building scalable data solutions on Google Cloud and enjoy solving real-time data engineering challenges, this is the perfect op...Show more
    Last updated: 30+ days ago • Promoted
    Data Bricks Engineer

    Data Bricks Engineer

    Relevance Lab • Greater Bengaluru Area, India
    SQL skills and hands-on experience using.AI-assisted development tools).The ideal candidate will be responsible for designing, developing, and optimizing data pipelines, supporting analytics worklo...Show more
    Last updated: 3 days ago • Promoted
    Lead Data Engineer [T500-21309]

    Lead Data Engineer [T500-21309]

    ANSR • Bengaluru, Karnataka, India
    ANSR is hiring for one of its clients.Martens is an iconic British brand founded in 1960 in Northamptonshire.Produced originally for workers looking for tough, durable boots, the brand was quickly ...Show more
    Last updated: 18 days ago • Promoted
    Data Engineer

    Data Engineer

    Digitalzone • Bengaluru, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show more
    Last updated: 21 days ago • Promoted
    Data Engineer I

    Data Engineer I

    Licious • Greater Bengaluru Area, India
    SDE 1 – Data Platform Engineer.We are looking for a passionate and motivated.Software Development Engineer (SDE 1) – Data Platform. Data Platform Engineering team at.In this role, you’ll design, bui...Show more
    Last updated: 3 days ago • Promoted
    Data Engineer

    Data Engineer

    VIDA Digital Identity • Greater Bengaluru Area, India
    At VIDA we’re building the future of digital identity.As a Data Engineer you’ll work across the stack—from platform and infrastructure to data pipelines and end-user tooling.You’ll help us moderniz...Show more
    Last updated: 3 days ago • Promoted
    Data Engineer

    Data Engineer

    Selector • Bengaluru, Karnataka, India
    Selector is building an operational intelligence platform for digital infrastructure.By adopting an AI / ML-based analytics approach, the platform provides actionable multi-dimensional.It enables ope...Show more
    Last updated: 30+ days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Emids • Bengaluru, Karnataka, India
    We are looking for a highly skilled Data Engineer with strong expertise in AWS, Databricks, PySpark, and Airflow to join our growing Data Engineering team. The ideal candidate will be responsible fo...Show more
    Last updated: 6 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    Grassdoor • Bengaluru, IN
    At Grassdoor Logistics Technologies, we are redefining the landscape of Cannabis commerce by.Unified Operations Center which provides seamless, technology-driven solutions.Our platform is built to ...Show more
    Last updated: 6 hours ago • Promoted • New!
    Lead Data Engineer

    Lead Data Engineer

    Algonomy • Greater Bengaluru Area, India
    Lead / Principal Software Engineer.At Algonomy, we believe the future of our economy is Algorithmic, where businesses will develop resilient, adaptive and agile decisioning abilities that will cons...Show more
    Last updated: 22 hours ago • Promoted • New!
    Customer Engineer (Data Engineer)

    Customer Engineer (Data Engineer)

    Konecta • Bengaluru, IN
    In this role, you will be the technical point of contact for the customer – a trusted partner for their IT leadership – as the primary engineer on the project, working with multifunctional teams bo...Show more
    Last updated: 2 days ago • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy Services • Greater Bengaluru Area, India
    Previous experience as a data engineer or in a similar role.Must have experience with MS Azure services such as Data Lake Storage, Data Factory, Databricks, HDInsight, Azure SQL Database, Azure Syn...Show more
    Last updated: 3 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Arcana • Greater Bengaluru Area, India
    Join our dynamic team at the forefront of cutting-edge technology as we seek a seasoned Senior Data Engineer.Embark on a journey where your deep-rooted expertise in computer science fundamentals, a...Show more
    Last updated: 3 days ago • Promoted