Talent.com
Senior Data Engineer

Senior Data Engineer

XebiaBengaluru, Karnataka, India
1 day ago
Job description

Job Title : Senior Data Engineer

Job Location : Bengaluru

Exp Range : 6-10 years

Notice Period : immediate - 15 days

We are looking for Data Engineer with hands on experience on Python , Pyspark , Hadoop Hive, HDFS, Oozie, Yarn

Key Responsibilities

  • Design, develop and maintain large-scale, high-performance data pipelines (batch and streaming) to support analytics and data-driven decision-making for retail business.
  • Collaborate with cross-functional teams (business stakeholders, analysts, platform / infrastructure teams) to understand data needs, ingest diverse data sources, and deliver data solutions.
  • Work on building and evolving a data lake / data warehouse / data platform architecture (including ingestion, transformation, storage, metadata, governance).
  • Implement optimal data models, query tuning, performance optimization, ensuring data quality, reliability, and scalability.
  • Adopt DevOps / CI-CD practices for data workflows (e.g., automated deployments, monitoring, scheduling).
  • Mentor and guide junior engineers, review code / designs, and contribute to architectural decisions and best practices in data engineering.
  • Stay current with new data technologies (cloud data services, streaming frameworks, orchestration) and recommend improvements.

Required Skills & Experience

  • Bachelor’s degree (B.Tech / BE) or equivalent in Computer Science, Engineering, or related.
  • 6-10 years of relevant experience in data engineering / big data / analytics platforms.
  • Strong expertise in distributed data processing frameworks such as Apache Spark (Scala or Java) and / or Python.
  • Solid experience with SQL and query optimisation over large volumes of data.
  • Experience with big data ecosystems : Hadoop distributions (Cloudera / Hortonworks), file formats (Parquet / Avro / ORC), streaming frameworks (Kafka, Spark Streaming).
  • Familiarity with data lake / warehouse design, data modelling, metadata management, data quality frameworks.
  • Exposure to cloud data engineering (Azure, AWS, GCP) or hybrid architectures is desirable.
  • Good software engineering practices : code quality, unit / integration testing, version control (Git), CI / CD pipelines, containerisation (Docker / Kubernetes) is a plus.
  • Excellent communication and collaboration skills, ability to work independently and mentor others.
  • Create a job alert for this search

    Senior Data Engineer • Bengaluru, Karnataka, India

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Nityo InfotechBengaluru, Karnataka, India
    We are seeking an experienced Senior Data Engineer with 8-12 years of hands-on experience to join our team on-site.This role requires a self-starter who can architect and implement robust data foun...Show moreLast updated: 3 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Straivehosur, tamil nadu, in
    The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Tredence Inc.Bengaluru, Karnataka, India
    Collaborate with DW / BI leads to understand new ETL pipeline development requirements.Triage issues to find gaps in existing pipelines and fix the issues. Work with business to understand the need in...Show moreLast updated: 30+ days ago
    • Promoted
    Senior AWS Data Engineer_Exp : 5+ Years

    Senior AWS Data Engineer_Exp : 5+ Years

    Atyeti Inchosur, tamil nadu, in
    Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.Python; strong SQL and clo...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Engineer (AWS / Databricks)

    Senior Data Engineer (AWS / Databricks)

    Accoladebangalore, karnataka, in
    The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Tata Consultancy ServicesBangalore Urban, Karnataka, India
    TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer with AWS_ Exp : 6+ Years

    Senior Data Engineer with AWS_ Exp : 6+ Years

    Atyeti Inchosur, tamil nadu, in
    Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.Python; strong SQL and clo...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SGS & Cohosur, tamil nadu, in
    Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in. The ideal candidate will play a ke...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Incept Labshosur, tamil nadu, in
    Incept Labs is an AI research lab based in San Francisco, California.Our small team of scientists, engineers, and builders is passionate about developing domain-specific, next-generation AI solutio...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer-Remote

    Senior Data Engineer-Remote

    Cimpress Indiahosur, tamil nadu, in
    Remote
    NASDAQ : CMPR) is the world leader in mass customisation.Our unmatched technology, production, and supply chain operations allow us to offer products that can be personalised by an individual custom...Show moreLast updated: 22 days ago
    • Promoted
    Senior Snowflake Data Engineer

    Senior Snowflake Data Engineer

    iVoyanthosur, tamil nadu, in
    One of our clients is looking for an experienced Senior Snowflake Data Engineer to join their team.We are seeking a Senior Data Engineer with 8+ years of experience in end-to-end data engineering a...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    ACL DigitalBengaluru, Karnataka, India
    Tech Lead design, build, and maintain the infrastructure for an organization's data, ensuring it is reliable, accessible, and optimized for use by data scientists and analysts.Key responsibilities ...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIhosur, tamil nadu, in
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    HealthyMe AIhosur, tamil nadu, in
    We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SutherlandBangalore Urban, Karnataka, India
    Location : Bangalore | Hyderabad | Chennai | Mumbai.If interested please reach out to me with your updated resume @Priti. We’re transforming how we work by harnessing the power of AI, data, and digit...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Mastekhosur, tamil nadu, in
    We are looking for a Senior Data Engineer with good exposure to Cloud Services in AWS(IAM, RDS, Lambda, DMS) along with Snowflake / Postgresql, ETL and Streaming Services like Kafka.Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    MeghGen TechnologiesBengaluru, Karnataka, India
    MeghGen Technologies is a trusted technology solutions partner specializing in data engineering, cloud-native applications, and cloud migrations. We design and implement end-to-end cloud solutions t...Show moreLast updated: 3 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Guidanz IncBengaluru, IN
    BI Connector is the industry leading solution for integrating Oracle Fusion Cloud data into modern BI platforms like Power BI, Tableau, and Data Warehouse, without complex ETL.Our Data Architecture...Show moreLast updated: 3 days ago