Talent.com
Senior Data Engineer

Senior Data Engineer

XebiaBengaluru, Karnataka, India
20 hours ago
Job description

Job Title : Senior Data Engineer

Job Location : Bengaluru

Exp Range : 6-10 years

Notice Period : immediate - 15 days

We are looking for Data Engineer with hands on experience on Python , Pyspark , Hadoop Hive, HDFS, Oozie, Yarn

Key Responsibilities

  • Design, develop and maintain large-scale, high-performance data pipelines (batch and streaming) to support analytics and data-driven decision-making for retail business.
  • Collaborate with cross-functional teams (business stakeholders, analysts, platform / infrastructure teams) to understand data needs, ingest diverse data sources, and deliver data solutions.
  • Work on building and evolving a data lake / data warehouse / data platform architecture (including ingestion, transformation, storage, metadata, governance).
  • Implement optimal data models, query tuning, performance optimization, ensuring data quality, reliability, and scalability.
  • Adopt DevOps / CI-CD practices for data workflows (e.g., automated deployments, monitoring, scheduling).
  • Mentor and guide junior engineers, review code / designs, and contribute to architectural decisions and best practices in data engineering.
  • Stay current with new data technologies (cloud data services, streaming frameworks, orchestration) and recommend improvements.

Required Skills & Experience

  • Bachelor’s degree (B.Tech / BE) or equivalent in Computer Science, Engineering, or related.
  • 6-10 years of relevant experience in data engineering / big data / analytics platforms.
  • Strong expertise in distributed data processing frameworks such as Apache Spark (Scala or Java) and / or Python.
  • Solid experience with SQL and query optimisation over large volumes of data.
  • Experience with big data ecosystems : Hadoop distributions (Cloudera / Hortonworks), file formats (Parquet / Avro / ORC), streaming frameworks (Kafka, Spark Streaming).
  • Familiarity with data lake / warehouse design, data modelling, metadata management, data quality frameworks.
  • Exposure to cloud data engineering (Azure, AWS, GCP) or hybrid architectures is desirable.
  • Good software engineering practices : code quality, unit / integration testing, version control (Git), CI / CD pipelines, containerisation (Docker / Kubernetes) is a plus.
  • Excellent communication and collaboration skills, ability to work independently and mentor others.
    • Create a job alert for this search

    Senior Data Engineer • Bengaluru, Karnataka, India