Talent.com
Data Engineer
Data EngineerDigitalzone • Hyderabad, IN
Data Engineer

Data Engineer

Digitalzone • Hyderabad, IN
22 days ago
Job description

About the Role

As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.

Responsibilities

  • Develop and maintain scalable ETL / ELT pipelines using Python, Airflow, and dbt
  • Build and optimize real-time streaming pipelines using Kafka, RabbitMQ, Spark and event-driven microservices
  • Leverage AI coding agents (Claude Code, Cursor AI, GitHub Copilot) to accelerate data pipeline development, data transformation, and optimization
  • Design and manage data storage solutions with PostgreSQL, ClickHouse and Elasticsearch
  • Define and implement data modeling best practices for efficient and scalable data storage.
  • Ensure high availability, performance, and security of data infrastructure on AWS cloud
  • Design and implement BI-ready datasets in ClickHouse optimized for OLAP workloads and reporting use cases.
  • Develop and manage denormalized schemas and data models to support analytics and amCharts-based reporting.
  • Optimize query performance, partitioning, and indexing strategies in ClickHouse to handle large-scale analytical workloads.
  • Implement best practices for data quality, validation, and observability
  • Work on data ingestion using Airbyte or other connector frameworks
  • Implement data transformation pipelines supporting analytical and ML workloads
  • Collaborate with cloud and DevOps teams for containerized deployments (Docker, Kubernetes, AWS)
  • Support integration of ML workflows and model APIs into production pipelines

Qualifications

  • 6+ years of hands-on experience in data engineering and distributed systems.
  • Required Skills

  • Experience with AI-assisted coding tools (Claude Code, GitHub Copilot, Cursor AI)
  • Strong expertise in ClickHouse for analytics, including data modeling, partitioning, indexing, and query optimization.
  • Proven ability to design and manage denormalized OLAP datasets to support BI and reporting workloads.
  • Solid understanding of ETL / ELT pipelines and experience with tools such as Airbyte, DBT, Airflow or Python-based transformations.
  • Proficiency in SQL (advanced queries, performance tuning, window functions, aggregations).
  • Hands-on experience working with reporting / visualization frameworks (e.g., amCharts or similar libraries).
  • Strong foundation in data quality, governance, and validation to ensure reliable analytics.
  • Strong knowledge of real-time data streaming (Kafka, Spark)
  • Experience with relational and analytical databases (Postgres, ClickHouse, Elasticsearch)
  • Exposure to ML model integration, MLOps is a strong plus
  • Strong problem-solving, debugging, and cross-team collaboration skills
  • Preferred Skills

  • Experience with relational and analytical databases (Postgres, ClickHouse, Elasticsearch)
  • Exposure to ML model integration, MLOps is a strong plus
  • Create a job alert for this search

    Data Engineer • Hyderabad, IN

    Related jobs
    Data Engineer

    Data Engineer

    Insight Global • hyderabad, telangana, in
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Recro • hyderabad, telangana, in
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Prudent Technologies and Consulting, Inc. • Hyderabad, Telangana, India
    Seeking an experienced Senior Data Engineer with over 9 years of industry experience to architect, build, and manage advanced data pipelines and platforms in a cloud environment.The ideal candidate...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Randstad Enterprise • Secunderabad, Telangana, India
    Role : Data Engineer Location : Remote Shift Timing : 2 : 00 Pm - 11 : 00 Pm Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ) Must have skillset : GCP - 2 years m...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer - Palantir Foundry

    Data Engineer - Palantir Foundry

    NP Group • secunderabad, India
    Data Engineer - Palantir Foundry, Workshop, Pyspark & Typescript.Long Term (initially 6 months) full time contract.We have an immediate requirement for an experienced Data Engineer to join the glob...Show more
    Last updated: 11 days ago • Promoted
    Data Engineer

    Data Engineer

    Vriba Solutions • hyderabad, telangana, in
    Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions. Data validation, quality & cleansing.Translate busin...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Straive • Hyderabad, India
    Design, build and maintain scalable batch and (optionally) streaming data pipelines using Apache Spark 3.Implement core ETL / ELT logic in Scala and Python. author efficient Spark DataFrame / Dataset j...Show more
    Last updated: 7 days ago • Promoted
    Softobiz - Data Engineer - Synapse Analytics

    Softobiz - Data Engineer - Synapse Analytics

    Softobiz Technologies Pvt ltd • Hyderabad
    Description : Job Title : Data Engineer.Career-defining role available with Tier 1 Blue Chip Australian Client.As a Data Engineer, you will be involved in all phases...Show more
    Last updated: 30+ days ago • Promoted
    Softobiz - Data Engineer

    Softobiz - Data Engineer

    Softobiz Technologies Pvt ltd • Hyderabad
    Description : Job Title : Data Engineer.Career-defining role available with Tier 1 Blue Chip Australian Client.As a Data Engineer, you will be involved in all phases...Show more
    Last updated: 15 days ago • Promoted
    Customer Engineer (Data Engineer)

    Customer Engineer (Data Engineer)

    Konecta • Secunderabad, Telangana, India
    In this role, you will be the technical point of contact for the customer – a trusted partner for their IT leadership – as the primary engineer on the project, working with multifunctional teams bo...Show more
    Last updated: 2 days ago • Promoted
    Data Engineer

    Data Engineer

    HCLTech • Hyderabad, Telangana, India
    Data Engineer - Databricks Job Description.The Data Engineer - Databricks will be responsible for building and optimizing our data pipelines, architectures, and data sets.He will work closely with ...Show more
    Last updated: 19 days ago • Promoted
    Data Engineer - Snowflake

    Data Engineer - Snowflake

    Prudent Technologies and Consulting, Inc. • hyderabad, telangana, in
    We are seeking a skilled Data Engineer with strong experience in Python, Snowflake, and AWS.The ideal candidate will be responsible for building and optimizing scalable data pipelines, integrating ...Show more
    Last updated: 8 days ago • Promoted
    Data Engineer

    Data Engineer

    Radiant Digital • Hyderabad, Telangana, India
    As a Data Engineer, you will play a key role in designing, developing, and optimizing data pipelines and storage solutions in a complex, enterprise-scale data warehouse environment.You will contrib...Show more
    Last updated: 16 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    Technogen India Pvt. Ltd. • hyderabad, telangana, in
    Design, build, and measure complex ELT jobs to process disparate data sources and form a high integrity, high quality, clean data asset. Executes and provides feedback for data modeling policies, pr...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Thermo Fisher Scientific • Hyderabad, Telangana, India
    This job is with Thermo Fisher Scientific, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly...Show more
    Last updated: 25 days ago • Promoted
    Data Platform Engineer

    Data Platform Engineer

    Prudent Technologies and Consulting, Inc. • Hyderabad, Republic Of India, IN
    Seeking an experienced Senior Data Engineer with over 9 years of industry experience to architect, build, and manage advanced data pipelines and platforms in a cloud environment.The ideal candidate...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer 2

    Data Engineer 2

    Confidential • Hyderabad / Secunderabad, Telangana
    Data Architecture & Solution Development.Translate business and functional requirements into robust, scalable data solutions aligned with overall architecture. Design and implement data integrations...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Travel & Payments • Hyderabad, Telangana, India
    At Yuno, we are building the payment infrastructure that enables all companies to participate in the global market.Founded by a team of seasoned experts in the payments and IT industries, Yuno prov...Show more
    Last updated: 30+ days ago • Promoted