Talent.com
Data Engineer

Data Engineer

DigitalzoneKalyan-Dombivli, IN
17 hours ago
Job description

About the Role

As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.

Responsibilities

  • Develop and maintain scalable ETL / ELT pipelines using Python, Airflow, and dbt
  • Build and optimize real-time streaming pipelines using Kafka, RabbitMQ, Spark and event-driven microservices
  • Leverage AI coding agents (Claude Code, Cursor AI, GitHub Copilot) to accelerate data pipeline development, data transformation, and optimization
  • Design and manage data storage solutions with PostgreSQL, ClickHouse and Elasticsearch
  • Define and implement data modeling best practices for efficient and scalable data storage.
  • Ensure high availability, performance, and security of data infrastructure on AWS cloud
  • Design and implement BI-ready datasets in ClickHouse optimized for OLAP workloads and reporting use cases.
  • Develop and manage denormalized schemas and data models to support analytics and amCharts-based reporting.
  • Optimize query performance, partitioning, and indexing strategies in ClickHouse to handle large-scale analytical workloads.
  • Implement best practices for data quality, validation, and observability
  • Work on data ingestion using Airbyte or other connector frameworks
  • Implement data transformation pipelines supporting analytical and ML workloads
  • Collaborate with cloud and DevOps teams for containerized deployments (Docker, Kubernetes, AWS)
  • Support integration of ML workflows and model APIs into production pipelines

Qualifications

  • 6+ years of hands-on experience in data engineering and distributed systems.
  • Required Skills

  • Experience with AI-assisted coding tools (Claude Code, GitHub Copilot, Cursor AI)
  • Strong expertise in ClickHouse for analytics, including data modeling, partitioning, indexing, and query optimization.
  • Proven ability to design and manage denormalized OLAP datasets to support BI and reporting workloads.
  • Solid understanding of ETL / ELT pipelines and experience with tools such as Airbyte, DBT, Airflow or Python-based transformations.
  • Proficiency in SQL (advanced queries, performance tuning, window functions, aggregations).
  • Hands-on experience working with reporting / visualization frameworks (e.g., amCharts or similar libraries).
  • Strong foundation in data quality, governance, and validation to ensure reliable analytics.
  • Strong knowledge of real-time data streaming (Kafka, Spark)
  • Experience with relational and analytical databases (Postgres, ClickHouse, Elasticsearch)
  • Exposure to ML model integration, MLOps is a strong plus
  • Strong problem-solving, debugging, and cross-team collaboration skills
  • Preferred Skills

  • Experience with relational and analytical databases (Postgres, ClickHouse, Elasticsearch)
  • Exposure to ML model integration, MLOps is a strong plus
  • Create a job alert for this search

    Data Engineer • Kalyan-Dombivli, IN

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    RecroThane, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    AAA GlobalKalyan-Dombivli, IN
    Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team. In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 22 days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Dexian Indiamumbai city, maharashtra, in
    Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Constructing infrastructure for efficient ETL processes from vari...Show moreLast updated: 16 hours ago
    • Promoted
    Alteryx Data Engineer

    Alteryx Data Engineer

    Collinsonmumbai, maharashtra, in
    Collinson, Working within the Transformation Team, you will be responsible for delivering key elements of our transformation programme. You will create new, and develop existing, Alteryx workflows t...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer II

    Data Engineer II

    ClearDemandmumbai, maharashtra, in
    Building on the foundation of the SDE-I role, the DE- II position takes on a greater level of responsibility and leadership. You'll play a crucial role in driving the evolution and efficiency of our...Show moreLast updated: 16 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Response Informaticsthane, maharashtra, in
    AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture. CICD - Terraform or CloudFo...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    thinkbridgethane, maharashtra, in
    We are a global digital product development firm that helps growth-stage companies gain the technology sophistication and maturity of leading modern digital businesses. We differentiate ourselves by...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Randstad EnterpriseThane, IN
    Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show moreLast updated: 30+ days ago
    Data Engineer

    Data Engineer

    CollinsonMumbai, Maharashtra, IN
    Quick Apply
    We use our expertise and products to craft customer experiences.Our range of services helps global brand acquire, engage and retain choice-rich customers. Collinson International Limited.Registered ...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    EnvuThane, Maharashtra, India
    At Envu, we partner with our customers to design world-class, forward-thinking innovations that protect and enhance the health of environments around the world. We offer dedicated services in : Profe...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    SystemBenderdombivli, maharashtra, in
    Job Title : Data Engineer (Microsoft Fabric & Azure).The Data Engineer is responsible for designing, building, and maintaining scalable data pipelines and modern data lakehouse architectures using M...Show moreLast updated: 15 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Sail AnalyticsDombivli, Republic Of India, IN
    Architect, develop, test and maintain scalable data warehouses and data pipelines.Expertise in SQL, PySpark / Python and Azure(ADB, ADF) or AWS(Glue, Lambda, Redshift). Bachelor's degree or equivalent...Show moreLast updated: 15 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Canopus Infosystems - A CMMI Level 3 CompanyKalyan-Dombivli, IN
    Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization.The ideal candidate should be capable of building data pipelines, performing web scra...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    StraiveMumbai, Maharashtra, India
    Data Engineer will be responsible for designing, developing, and maintaining data pipelines and architectures that support the organization's analytics and reporting needs.The ideal candidate will ...Show moreLast updated: 30+ days ago