Data Engineer
Digitalzoneludhiana, punjab, in16 hours ago
Job description6+ years of hands-on experience in data engineering and distributed systems. Experience with AI-assisted coding tools (Claude Code, GitHub Copilot, Cursor AI) Strong expertise in ClickHouse for analytics, including data modeling, partitioning, indexing, and query optimization. Proven ability to design and manage denormalized OLAP datasets to support BI and reporting workloads. Solid understanding of ETL / ELT pipelines and experience with tools such as Airbyte, DBT, Airflow or Python-based transformations. Proficiency in SQL (advanced queries, performance tuning, window functions, aggregations). Hands-on experience working with reporting / visualization frameworks (e.g., amCharts or similar libraries). Strong foundation in data quality, governance, and validation to ensure reliable analytics. Strong knowledge of real-time data streaming (Kafka, Spark) Experience with relational and analytical databases (Postgres, ClickHouse, Elasticsearch) Exposure to ML model integration, MLOps is a strong plus Strong problem-solving, debugging, and cross-team collaboration skills Experience with relational and analytical databases (Postgres, ClickHouse, Elasticsearch) Exposure to ML model integration, MLOps is a strong plus
About the Role
As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.
Responsibilities
- Develop and maintain scalable ETL / ELT pipelines using Python, Airflow, and dbt
- Build and optimize real-time streaming pipelines using Kafka, RabbitMQ, Spark and event-driven microservices
- Leverage AI coding agents (Claude Code, Cursor AI, GitHub Copilot) to accelerate data pipeline development, data transformation, and optimization
- Design and manage data storage solutions with PostgreSQL, ClickHouse and Elasticsearch
- Define and implement data modeling best practices for efficient and scalable data storage.
- Ensure high availability, performance, and security of data infrastructure on AWS cloud
- Design and implement BI-ready datasets in ClickHouse optimized for OLAP workloads and reporting use cases.
- Develop and manage denormalized schemas and data models to support analytics and amCharts-based reporting.
- Optimize query performance, partitioning, and indexing strategies in ClickHouse to handle large-scale analytical workloads.
- Implement best practices for data quality, validation, and observability
- Work on data ingestion using Airbyte or other connector frameworks
- Implement data transformation pipelines supporting analytical and ML workloads
- Collaborate with cloud and DevOps teams for containerized deployments (Docker, Kubernetes, AWS)
- Support integration of ML workflows and model APIs into production pipelines
Qualifications
Required Skills
Preferred Skills
Create a job alert for this search
Data Engineer • ludhiana, punjab, in
Related jobs
- Promoted
Data Engineer
Response Informaticsludhiana, punjab, in We’re Hiring | Data Engineering Experts (Hyderabad / Remote).We’re looking for passionate and experienced.Data Engineering professionals.
If you love building scalable data pipelines, optimizing clo...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer (AWS / Databricks)
Accoladeludhiana, punjab, in The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 30+ days ago
- Promoted
GCP Data Engineer
JRD Systemsludhiana, punjab, in Collaborate with data architects, analysts, and business teams to define and maintain.Roadnet) and modernized data sources.
Partner with governance and infrastructure teams to establish.Automate and...Show moreLast updated: 5 days ago
- Promoted
AWS Data Engineer
Tata Consultancy Servicesludhiana, punjab, in TCS has always been in the spotlight for being adept in the next big technologies.What we can offer you is a space to explore varied technologies and quench your techie soul.Required Skill Set : AWS...Show moreLast updated: 9 days ago
- Promoted
- New!
Snowflake Data Engineer
Newpage Solutionsludhiana, punjab, in Location : Remote | Type : Contract.Newpage Solutions is a global digital health innovation company helping people live longer, healthier lives.
We partner with life sciences organizations—including p...Show moreLast updated: 16 hours ago
- Promoted
AWS Data Engineer
TerraGiGludhiana, punjab, in Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR.
Writing reusable, testable, and efficient code.Integration of data storage ...Show moreLast updated: 11 days ago
- Promoted
Data Engineer
Veraxionludhiana, India Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions.
Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 11 days ago
- Promoted
Data Engineer
Randstad Enterpriseludhiana, punjab, in Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ).
GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
AAA Globalludhiana, punjab, in Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team.
In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 22 days ago
- Promoted
Data Engineer
Tata Consultancy Servicesludhiana, punjab, in Greetings from TATA Consultancy Services!!.Thank you for expressing your interest in exploring a career possibility with the TCS Family.
We have a job opportunity for Azure Data Engineer at Tata Con...Show moreLast updated: 30+ days ago
- Promoted
Freelance Data Engineer
upGradludhiana, punjab, in We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 20 days ago
- Promoted
Senior Data Engineer
Saransh Includhiana, punjab, in Data Engineer (Contract-to-Hire | Remote).Full-Time / Fixed-Term Contract (12 months, extendable based on performance).We are seeking a highly skilled.
The ideal candidate will be hands-on, detail-o...Show moreLast updated: 22 days ago
- Promoted
- New!
Lead Data Engineer (Azure, Databricks architecture, 8+yrs)
Innova ESIludhiana, punjab, in Drive end to end integration delivery through analysis, design, build and deployment.Manage requirement gathering and analysis necessary for integration build.
Develop new and enhanced integrations ...Show moreLast updated: 16 hours ago
- Promoted
Data Engineer
LTIMindtreeludhiana, punjab, in We are seeking a skilled Data Engineer with hands-on experience in.The ideal candidate will be responsible for developing scalable data pipelines, transforming and ingesting large-scale data, and e...Show moreLast updated: 30+ days ago
- Promoted
AI / ML & Data Engineer
Mindfire Solutionsludhiana, punjab, in We are looking for an experienced AI / ML & Data Engineer to design, develop, and deploy scalable machine learning models and data infrastructure on AWS.
You will work closely with cross-functional te...Show moreLast updated: 13 days ago
- Promoted
Data Engineer(Azure / AWS, Python / Pyspark, SQL)
Sail Analyticsludhiana, punjab, in Architect, develop, test and maintain scalable data warehouses and data pipelines.Expertise in SQL, PySpark / Python and Azure(ADB, ADF) or AWS(Glue, Lambda, Redshift).
Bachelor's degree or equivalent...Show moreLast updated: 30+ days ago