Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights.
Constructing infrastructure for efficient ETL processes from various sources and storage systems.
Collaborating closely with Product Managers and Business Managers to design technical solutions aligned with business requirements.
Leading the implementation of algorithms and prototypes to transform raw data into useful information.
Architecting, designing, and maintaining database pipeline architectures, ensuring readiness for AI / ML transformations.
Creating innovative data validation methods and data analysis tools.
Ensuring compliance with data governance and security policies.
Interpreting data trends and patterns to establish operational alerts.
Developing analytical tools, programs, and reporting mechanisms.
Conducting complex data analysis and presenting results effectively.
Preparing data for prescriptive and predictive modeling.
Continuously exploring opportunities to enhance data quality and reliability.
Applying strong programming and problem-solving skills to develop scalable solutions.
Passion for testing strategy, problem-solving, and continuous learning.
Willingness to acquire new skills and knowledge.
Possess a product / engineering mindset to drive impactful data solutions.
Experience working in distributed environments with global teams.
Technical Skills and Experience requirements :
Minimum 8+ years of hands-on experience designing, building, deploying, testing, maintaining, monitoring, and owning scalable, resilient, and distributed data pipelines.
High proficiency in Python, Scala and Spark for applied large-scale data processing.
Expertise with big data technologies, including Spark, Data Lake, Delta Lake, and Hive.
Solid understanding of batch and streaming data processing techniques.
Proficient knowledge of the Data Lifecycle Management process, including data collection, access, use, storage, transfer, and deletion.
Expert-level ability to write complex, optimized SQL queries across extensive data volumes.
Experience with RDBMS and OLAP databases like MySQL, Snowflake.
Familiarity with Agile methodologies.
Obsession for service observability, instrumentation, monitoring, and alerting.
Knowledge or experience in architectural best practices for building data lakes.
Create a job alert for this search
Data Engineer Python • baddi, himachal pradesh, in
Related jobs
Promoted
New!
Data Engineer (Remote)
QAAgility Technologiesbaddi, himachal pradesh, in
Remote
The ideal candidate will be responsible for designing, developing, and maintaining robust data pipelines that support key business functions across the supply chain domain.This role requires strong...Show moreLast updated: 1 hour ago
Promoted
New!
Fullstack Python Engineer (Cloud and AI)
Luxoft Indiabaddi, himachal pradesh, in
Opening roles in Bangalore, Chennai, Gurugram, Hyderabad and Noida.Must have experience of maintaining & upgrading.NET based applications on Windows OS / Azure Cloud ,Experience with the MVC.NET, S...Show moreLast updated: 1 hour ago
Promoted
New!
Python Lead Engineer- WFH
AgileEnginepanchkula, haryana, in
Remote
THIS IS FULLY REMOTE WORKING OPPORTUNITY.We someone who can join in less than 1 month.Pls read the JD carefully and only proceed if you have the relevant experience.
If you are interested and fulfil...Show moreLast updated: 1 hour ago
Promoted
New!
Lead Data Engineer - Python & GCP || Contract Job || 8-10 Years Experience
People Prime Worldwidebaddi, himachal pradesh, in
Our Client is a global IT services company headquartered in Southborough, Massachusetts, USA.Founded in 1996, with a revenue of $1.
B, with 35,000+ associates worldwide, specializes in digital engin...Show moreLast updated: 1 hour ago
Promoted
Senior Data Engineer
Intelliasbaddi, himachal pradesh, in
Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines.
Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 16 days ago
Promoted
Senior Data Engineer
SGS & Cobaddi, himachal pradesh, in
Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in.
The ideal candidate will play a ke...Show moreLast updated: 16 days ago
Promoted
AWS Data Engineer
Tata Consultancy Servicespanchkula, haryana, in
TCS is Hiring AWS Data Engineer Bangalore location.Strong hands-on experience in Python programming and PySpark.Experience using AWS services (RedShift, Glue, EMR, S3 & Lambda).Experience working w...Show moreLast updated: 24 days ago
Promoted
New!
Data Engineer
NexionPro Servicespanchkula, haryana, in
PySpark-based data processing workflows.Collaborate with data architects, analysts, and cross-functional teams to understand business requirements and translate them into technical solutions.Optimi...Show moreLast updated: 1 hour ago
Promoted
Senior Python Data Engineer
iVoyantbaddi, himachal pradesh, in
Join a dynamic engineering team working on a high-impact tax reporting platform for the 2025 fiscal season.The core goal is to modernize and significantly accelerate the generation of Excel-based r...Show moreLast updated: 3 days ago
Promoted
Data Engineer
HCLTechpanchkula, haryana, in
We’re Expanding Our Digital & Data Talent Pool.Are you a professional ready to take on enterprise-scale transformation journey? We are on a mass hiring drive and looking for experts who can bring i...Show moreLast updated: 30+ days ago
Promoted
Backend Python Engineer - 17852
TuringChandigarh, Chandigarh, India
Role Overview : We’re looking for experienced Python engineers to collaborate with one of the world’s top Large Language Model (LLM) companies.
Your work will directly help improve how AI models thin...Show moreLast updated: 6 days ago
Promoted
New!
Senior Data Engineer
Adaptive Technology Insightspanchkula, haryana, in
We are looking for an experienced.You will be responsible for designing, building, and optimizing data pipelines and architecture to support analytics, reporting, and data-driven decision-making ac...Show moreLast updated: 1 hour ago
Promoted
AI Data Engineer - 17852
TuringChandigarh, Chandigarh, India
Role Overview : We’re looking for experienced AI data engineers skilled in Python to collaborate with one of the world’s top Large Language Model (LLM) companies.
Your work will directly help improve...Show moreLast updated: 6 days ago
Promoted
AI Data Engineer
Peak Trust Global Real Estatepanchkula, haryana, in
This role requires strong technical skills across Python, automation, ML tooling, and analytical reporting.Key Responsibilities (Technical).
Build automated data collection workflows using tools suc...Show moreLast updated: 3 days ago
Promoted
Azure Data Engineer
Tech Mahindrapanchkula, haryana, in
Expertise in CI-CD, Pyspark, SQL.Expertise in ADF, ADLS & ADB (Mandatory).Experience in "Azure Services / Key Vault".Experience in "GIT / Jenkins / Azure DevOps".Show moreLast updated: 1 day ago
Promoted
New!
Data Engineer
Ubique Systemspanchkula, haryana, in
Primary skills : Python, SQL, data lakes, azure.Pipeline Development & Automation.Design, build, and maintain CI / CD pipelines to automate deployment of DQ rules and data services across environments...Show moreLast updated: 1 hour ago
Promoted
Sr Python Backend Engineer
Katalytx Analyticspanchkula, haryana, in
Hand on Python engineer who loves building scalable applications and robust RESTful APIs.Translate complex business requirements into detailed technical specifications, architectural designs, and A...Show moreLast updated: 2 days ago
Promoted
Data Engineer
TEKsystemsbaddi, himachal pradesh, in
Location - Remote or Delhi or Hyderabad or Bangalore or Pune.Proficiency in Python and experience maintaining data-driven applications.
Hands-on experience with ETL pipeline development, schema desi...Show moreLast updated: 8 days ago