Experience with Python(Lead Level) and PySpark + ETL
Key Responsibilities :
Lead the design, development, and optimization of Python- and PySpark-based data pipelines and ETL workflows.
Collaborate with data scientists and analysts to gather requirements and ensure data accuracy, quality, and consistency.
Build scalable and high-performance data solutions to support analytics and business operations.
Monitor data pipeline performance, identify bottlenecks, and troubleshoot issues proactively.
Drive architecture improvements and contribute to long-term data platform strategy.
Ensure compliance with data governance, security, and regulatory standards.
Prepare and maintain clear technical documentation for all data processes and systems.
Mentor, guide, and lead the data engineering team to deliver high-quality outcomes.
Required Skills & Qualifications :
Minimum 8+ years of hands-on experience in Python, with strong expertise in writing optimized and modular code.
Strong experience with PySpark, distributed processing, and big data technologies.
Proven experience leading engineering teams and delivering complex technical projects.
Strong understanding of ETL development, data modeling, and pipeline orchestration.
Experience with cloud platforms (AWS / Azure / GCP) is a plus.
Excellent problem-solving skills and ability to work in a fast-paced environment.
Strong communication and documentation skills.
(ref : hirist.tech)
Create a job alert for this search
Lead Python • Hyderabad
Related jobs
Python (Airflow / DBT) Engineer
Luxoft • Hyderabad, Telangana, India
Project Description : This project is part of a strategic initiative to migrate legacy on-premises data systems to a modern, scalable cloud-based data platform using Snowflake on Azure.The goal is t...Show more
Last updated: 10 days ago • Promoted
Senior Python Developer
Ascendion • Hyderabad, Telangana, India
Notice Period : Immediate to 20 days.Skills : Python , Django, Flask, Fast API, Microservices, AWS or Cloud Native Deployment, CI CD Tools Knowledge.Show more
Last updated: 18 days ago • Promoted
Senior Python Developer
Huptech HR Solutions • secunderabad, telangana, in
Job Description : - Senior Python Developer.Job Location - Ahmedabad (Remote).Software Development : Write clean, scalable, and efficient Python code to develop software applications.Backend Developm...Show more
Last updated: 25 days ago • Promoted
Technoidentity - Technical Lead - Python / FastAPI
Whats in it for You ? - Modern Python Stack Python 3.FastAPI, Pandas, NumPy, SQLAlchemy, PostgreSQL / AlloyDB, PL / pgSQL.
Tech Leadership Drive technical decision-makin...Show more
Last updated: 30+ days ago • Promoted
ETL Engineer
ADP • Hyderabad, Republic Of India, IN
Position : Data Engineer with 3 to 10 Years experience in PySpark and Data bricks.In this role candidate will be responsible for understanding complex data sets, managing multiple disparate data so...Show more
Last updated: 2 days ago • Promoted
ETL Developer / ETL Technical Lead With PLSQL
Talent Smart • Hyderabad, Telangana, India
Talend or Informatica, Snowflake.We are looking for a talented Talend Developer with PLSQL hands-on experience in Talend Management Console on Cloud and Snowflake to join our growing team.The i...Show more
Last updated: 30+ days ago • Promoted
Python / Pyspark, Bigquery with GCP, Apache Iceberg
Tata Consultancy Services • Hyderabad, Telangana, India
TCS Hiring !!Virtual Drive • • • 12-Nov-25 Python / Pyspark, Bigquery with GCP, Apache Iceberg TCS - Hyderabad 12 PM to 1 PM Immediate Joiners 5 to 7 years Role • • Python / Pyspark, Bigquery with GCP, A...Show more
Last updated: 19 days ago • Promoted
Senior ETL Engineer
Adaptive Technology Insights • Hyderabad, Republic Of India, IN
We are looking for an experienced.You will be responsible for designing, building, and optimizing data pipelines and architecture to support analytics, reporting, and data-driven decision-making ac...Show more
Last updated: 11 days ago • Promoted
Senior Python Developer
BPMLinks • Hyderabad, Telangana, India
Job Title : Senior Python Backend Developer.Location : BPMLinks - Hyderabad (Work from Office).You will architect, design, and build robust backend systems using Python and modern frameworks for clou...Show more
Last updated: 11 days ago • Promoted
Python Engineer (Airflow, Cloud)
Luxoft • Greater Hyderabad Area, India
This project is part of a strategic initiative to migrate legacy on-premises data systems to a modern, scalable cloud-based data platform using Snowflake on Azure.
The goal is to enhance data access...Show more
Last updated: 3 days ago • Promoted
Lead Python Developer
Fission Labs • Hyderabad, Telangana, India
Role : Lead Python Developer – API & Cloud Systems Location : Hyderabad Experience : 9+ years No.Fission Labs, headquartered in Sunnyvale, with offices in Dallas & Hyderabad, Fission Labs is a leadin...Show more
Last updated: 8 days ago • Promoted
Lead Python Engineer
Gamyam • Hyderabad, Republic Of India, IN
Gamyam Info Tech LLP is looking for a.Location : Hyderabad / Razole (Onsite).Take complete ownership of modules and features—from.
Collaborate with cross-functional teams to design & implement new feat...Show more
Last updated: 10 days ago • Promoted
Python Developer - ETL / PySpark
Hire Alpha • Hyderabad,Telangana
Description : Role : Python : 5+ Years.Location : Hyderabad -5 Days WFO.Primary Skills : Strong in Python Programming, Pyspark queries, Data Structure and Algorithm.D...Show more
Last updated: 30+ days ago • Promoted
Data Unveil - Python Developer - ETL / PySpark
Data Unveil • Hyderabad
Description : About us : Data Unveil is the next generation provider of best-in-class data aggregation services.Our solutions and methodologies hav...Show more
Last updated: 30+ days ago • Promoted
Lead / Senior Engineer - Python
TESTQ Technologies Limited • Hyderabad
About the Opportunity : We are seeking a highly skilled Lead / Senior Engineer Python / Data / AI to design and build large-scale data-driven systems and AI-powered...Show more
Last updated: 30+ days ago • Promoted
ETL / BI Project Lead
Persistent Systems • Hyderabad, Republic Of India, IN
We are seeking an experienced Data Project Manager with strong expertise in managing complex data initiatives across the full project lifecycle.
The ideal candidate will have a deep understanding of...Show more
Last updated: 11 days ago • Promoted
Python Development Lead
Gamyam • Hyderabad, Republic Of India, IN
Gamyam Info Tech LLP is looking for a.Location : Hyderabad / Razole (Onsite).Take complete ownership of modules and features—from.
Collaborate with cross-functional teams to design & implement new feat...Show more
Last updated: 10 days ago • Promoted
Lead Python & GenAI Developer
Adecco • Hyderabad, Republic Of India, IN
Develop generative AI solutions on AWS, focusing on LLMs, prompt engineering, RAG, and agentic AI using n8n and Python libraries like LangChain.
Anthropic Claude) on AWS Bedrock with boto3.Fine-tune...Show more