Experience with Python(Lead Level) and PySpark + ETL
Key Responsibilities :
Lead the design, development, and optimization of Python- and PySpark-based data pipelines and ETL workflows.
Collaborate with data scientists and analysts to gather requirements and ensure data accuracy, quality, and consistency.
Build scalable and high-performance data solutions to support analytics and business operations.
Monitor data pipeline performance, identify bottlenecks, and troubleshoot issues proactively.
Drive architecture improvements and contribute to long-term data platform strategy.
Ensure compliance with data governance, security, and regulatory standards.
Prepare and maintain clear technical documentation for all data processes and systems.
Mentor, guide, and lead the data engineering team to deliver high-quality outcomes.
Required Skills & Qualifications :
Minimum 8+ years of hands-on experience in Python, with strong expertise in writing optimized and modular code.
Strong experience with PySpark, distributed processing, and big data technologies.
Proven experience leading engineering teams and delivering complex technical projects.
Strong understanding of ETL development, data modeling, and pipeline orchestration.
Experience with cloud platforms (AWS / Azure / GCP) is a plus.
Excellent problem-solving skills and ability to work in a fast-paced environment.
Strong communication and documentation skills.
(ref : hirist.tech)
Create a job alert for this search
Lead Python • Hyderabad
Related jobs
Senior Python Developer (Programming)
Jobseekerspage.com • hyderabad, telangana, in
HIRING - SENIOR PYTHON DEVELOPER.Senior Python Developer (Programming).We are seeking an experienced Python Developer with strong programming skills (not scripting) to develop and optimize data con...Show more
Last updated: 3 days ago • Promoted
Senior Python Developer
Luxoft • hyderabad, telangana, in
We're seeking a strong and creative Software Engineer eager to solve challenging problems of scale and work on cutting edge technologies.
In this project, you will have the opportunity to write code...Show more
Last updated: 30+ days ago • Promoted
Python Lead developer
Cognizant • Hyderabad, Telangana, India
Should have 10+ years of Python development experience Experience with popular Python frameworks such as Django, Flask or Pyramid.
Knowledge of data science and machine learning concepts and tools.A...Show more
Last updated: 2 days ago • Promoted
Senior Lead
Tata Consultancy Services • Hyderabad, Telangana, India
Required Technical Skill Set • • UiPath & Python Desired Experience Range • • 5-12 Yrs Location of Requirement : Bangalore (ITPL), Hyderabad (Adibatla), Chennai (Ozone), Delhi (GG7) Desired Competenc...Show more
Last updated: 20 days ago • Promoted
Senior Python Developer
Aarav Solutions • hyderabad, telangana, in
Aarav Solutions is a global Product Engineering and IT Consulting services provider.Our goal is to enable organizations in their digital transformation journey, leveraging our domain knowledge and ...Show more
Last updated: 30+ days ago • Promoted
Technoidentity - Technical Lead - Python / FastAPI
Whats in it for You ? - Modern Python Stack Python 3.FastAPI, Pandas, NumPy, SQLAlchemy, PostgreSQL / AlloyDB, PL / pgSQL.
Tech Leadership Drive technical decision-makin...Show more
Last updated: 30+ days ago • Promoted
Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)
AIMLEAP • Hyderabad, IN
Senior Python Data Engineer – ETL & Pipeline Development.Remote (WFH) / Bangalore / India.Tech / MCA / Computer Science / IT.
IT / Data / AI / LegalTech / Enterprise Solutions.ETL pipelines and data...Show more
Last updated: 23 hours ago • Promoted
Python Developer - ETL / PySpark
Hire Alpha • Hyderabad,Telangana
Description : Role : Python : 5+ Years.Location : Hyderabad -5 Days WFO.Primary Skills : Strong in Python Programming, Pyspark queries, Data Structure and Algorithm.D...Show more
Last updated: 30+ days ago • Promoted
Data Unveil - Python Developer - ETL / PySpark
Data Unveil • Hyderabad
Description : About us : Data Unveil is the next generation provider of best-in-class data aggregation services.Our solutions and methodologies hav...Show more
Last updated: 30+ days ago • Promoted
Lead / Senior Engineer - Python
TESTQ Technologies Limited • Hyderabad
About the Opportunity : We are seeking a highly skilled Lead / Senior Engineer Python / Data / AI to design and build large-scale data-driven systems and AI-powered...Show more
Last updated: 30+ days ago • Promoted
Founding Technical Lead - Python / Django
Aari Consultants • Hyderabad
Founding Technical Lead A Hyderabad based startup is looking for a Founding Technical Lead with 6- 10 years of experienc...Show more
Last updated: 30+ days ago • Promoted
Lead Python Developer
Fission Labs • hyderabad, telangana, in
Role : Lead Python Developer – API & Cloud Systems.Sunnyvale, with offices in Dallas & Hyderabad, Fission Labs is a leading software development company, specializing in crafting flexible, agile, an...Show more
Last updated: 3 days ago • Promoted
ETL Lead
MOURI Tech • Hyderabad, Telangana, India
Looking for Senior ETL Testing Exp Level : 7+ Years Location : Hyd, Bang, Vizag Mode of work : Hybrid Notice period : Immediate to 30 Days Max - Over 7 years of experience in Functional Testing, E...Show more
Last updated: 5 days ago • Promoted
Soulpage IT Solutions - Technical Lead - Python
SOULPAGE IT SOLUTIONS PRIVATE LIMITED • Hyderabad
Job Description : Key Responsibilities : - Lead the design, development, and deployment of backend sy...Show more
Last updated: 30+ days ago • Promoted
Macquarie - Data Lead - Python / SQL
Macquarie • Hyderabad
Description : Macquarie Asset Management (MAM) is a global asset manager, integrated across public and private markets.We focus on generating positive outcomes for o...Show more
Last updated: 8 hours ago • Promoted • New!
Python / Pyspark, Bigquery with GCP, Apache Iceberg
Tata Consultancy Services • Hyderabad, Telangana, India
TCS Hiring !!Virtual Drive • • •.Nov-25 Python / Pyspark, Bigquery with GCP, Apache Iceberg.Python / Pyspark, Bigquery with GCP, Apache Iceberg.
Please read Job description before Applying.NOTE : If the sk...Show more
Last updated: 14 days ago • Promoted
Lead Engineer - Python Technologies
P99SOFT PRIVATE LIMITED • Hyderabad
About the Role : We are seeking a highly skilled and experienced Lead Engineer with deep expertise in Python and FastAPI to join our dynamic technology team.The ideal candidate...Show more
Last updated: 30+ days ago • Promoted
Snowflake Developer - Python / Spark
First merdian • Hyderabad
Description : We are seeking a highly skilled and experienced Snowflake Lead responsible for leading the design, development, and implementation of Snowflake-based ...Show more