EverestDX - Senior Data Engineer - Python/PySparkEverestDX • Hyderabad
EverestDX - Senior Data Engineer - Python / PySpark
EverestDX • Hyderabad
7 days ago
Job description
Description : Job Summary :
We are seeking an experienced Azure Data Engineer / Lead with strong expertise in Azure services, distributed data processing, and team leadership.
The ideal candidate will have hands-on experience with Azure Databricks, Azure Data Lake, Azure Data Factory, PySpark / Spark, and SQL, along with the ability to guide a small team on technical design and delivery.
Key Responsibilities :
Design, develop, and optimize large-scale data pipelines using Azure Databricks, ADLS, and ADF.
Implement and manage distributed data processing solutions using Spark / PySpark.
Write and optimize SQL queries for data extraction, transformation, and analysis.
Lead and mentor a small team of data engineers, providing technical guidance and reviewing design solutions.
Collaborate with stakeholders to translate business requirements into scalable and efficient data solutions.
Ensure data quality, governance, and compliance across data platforms.
Support production deployments, troubleshooting, and performance optimization.
Required Skills :
Strong expertise with Azure Databricks, Azure Data Lake, and Azure Data Factory.
Hands-on experience in Spark / PySpark for distributed data processing.
Proficiency in SQL for complex queries and optimization.
Solid understanding of Azure cloud platform and its ecosystem.
Proven experience in leading and mentoring teams.
Strong problem-solving and analytical skills.
Excellent communication and collaboration abilities
(ref : hirist.tech)
Create a job alert for this search
Senior Data Engineer • Hyderabad
Related jobs
Senior Python Data Engineer
iVoyant • hyderabad, telangana, in
Join a dynamic engineering team working on a high-impact tax reporting platform for the 2025 fiscal season.The core goal is to modernize and significantly accelerate the generation of Excel-based r...Show more
Last updated: 8 days ago • Promoted
Senior Data Engineer - AWS & Python
Egen • hyderabad, telangana, in
Design, develop, and maintain ETL / ELT data pipelines using Python and AWS native services (Glue, Lambda, EMR, Step Functions, etc.
Build and manage data lakes and data warehouses using Amazon S3, Re...Show more
Last updated: 6 days ago • Promoted
Lead Python Data Engineer _ Exp : 7+ Years
Atyeti Inc • secunderabad, telangana, in
Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.
Python; strong SQL and cloud-native development experience ...Show more
Last updated: 12 days ago • Promoted
Senior Data Engineer
Straive • Hyderabad, Telangana, India
The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
SGS & Co • hyderabad, telangana, in
Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in.
The ideal candidate will play a ke...Show more
Last updated: 22 days ago • Promoted
Senior Python Data Engineer
SIRO • hyderabad, telangana, in
Good Python Programming with 6 years of experience; PyCharm; Well versed in AWS tools , will be good if AWS architect certified.
GitHub; GitAction; Experience in deploying Data Pipelines.Good commu...Show more
Last updated: 13 days ago • Promoted
Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)
AIMLEAP • Hyderabad, IN
Senior Python Data Engineer – ETL & Pipeline Development.Remote (WFH) / Bangalore / India.Tech / MCA / Computer Science / IT.
IT / Data / AI / LegalTech / Enterprise Solutions.ETL pipelines and data...Show more
Last updated: 3 days ago • Promoted
Senior Data Engineer (Databricks / Python)
Tata Consultancy Services • Hyderabad, Republic Of India, IN
Currently, looking for an experienced Individual, worked on.Data-Bricks, Data Lake with Python.Kindly reach-out to me if you inherit these tools.
Extensive expertise in designing and implementing da...Show more
Last updated: 2 days ago • Promoted
Senior Data Engineer - Python / SQL
Warner Bros. Discovery • Hyderabad
Description : Your Role Accountabilities : - Gain an understanding of brand and enterprise data warehouse / reporting requirem...Show more
Last updated: 6 days ago • Promoted
Ingrain Systems Inc - Senior Data Engineer - Python / SQL
Ingrain Systems Inc • Hyderabad
Job Description : - Develop and own efficient SQL and Python code to support data analysis and ELT pipeline development.Build and maintain data transformation models ...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Adaptive Technology Insights • Hyderabad, Telangana, India
We are looking for an experienced.You will be responsible for designing, building, and optimizing data pipelines and architecture to support analytics, reporting, and data-driven decision-making ac...Show more
Last updated: 8 days ago • Promoted
Senior Data Engineer
Intellias • Hyderabad, Telangana, India
Tech Stack : Python Kafka Apache Flink / Apache Spark (Streaming) Apache Hudi / Apache Iceberg Required skills : 5+ years of experience as a Data Engineer or similar role, with hands-on expertise in ...Show more
Last updated: 22 days ago • Promoted
Senior Data Engineer - Python / SQL
Hiringeye • Hyderabad
Description : We are looking for a Senior Data Engineer who is passionate about transforming data into valua...Show more
Last updated: 27 days ago • Promoted
Lead / Senior Engineer - Python
TESTQ Technologies Limited • Hyderabad
About the Opportunity : We are seeking a highly skilled Lead / Senior Engineer Python / Data / AI to design and build large-scale data-driven systems and AI-powered...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
SAIVA AI • Hyderabad, IN
We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Live Connections • hyderabad, telangana, in
Hiring : Data Engineer | 9-12 Years Experience | Remote (India).Python, SQL, Big Data, Cloud, Snowflake.We are looking for an experienced.
The ideal candidate will have deep experience in.Python, SQL...Show more
Last updated: 30+ days ago • Promoted
Azure Senior Data Engineer
Tata Consultancy Services • Hyderabad, Telangana, India
TCS is hiring for AWS Data Engineer.Extensive coding experience including Python / Pyspark.Experience developing in Azure with key data technologies (e.
ADLS, ADF, Azure Databricks etc.Software develo...Show more
Last updated: 17 days ago • Promoted
Senior Data Analytics Engineer - Python / SQL
Insight Global, LLC • Hyderabad
Overview : We're looking for a creative and driven Senior Analytics Engineer to join our high-performing Data Analytics team in a fast-paced Healthcare IT environment.Th...Show more