Talent.com
EverestDX - Senior Data Engineer - Python/PySpark
EverestDX - Senior Data Engineer - Python/PySparkEverestDX • Hyderabad
EverestDX - Senior Data Engineer - Python / PySpark

EverestDX - Senior Data Engineer - Python / PySpark

EverestDX • Hyderabad
7 days ago
Job description

Description : Job Summary :

  • We are seeking an experienced Azure Data Engineer / Lead with strong expertise in Azure services, distributed data processing, and team leadership.
  • The ideal candidate will have hands-on experience with Azure Databricks, Azure Data Lake, Azure Data Factory, PySpark / Spark, and SQL, along with the ability to guide a small team on technical design and delivery.

Key Responsibilities :

  • Design, develop, and optimize large-scale data pipelines using Azure Databricks, ADLS, and ADF.
  • Implement and manage distributed data processing solutions using Spark / PySpark.
  • Write and optimize SQL queries for data extraction, transformation, and analysis.
  • Lead and mentor a small team of data engineers, providing technical guidance and reviewing design solutions.
  • Collaborate with stakeholders to translate business requirements into scalable and efficient data solutions.
  • Ensure data quality, governance, and compliance across data platforms.
  • Support production deployments, troubleshooting, and performance optimization.
  • Required Skills :

  • Strong expertise with Azure Databricks, Azure Data Lake, and Azure Data Factory.
  • Hands-on experience in Spark / PySpark for distributed data processing.
  • Proficiency in SQL for complex queries and optimization.
  • Solid understanding of Azure cloud platform and its ecosystem.
  • Proven experience in leading and mentoring teams.
  • Strong problem-solving and analytical skills.
  • Excellent communication and collaboration abilities
  • (ref : hirist.tech)

    Create a job alert for this search

    Senior Data Engineer • Hyderabad

    Related jobs
    Senior Python Data Engineer

    Senior Python Data Engineer

    iVoyant • hyderabad, telangana, in
    Join a dynamic engineering team working on a high-impact tax reporting platform for the 2025 fiscal season.The core goal is to modernize and significantly accelerate the generation of Excel-based r...Show more
    Last updated: 8 days ago • Promoted
    Senior Data Engineer - AWS & Python

    Senior Data Engineer - AWS & Python

    Egen • hyderabad, telangana, in
    Design, develop, and maintain ETL / ELT data pipelines using Python and AWS native services (Glue, Lambda, EMR, Step Functions, etc. Build and manage data lakes and data warehouses using Amazon S3, Re...Show more
    Last updated: 6 days ago • Promoted
    Lead Python Data Engineer _ Exp : 7+ Years

    Lead Python Data Engineer _ Exp : 7+ Years

    Atyeti Inc • secunderabad, telangana, in
    Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles. Python; strong SQL and cloud-native development experience ...Show more
    Last updated: 12 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Straive • Hyderabad, Telangana, India
    The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SGS & Co • hyderabad, telangana, in
    Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in. The ideal candidate will play a ke...Show more
    Last updated: 22 days ago • Promoted
    Senior Python Data Engineer

    Senior Python Data Engineer

    SIRO • hyderabad, telangana, in
    Good Python Programming with 6 years of experience; PyCharm; Well versed in AWS tools , will be good if AWS architect certified. GitHub; GitAction; Experience in deploying Data Pipelines.Good commu...Show more
    Last updated: 13 days ago • Promoted
    Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)

    Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)

    AIMLEAP • Hyderabad, IN
    Senior Python Data Engineer – ETL & Pipeline Development.Remote (WFH) / Bangalore / India.Tech / MCA / Computer Science / IT. IT / Data / AI / LegalTech / Enterprise Solutions.ETL pipelines and data...Show more
    Last updated: 3 days ago • Promoted
    Senior Data Engineer (Databricks / Python)

    Senior Data Engineer (Databricks / Python)

    Tata Consultancy Services • Hyderabad, Republic Of India, IN
    Currently, looking for an experienced Individual, worked on.Data-Bricks, Data Lake with Python.Kindly reach-out to me if you inherit these tools. Extensive expertise in designing and implementing da...Show more
    Last updated: 2 days ago • Promoted
    Senior Data Engineer - Python / SQL

    Senior Data Engineer - Python / SQL

    Warner Bros. Discovery • Hyderabad
    Description : Your Role Accountabilities : - Gain an understanding of brand and enterprise data warehouse / reporting requirem...Show more
    Last updated: 6 days ago • Promoted
    Ingrain Systems Inc - Senior Data Engineer - Python / SQL

    Ingrain Systems Inc - Senior Data Engineer - Python / SQL

    Ingrain Systems Inc • Hyderabad
    Job Description : - Develop and own efficient SQL and Python code to support data analysis and ELT pipeline development.Build and maintain data transformation models ...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Adaptive Technology Insights • Hyderabad, Telangana, India
    We are looking for an experienced.You will be responsible for designing, building, and optimizing data pipelines and architecture to support analytics, reporting, and data-driven decision-making ac...Show more
    Last updated: 8 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Intellias • Hyderabad, Telangana, India
    Tech Stack : Python Kafka Apache Flink / Apache Spark (Streaming) Apache Hudi / Apache Iceberg Required skills : 5+ years of experience as a Data Engineer or similar role, with hands-on expertise in ...Show more
    Last updated: 22 days ago • Promoted
    Senior Data Engineer - Python / SQL

    Senior Data Engineer - Python / SQL

    Hiringeye • Hyderabad
    Description : We are looking for a Senior Data Engineer who is passionate about transforming data into valua...Show more
    Last updated: 27 days ago • Promoted
    Lead / Senior Engineer - Python

    Lead / Senior Engineer - Python

    TESTQ Technologies Limited • Hyderabad
    About the Opportunity : We are seeking a highly skilled Lead / Senior Engineer Python / Data / AI to design and build large-scale data-driven systems and AI-powered...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AI • Hyderabad, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Live Connections • hyderabad, telangana, in
    Hiring : Data Engineer | 9-12 Years Experience | Remote (India).Python, SQL, Big Data, Cloud, Snowflake.We are looking for an experienced. The ideal candidate will have deep experience in.Python, SQL...Show more
    Last updated: 30+ days ago • Promoted
    Azure Senior Data Engineer

    Azure Senior Data Engineer

    Tata Consultancy Services • Hyderabad, Telangana, India
    TCS is hiring for AWS Data Engineer.Extensive coding experience including Python / Pyspark.Experience developing in Azure with key data technologies (e. ADLS, ADF, Azure Databricks etc.Software develo...Show more
    Last updated: 17 days ago • Promoted
    Senior Data Analytics Engineer - Python / SQL

    Senior Data Analytics Engineer - Python / SQL

    Insight Global, LLC • Hyderabad
    Overview : We're looking for a creative and driven Senior Analytics Engineer to join our high-performing Data Analytics team in a fast-paced Healthcare IT environment.Th...Show more
    Last updated: 9 days ago • Promoted