Talent.com
Data Engineering Manager (AWS Databricks)
Data Engineering Manager (AWS Databricks)Blend • Hyderabad, Telangana, India
Data Engineering Manager (AWS Databricks)

Data Engineering Manager (AWS Databricks)

Blend • Hyderabad, Telangana, India
25 days ago
Job description

We are looking for an experienced Data Engineering Manager with a strong foundation in Python, SQL, and Spark , and hands-on expertise in AWS, Databricks . In this role, you will build and maintain scalable data pipelines and architecture to support analytics, data science, and business intelligence initiatives. You’ll work closely with cross-functional teams to drive data reliability, quality, and performance.

Responsibilities :

  • Design, develop, and optimize scalable data pipelines using Databricks in AWS such as Glue, S3, Lambda, EMR, Databricks notebooks, workflows and jobs.
  • Building data lake in WS Databricks.
  • Build and maintain robust ETL / ELT workflows using Python and SQL to handle structured and semi-structured data.
  • Develop distributed data processing solutions using Apache Spark or PySpark .
  • Partner with data scientists and analysts to provide high-quality, accessible, and well-structured data.
  • Ensure data quality, governance, security, and compliance across pipelines and data stores.
  • Monitor, troubleshoot, and improve the performance of data systems and pipelines.
  • Participate in code reviews and help establish engineering best practices.
  • Mentor junior data engineers and support their technical development.

Requirements :

  • Bachelor's or master's degree in computer science, Engineering, or a related field.
  • 8+ years of hands-on experience in data engineering , with at least 3 years working with AWS Databricks .
  • Strong programming skills in Python for data processing and automation.
  • Advanced proficiency in SQL for querying and transforming large datasets.
  • Deep experience with Apache Spark / PySpark in a distributed computing environment.
  • Solid understanding of data modelling, warehousing, and performance optimization techniques.
  • Proficiency with AWS services such as Glue , S3 , Lambda and EMR .
  • Experience with version control Git or Code commit
  • Experience in any workflow orchestration like Airflow, AWS Step functions is a plus.
  • Excellent communication and stakeholder management skills with a strategic mindset.
  • Create a job alert for this search

    Manager Data Engineering • Hyderabad, Telangana, India

    Related jobs
    Data Engineer

    Data Engineer

    TerraGiG • Hyderabad, IN
    Lead the design, development, and implementation of data solutions using AWS and Snowflake.Collaborate with cross-functional teams to understand business requirements and translate them into techni...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineering Manager AWS Databricks

    Data Engineering Manager AWS Databricks

    Blend360 • Hyderabad, Telangana, India
    We are looking for an experienced .In this role you will build and maintain scalable data pipelines and architecture to support analytics data science and business intelligence initiatives.You...Show more
    Last updated: 26 days ago • Promoted
    Senior Manager – AWS Connect Engineering

    Senior Manager – AWS Connect Engineering

    Blue Spire Inc • Hyderabad, Telangana, India
    Blue Spire is seeking an experienced.Lead / Senior Manager – AWS Connect Engineering & API Solutions.AWS Connect migration and modernization programs for our BFSI enterprise clients.This role requi...Show more
    Last updated: 16 days ago • Promoted
    MLOps Engineer — AWS SageMaker

    MLOps Engineer — AWS SageMaker

    Hadron Talent -Hadronfinsys • Hyderabad, IN
    MLOps Engineer — AWS SageMaker.A large global enterprise (name not disclosed).Full-time / Long-term contract.You will work within a global data & analytics team to design, deploy, and maintain robu...Show more
    Last updated: 11 hours ago • Promoted • New!
    Senior AWS Data Engineer_Exp : 5+ Years

    Senior AWS Data Engineer_Exp : 5+ Years

    Atyeti Inc • Hyderabad, Telangana, India
    Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.Python; strong SQL and clo...Show more
    Last updated: 28 days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    iDWTeam • Hyderabad, Telangana, India
    The ideal candidate has strong hands-on experience with AWS data services, scalable ETL / ELT pipelines, and modern data architecture patterns. You will work collaboratively with analytics, engineerin...Show more
    Last updated: 8 hours ago • Promoted • New!
    Data Engineering Manager – Web Crawling & Pipeline Architecture ( 7 to 2 yrs)

    Data Engineering Manager – Web Crawling & Pipeline Architecture ( 7 to 2 yrs)

    AIMLEAP • Hyderabad, IN
    Data Engineering Manager – Web Crawling & Pipeline Architecture.Tech / MCA / Computer Science / IT .IT / Data / AI / E-commerce / FinTech / Healthcare . Experience working with cloud platforms such ...Show more
    Last updated: 4 days ago • Promoted
    Principal Data Engineer

    Principal Data Engineer

    KPI Partners • Hyderabad, Telangana, India
    We are seeking a highly skilled Principal Data Engineer to join our dynamic team at KPI Partners.Lead data engineering initiatives and projects from conception to delivery.Design and implement scal...Show more
    Last updated: 11 days ago • Promoted
    Data Engineering Manager (AWS Databricks)

    Data Engineering Manager (AWS Databricks)

    Blend • Hyderabad, Telangana, India
    We are looking for an experienced.In this role, you will build and maintain scalable data pipelines and architecture to support analytics, data science, and business intelligence initiatives.You’ll...Show more
    Last updated: 26 days ago • Promoted
    Engineering Manager

    Engineering Manager

    Tamara • Hyderabad, IN
    Tamara is the leading fintech platform in Saudi Arabia and the wider GCC region with a mission to help people make their dreams come true by building the most customer-centric financial super-app o...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer - Data Acquisition

    Senior Data Engineer - Data Acquisition

    InfoBeans • Hyderabad, IN
    We are seeking a highly skilled.Senior Data Engineer – Data Acquisition (ODS).The ideal candidate will have extensive hands-on experience in building and optimizing data ingestion and transformatio...Show more
    Last updated: 22 days ago • Promoted
    Engineering Manager

    Engineering Manager

    Confidential • Hyderabad, IN
    The ideal candidate will be responsible for managing and inspiring his or her team to achieve their performance metrics.Your role will involve strategizing, project management, part staff managemen...Show more
    Last updated: 2 days ago • Promoted
    Data Engineering Manager

    Data Engineering Manager

    Blend • Hyderabad, Republic Of India, IN
    We are looking for an experienced.In this role, you will build and maintain scalable data pipelines and architecture to support analytics, data science, and business intelligence initiatives.You’ll...Show more
    Last updated: 26 days ago • Promoted
    Data Engineering Solutions Architect

    Data Engineering Solutions Architect

    Logic Pursuits • Greater Hyderabad Area, India
    Data Engineering Solutions Architect.We are looking for an experienced.Data Engineering Solutions Architect.ETL, and reporting solutions across modern and traditional data platforms.You will play a...Show more
    Last updated: 14 days ago • Promoted
    Principal Data Engineer

    Principal Data Engineer

    CodeMyMobile • Hyderabad, IN
    Experience Required - 7 to 10 Years.Are you a Data Engineer who cares about clean engineering, autonomy, and solving real data challenges? If this sounds like you, we’d love to connect!.Email your ...Show more
    Last updated: 29 days ago • Promoted
    Project Manager – Data Engineering & Analytics

    Project Manager – Data Engineering & Analytics

    Brillio • Hyderabad, IN
    We are looking for a skilled Technical Project Manager to lead and deliver projects in data engineering and analytics.You will manage cross-functional teams to execute data platform, pipeline, and ...Show more
    Last updated: 30+ days ago • Promoted
    AWS Data Architect

    AWS Data Architect

    ACL Digital • Hyderabad, IN
    AWS (S3, Redshift, Glue, Lake Formation, IAM).Proficient in data modeling, performance tuning, and security best practices. .AWS Certified Solutions Architect preferred.Show more
    Last updated: 20 days ago • Promoted
    Principal Data Engineer

    Principal Data Engineer

    Nexuspoint Consultant • Hyderabad, IN
    We are looking for an accomplished Principal Data Engineer to lead the ideation, architecture,.You will work closely with cloud, security, and infrastructure architects to ensure seamless.Lead the ...Show more
    Last updated: 13 hours ago • Promoted • New!