Talent.com
Data Engineer

Data Engineer

GMGsecunderabad, India
3 hours ago
Job description

What we do :

GMG is a global well-being company retailing, distributing and manufacturing a portfolio of leading international and home-grown brands across sport, food and health sectors. Its vision is to inspire people to win in ways that make the world better. Today, GMG’s investments span four key verticals : GMG Sports, GMG Food, GMG Health, and GMG Consumer Goods. Under the ownership and management of the Baker family, it has become a leading global company, affiliated with the world’s most successful and respected brands in the well-being sector. Working across the Middle East, North Africa, and Asia, GMG has introduced more than 120 brands into its markets.

What will you do :

We are seeking a highly skilled Data Engineer specializing in AWS and Databricks. The ideal candidate will design, build, and maintain scalable data pipelines, ensuring efficient data ingestion, processing, and integration from multiple sources. This role requires expertise in AWS services, PySpark, SQL, and Databricks, along with strong optimization, security, and cost management skills.

Roles and Responsibilities :

Data Engineering & Pipeline Development

  • Develop and manage ETL pipelines for structured, semi-structured, and unstructured data using AWS Glue, PySpark, and SQL.
  • Handle real-time event stream data ingestion and processing from multiple source systems.
  • Ensure efficient data integration into Databricks for advanced processing and analytics.

Cloud & Infrastructure Management

  • Build and optimize backend systems leveraging AWS services (Glue, Athena, Lambda, SNS, S3).
  • Implement, configure, and manage Databricks environments, including clusters, notebooks, and libraries for performance optimization.
  • Ensure optimal resource utilization for AWS and Databricks clusters to improve efficiency and reduce costs.
  • Integrate Databricks with various cloud services while following governance and security best practices.
  • Testing & CI / CD Best Practices

  • Write unit test cases and integration tests to ensure data pipeline reliability.
  • Establish best practices for Databricks CI / CD and implement automation for deployment.
  • Optimization & Security

  • Apply performance tuning techniques to optimize queries, storage, and processing times.
  • Ensure compliance with security, governance, and industry best practices across AWS and Databricks environments.
  • Monitor system performance and proactively address issues to maintain high availability and reliability.
  • Functional / Technical Competencies :

  • Knowledge of Glue, PySpark, SQL, Athena, Lambda, SNS, S3
  • Knowledge of Databricks : Cluster setup, Notebooks, Libraries, CI / CD, Optimization
  • Data Processing : Event stream ingestion and batch processing
  • Testing : Writing unit test cases and integration tests
  • Security & Governance : AWS / Databricks governance standards and best practices
  • Performance Optimization : Query tuning, cluster performance improvements, cost reduction
  • Strong problem-solving and analytical skills
  • Ability to work in a fast-paced, cloud-based data environment
  • Excellent collaboration and communication skills
  • Strong attention to detail and commitment to best practices
  • Educational Qualification :

  • Bachelor's in computer science or computer engineering
  • Certification in Data Engineering and Analytics
  • Experience :

    Minimum 6 years' experience in Data engineering (Core development / design), in which 3+ years in AWS with command on (AWS glue, pyspark, SQL, Athena, lambda, SNS, S3) and 1+ year in Databricks.

    Create a job alert for this search

    Data Engineer • secunderabad, India

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    Softobizhyderabad, telangana, in
    Career-defining role available with Tier 1 Blue Chip Australian Client.As a Data Engineer, you will be involved in all phases of the software development life cycle, collecting and documenting busi...Show moreLast updated: 28 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Veraxionhyderabad, telangana, in
    Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 17 days ago
    • Promoted
    Data Engineer – Databricks Platform

    Data Engineer – Databricks Platform

    Amicon Hub ServicesHyderabad, Telangana, India
    Delta Lake, Spark, PySpark, SQL).SQL Server, MongoDB, InfluxDB).Kafka, Azure Event Hubs, or similar).Excellent problem-solving skills and the ability to work in a fast-paced environment.Familiar wi...Show moreLast updated: 17 days ago
    • Promoted
    Data Engineer

    Data Engineer

    DigitalzoneHyderabad, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    RecroHyderabad, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
    • Promoted
    Snowflake Data Engineer

    Snowflake Data Engineer

    AnblicksHyderabad, Republic Of India, IN
    Snowflake Data Engineer – Early Joiners Preferred.Hyderabad / Ahmedabad (Hybrid).Great Place to Work® Certified |.Snowflake Elite Partner (3 Years in a Row). Early Joiners / Immediate Joiners (withi...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    EverestDX Inchyderabad, telangana, in
    Everest DX – We are a Digital Platform Services company, headquartered in Stamford.Our Platform / Solution includes Orchestration, Intelligent operations with BOTs’, AI-powered analytics for Enterpri...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    People Prime WorldwideHyderabad, Telangana, India
    About Company : They balance innovation with an open, friendly culture and the backing of a long-established parent company, known for its ethical reputation. We guide customers from what’s now to w...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Prudent Technologies and Consulting, Inc.hyderabad, telangana, in
    Seeking an experienced Senior Data Engineer with over 9 years of industry experience to architect, build, and manage advanced data pipelines and platforms in a cloud environment.The ideal candidate...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Response InformaticsHyderabad, Telangana, India
    Cloud & Infrastructure • AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows. Snowflake : Moderate understanding of Snowflake architecture.C...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Technogen India Pvt. Ltd.hyderabad, telangana, in
    Design, build, and measure complex ELT jobs to process disparate data sources and form a high integrity, high quality, clean data asset. Executes and provides feedback for data modeling policies, pr...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Egenhyderabad, telangana, in
    We are looking for a skilled and motivated Lead Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team.The ideal candidate will...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Dexian Indiasecunderabad, telangana, in
    Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Constructing infrastructure for efficient ETL processes from vari...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    DraconXHyderabad, IN
    DraconX specializes in creating intelligent, scalable digital solutions that drive growth and innovation for startups and enterprises. As pioneers in AI business automation and SaaS platforms, we ex...Show moreLast updated: 3 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Quest DiagnosticsHyderabad, Republic Of India, IN
    Work as part of a small agile team to design and implement new features and technologies.Deliver high quality, high performance code in an agile environment. Use, evaluate, and learn exciting new te...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    GMGhyderabad, India
    GMG is a global well-being company retailing, distributing and manufacturing a portfolio of leading international and home-grown brands across sport, food and health sectors.Its vision is to inspir...Show moreLast updated: 3 hours ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    ValueMomentumHyderabad, Republic Of India, IN
    We are seeking a Senior Databricks Data Engineer with experience in designing and developing data pipelines using Azure Databricks, Data Factory, and Datalake. The role involves managing large volum...Show moreLast updated: 19 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalHyderabad, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago