Talent.com
No longer accepting applications
Data Engineer

Data Engineer

GMGPrayagraj(Allahabad), IN
10 hours ago
Job description

What we do :

GMG is a global well-being company retailing, distributing and manufacturing a portfolio of leading international and home-grown brands across sport, food and health sectors. Its vision is to inspire people to win in ways that make the world better. Today, GMG’s investments span four key verticals : GMG Sports, GMG Food, GMG Health, and GMG Consumer Goods. Under the ownership and management of the Baker family, it has become a leading global company, affiliated with the world’s most successful and respected brands in the well-being sector. Working across the Middle East, North Africa, and Asia, GMG has introduced more than 120 brands into its markets.

What will you do :

We are seeking a highly skilled Data Engineer specializing in AWS and Databricks. The ideal candidate will design, build, and maintain scalable data pipelines, ensuring efficient data ingestion, processing, and integration from multiple sources. This role requires expertise in AWS services, PySpark, SQL, and Databricks, along with strong optimization, security, and cost management skills.

Roles and Responsibilities :

Data Engineering & Pipeline Development

  • Develop and manage ETL pipelines for structured, semi-structured, and unstructured data using AWS Glue, PySpark, and SQL.
  • Handle real-time event stream data ingestion and processing from multiple source systems.
  • Ensure efficient data integration into Databricks for advanced processing and analytics.

Cloud & Infrastructure Management

  • Build and optimize backend systems leveraging AWS services (Glue, Athena, Lambda, SNS, S3).
  • Implement, configure, and manage Databricks environments, including clusters, notebooks, and libraries for performance optimization.
  • Ensure optimal resource utilization for AWS and Databricks clusters to improve efficiency and reduce costs.
  • Integrate Databricks with various cloud services while following governance and security best practices.
  • Testing & CI / CD Best Practices

  • Write unit test cases and integration tests to ensure data pipeline reliability.
  • Establish best practices for Databricks CI / CD and implement automation for deployment.
  • Optimization & Security

  • Apply performance tuning techniques to optimize queries, storage, and processing times.
  • Ensure compliance with security, governance, and industry best practices across AWS and Databricks environments.
  • Monitor system performance and proactively address issues to maintain high availability and reliability.
  • Functional / Technical Competencies :

  • Knowledge of Glue, PySpark, SQL, Athena, Lambda, SNS, S3
  • Knowledge of Databricks : Cluster setup, Notebooks, Libraries, CI / CD, Optimization
  • Data Processing : Event stream ingestion and batch processing
  • Testing : Writing unit test cases and integration tests
  • Security & Governance : AWS / Databricks governance standards and best practices
  • Performance Optimization : Query tuning, cluster performance improvements, cost reduction
  • Strong problem-solving and analytical skills
  • Ability to work in a fast-paced, cloud-based data environment
  • Excellent collaboration and communication skills
  • Strong attention to detail and commitment to best practices
  • Educational Qualification :

  • Bachelor's in computer science or computer engineering
  • Certification in Data Engineering and Analytics
  • Experience :

    Minimum 6 years' experience in Data engineering (Core development / design), in which 3+ years in AWS with command on (AWS glue, pyspark, SQL, Athena, lambda, SNS, S3) and 1+ year in Databricks.

    Create a job alert for this search

    Data Engineer • Prayagraj(Allahabad), IN

    Related jobs
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Xsell ResourcesPrayagraj(Allahabad), IN
    Seeking a GCP Certified Data Engineer to work remotely from India for our Fortune 5 healthcare client in the US.No notice periods more than 15 days. GCP Google Cloud Professional Data Engineer Certi...Show moreLast updated: 5 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    HealthyMe AIPrayagraj(Allahabad), IN
    We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    RecroPrayagraj(Allahabad), IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
    • Promoted
    Sr Data Engineer

    Sr Data Engineer

    Mitchell Martin Inc.Prayagraj(Allahabad), IN
    Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer to design, build, and optimize data pipelines and systems that power our analytics, reporting, and data-driven decision-mak...Show moreLast updated: 20 days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    TerraGiGPrayagraj(Allahabad), IN
    Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR. Writing reusable, testable, and efficient code.Integration of data storage ...Show moreLast updated: 17 days ago
    • Promoted
    Data Engineer

    Data Engineer

    AAA GlobalPrayagraj(Allahabad), IN
    Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team. In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 28 days ago
    • Promoted
    AI / ML & Data Engineer

    AI / ML & Data Engineer

    Mindfire SolutionsPrayagraj(Allahabad), IN
    We are looking for an experienced AI / ML & Data Engineer to design, develop, and deploy scalable machine learning models and data infrastructure on AWS. You will work closely with cross-functional te...Show moreLast updated: 19 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgePrayagraj(Allahabad), IN
    We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Azure Data Engineer

    Azure Data Engineer

    SystemBenderPrayagraj(Allahabad), IN
    Advance SQL Azure Data Factory (ADF) Databricks with PySpark Azure Synapse (added advantage).Fully conversant with big-data processing approaches and schema-on-read methodologies is a must and know...Show moreLast updated: 11 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalPrayagraj(Allahabad), IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago
    • Promoted
    Data & Analytics Engineer

    Data & Analytics Engineer

    APPIT Software IncPrayagraj(Allahabad), IN
    Data Engineer : Snowflake -Mandatory – Hands -on Experience.ETL Tool -Informatica [IVS version],BDT.GCP : Big query – Mandatory -handson experience. Data Modelling & Data Warehouse -Mandatory -Hands...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer (Analyst)

    Data Engineer (Analyst)

    Canopus Infosystems - A CMMI Level 3 CompanyPrayagraj(Allahabad), IN
    We are looking for an experienced .The ideal candidate should have a strong understanding of SQL, cloud data warehouses (preferably Snowflake), and hands-on experience with advertising or marketing...Show moreLast updated: 5 days ago
    • Promoted
    Data Engineer

    Data Engineer

    DigitalzonePrayagraj(Allahabad), IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 6 days ago
    • Promoted
    Freelance Data Engineer

    Freelance Data Engineer

    upGradPrayagraj(Allahabad), IN
    We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 26 days ago
    • Promoted
    Data Engineer (Qlick Experience)

    Data Engineer (Qlick Experience)

    Add Min Web WorldPrayagraj(Allahabad), IN
    Job Title : Data Engineer (Qlik Experience).We are looking for a dedicated.The ideal candidate should have a strong understanding of data processing, integration, and reporting, along with the abili...Show moreLast updated: 6 days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    K&K Talents - IndiaPrayagraj(Allahabad), IN
    This position is with one of our.Location : Bangalore, Bhopal, Chennai, Gurugram, Hyderabad, Jaipur, Pune.Employment Type : Full-time Permanent. We are seeking an experienced Data Engineer with strong...Show moreLast updated: 27 days ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    CodeMyMobilePrayagraj(Allahabad), IN
    Experience Required - 7 to 10 Years.Are you a Data Engineer who cares about clean engineering, autonomy, and solving real data challenges? If this sounds like you, we’d love to connect!.Email your ...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineer

    Data Engineer

    DraconXPrayagraj(Allahabad), IN
    DraconX specializes in creating intelligent, scalable digital solutions that drive growth and innovation for startups and enterprises. As pioneers in AI business automation and SaaS platforms, we ex...Show moreLast updated: 2 days ago