Talent.com
AWS Databricks Engineer

AWS Databricks Engineer

GMGHaryāna, Republic Of India, IN
23 hours ago
Job description

What we do :

GMG is a global well-being company retailing, distributing and manufacturing a portfolio of leading international and home-grown brands across sport, food and health sectors. Its vision is to inspire people to win in ways that make the world better. Today, GMG’s investments span four key verticals : GMG Sports, GMG Food, GMG Health, and GMG Consumer Goods. Under the ownership and management of the Baker family, it has become a leading global company, affiliated with the world’s most successful and respected brands in the well-being sector. Working across the Middle East, North Africa, and Asia, GMG has introduced more than 120 brands into its markets.

What will you do :

We are seeking a highly skilled Data Engineer specializing in AWS and Databricks. The ideal candidate will design, build, and maintain scalable data pipelines, ensuring efficient data ingestion, processing, and integration from multiple sources. This role requires expertise in AWS services, PySpark, SQL, and Databricks, along with strong optimization, security, and cost management skills.

Roles and Responsibilities :

Data Engineering & Pipeline Development

  • Develop and manage ETL pipelines for structured, semi-structured, and unstructured data using AWS Glue, PySpark, and SQL.
  • Handle real-time event stream data ingestion and processing from multiple source systems.
  • Ensure efficient data integration into Databricks for advanced processing and analytics.

Cloud & Infrastructure Management

  • Build and optimize backend systems leveraging AWS services (Glue, Athena, Lambda, SNS, S3).
  • Implement, configure, and manage Databricks environments, including clusters, notebooks, and libraries for performance optimization.
  • Ensure optimal resource utilization for AWS and Databricks clusters to improve efficiency and reduce costs.
  • Integrate Databricks with various cloud services while following governance and security best practices.
  • Testing & CI / CD Best Practices

  • Write unit test cases and integration tests to ensure data pipeline reliability.
  • Establish best practices for Databricks CI / CD and implement automation for deployment.
  • Optimization & Security

  • Apply performance tuning techniques to optimize queries, storage, and processing times.
  • Ensure compliance with security, governance, and industry best practices across AWS and Databricks environments.
  • Monitor system performance and proactively address issues to maintain high availability and reliability.
  • Functional / Technical Competencies :

  • Knowledge of Glue, PySpark, SQL, Athena, Lambda, SNS, S3
  • Knowledge of Databricks : Cluster setup, Notebooks, Libraries, CI / CD, Optimization
  • Data Processing : Event stream ingestion and batch processing
  • Testing : Writing unit test cases and integration tests
  • Security & Governance : AWS / Databricks governance standards and best practices
  • Performance Optimization : Query tuning, cluster performance improvements, cost reduction
  • Strong problem-solving and analytical skills
  • Ability to work in a fast-paced, cloud-based data environment
  • Excellent collaboration and communication skills
  • Strong attention to detail and commitment to best practices
  • Educational Qualification :

  • Bachelor's in computer science or computer engineering
  • Certification in Data Engineering and Analytics
  • Experience :

    Minimum 6 years' experience in Data engineering (Core development / design), in which 3+ years in AWS with command on (AWS glue, pyspark, SQL, Athena, lambda, SNS, S3) and 1+ year in Databricks.

    Create a job alert for this search

    Aws Engineer • Haryāna, Republic Of India, IN

    Related jobs
    • Promoted
    MLOps & DevOps Engineer

    MLOps & DevOps Engineer

    Amicon Hub ServicesHaryāna, Republic Of India, IN
    Senior MLOps / DevOps Engineer (for one of our esteemed clients).PAN India (Gurugram, Noida, Bangalore, Chennai, Hyderabad, Pune). AI / ML Infrastructure & Automation.We’re looking for a passionate ...Show moreLast updated: 23 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    KOGTA FINANCIAL (INDIA) LIMITEDharyana, haryana, in
    ETL & Data Warehouse Developer.As a key member of our data engineering team, you will be responsible for designing, developing, and optimizing ETL pipelines and scalable data warehouse solutions on...Show moreLast updated: 1 day ago
    • Promoted
    Cloud Engineer

    Cloud Engineer

    The NorthCap Universityharyana, haryana, in
    Sc in Computer Science, Information Technology, or related field.The NorthCap University is seeking a skilled.The ideal candidate will manage and optimize our cloud infrastructure, ensure data secu...Show moreLast updated: 1 day ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Impetusharyana, haryana, in
    Design, build, and maintain large-scale data pipelines on BigQuery and other Google Cloud Platform (GCP) services.Use Python and PySpark / Spark to transform, clean, aggregate and prepare data for an...Show moreLast updated: 1 day ago
    • Promoted
    Analytics Engineer

    Analytics Engineer

    NABHaryāna, Republic Of India, IN
    Proficient in executing ETL processes between data environments.Proficient at coding in SQL (additional knowledge in Python and R is highly regarded). Proficient at creating analytics related docume...Show moreLast updated: 23 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Atomic Northharyana, haryana, in
    Azure Databricks, PySpark, Python, SQL, Azure Data Factory, Data Modelling, Data Migration, Data Warehousing.India (Remote / Hybrid options available). Azure Data Factory, Azure Databricks, and Data...Show moreLast updated: 1 day ago
    • Promoted
    Cloud Data Solutions Engineer

    Cloud Data Solutions Engineer

    Atomic NorthHaryāna, Republic Of India, IN
    Azure Databricks, PySpark, Python, SQL, Azure Data Factory, Data Modelling, Data Migration, Data Warehousing.India (Remote / Hybrid options available). Azure Data Factory, Azure Databricks, and Data...Show moreLast updated: 23 hours ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    ManpowerGroup IndiaHaryāna, Republic Of India, IN
    ADF, ETL and SSIS, Python and SQL including data warehousing concepts and data warehousing principles.Proficiency in ETL tools and SQL for data extraction, transformation, and loading.Experience pe...Show moreLast updated: 23 hours ago
    • Promoted
    Data Engineer - II

    Data Engineer - II

    Airtel Payments Bankharyana, haryana, in
    Airtel Payments Bank, India's first payments bank is a completely digital and paperless bank.The bank aims to take basic banking services to the doorstep of every Indian by leveraging Airtel's vast...Show moreLast updated: 1 day ago
    • Promoted
    Principal Data Engineer (Azure)

    Principal Data Engineer (Azure)

    Atomic NorthHaryāna, Republic Of India, IN
    Azure Databricks, PySpark, Python, SQL, Azure Data Factory, Data Modelling, Data Migration, Data Warehousing.India (Remote / Hybrid options available). Azure Data Factory, Azure Databricks, and Data...Show moreLast updated: 23 hours ago
    • Promoted
    Cloud Data Engineer

    Cloud Data Engineer

    ImpetusHaryāna, Republic Of India, IN
    Design, build, and maintain large-scale data pipelines on BigQuery and other Google Cloud Platform (GCP) services.Use Python and PySpark / Spark to transform, clean, aggregate and prepare data for an...Show moreLast updated: 23 hours ago
    • Promoted
    • New!
    Data Analytics Engineer

    Data Analytics Engineer

    True Tech ProfessionalsHaryāna, Republic Of India, IN
    Experience required - 4+ years.Job Description : Senior Looker Full Stack Engineer.Senior Looker Full Stack Engineer.Business Intelligence (BI) and data activation stack. This role involves designing...Show moreLast updated: 21 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Obrimo TechnologiesHaryana, India
    Software Engineer & Data Analyst.The ideal candidate will be skilled in.You’ll work with cross-functional teams to design, develop, and deploy cloud-based applications and analytical dashboards tha...Show moreLast updated: 1 day ago
    • Promoted
    AWS DevOps

    AWS DevOps

    Malayaj Solutionsharyana, haryana, in
    Malayaj Solutions, headquartered in Bangalore, is a trusted provider of innovative and customized technology services since 2018. The company specializes in Development, Automation, Digital Transfor...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    NABharyana, haryana, in
    Proficient in executing ETL processes between data environments.Proficient at coding in SQL (additional knowledge in Python and R is highly regarded). Proficient at creating analytics related docume...Show moreLast updated: 1 day ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    GSPANN Technologies, IncHaryāna, Republic Of India, IN
    Headquartered in California, U.GSPANN provides consulting and IT services to global clients.We help clients transform how they deliver business value by helping them optimize their IT capabilities,...Show moreLast updated: 23 hours ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    MakeMyTripharyana, haryana, in
    We are looking for experienced Data engineers with excellent problem-solving skills to develop machine-learning powered Data Products design to enhance customer experiences.Nurtured from the seed o...Show moreLast updated: 1 day ago
    • Promoted
    Data Solutions Engineer

    Data Solutions Engineer

    ReqpediaHaryāna, Republic Of India, IN
    Job Title : Azure Data Engineer.Minimum 6+ years of experience in a Cloud Data Engineering role.Hands-on experience with Azure Cloud data tools (ADF, SHIR,. Logic Apps, ADLS Gen2, Blob Storage), Data...Show moreLast updated: 23 hours ago