Talent.com
No longer accepting applications
Data Engineer

Data Engineer

GMGhosur, tamil nadu, in
8 hours ago
Job description

What we do :

GMG is a global well-being company retailing, distributing and manufacturing a portfolio of leading international and home-grown brands across sport, food and health sectors. Its vision is to inspire people to win in ways that make the world better. Today, GMG’s investments span four key verticals : GMG Sports, GMG Food, GMG Health, and GMG Consumer Goods. Under the ownership and management of the Baker family, it has become a leading global company, affiliated with the world’s most successful and respected brands in the well-being sector. Working across the Middle East, North Africa, and Asia, GMG has introduced more than 120 brands into its markets.

What will you do :

We are seeking a highly skilled Data Engineer specializing in AWS and Databricks. The ideal candidate will design, build, and maintain scalable data pipelines, ensuring efficient data ingestion, processing, and integration from multiple sources. This role requires expertise in AWS services, PySpark, SQL, and Databricks, along with strong optimization, security, and cost management skills.

Roles and Responsibilities :

Data Engineering & Pipeline Development

  • Develop and manage ETL pipelines for structured, semi-structured, and unstructured data using AWS Glue, PySpark, and SQL.
  • Handle real-time event stream data ingestion and processing from multiple source systems.
  • Ensure efficient data integration into Databricks for advanced processing and analytics.

Cloud & Infrastructure Management

  • Build and optimize backend systems leveraging AWS services (Glue, Athena, Lambda, SNS, S3).
  • Implement, configure, and manage Databricks environments, including clusters, notebooks, and libraries for performance optimization.
  • Ensure optimal resource utilization for AWS and Databricks clusters to improve efficiency and reduce costs.
  • Integrate Databricks with various cloud services while following governance and security best practices.
  • Testing & CI / CD Best Practices

  • Write unit test cases and integration tests to ensure data pipeline reliability.
  • Establish best practices for Databricks CI / CD and implement automation for deployment.
  • Optimization & Security

  • Apply performance tuning techniques to optimize queries, storage, and processing times.
  • Ensure compliance with security, governance, and industry best practices across AWS and Databricks environments.
  • Monitor system performance and proactively address issues to maintain high availability and reliability.
  • Functional / Technical Competencies :

  • Knowledge of Glue, PySpark, SQL, Athena, Lambda, SNS, S3
  • Knowledge of Databricks : Cluster setup, Notebooks, Libraries, CI / CD, Optimization
  • Data Processing : Event stream ingestion and batch processing
  • Testing : Writing unit test cases and integration tests
  • Security & Governance : AWS / Databricks governance standards and best practices
  • Performance Optimization : Query tuning, cluster performance improvements, cost reduction
  • Strong problem-solving and analytical skills
  • Ability to work in a fast-paced, cloud-based data environment
  • Excellent collaboration and communication skills
  • Strong attention to detail and commitment to best practices
  • Educational Qualification :

  • Bachelor's in computer science or computer engineering
  • Certification in Data Engineering and Analytics
  • Experience :

    Minimum 6 years' experience in Data engineering (Core development / design), in which 3+ years in AWS with command on (AWS glue, pyspark, SQL, Athena, lambda, SNS, S3) and 1+ year in Databricks.

    Create a job alert for this search

    Data Engineer • hosur, tamil nadu, in

    Related jobs
    • Promoted
    Data Engineer 2

    Data Engineer 2

    YubiBangalore Urban, Karnataka, India
    As a Data Engineer, you will be part of a highly talented Data Engineering team.Responsible for developing reusable capabilities and tools to automate various types of data processing pipelines.You...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalBangalore, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    EVERSANABengaluru, Karnataka, India
    At EVERSANA, we are proud to be certified as a Great Place to Work across the globe.We’re fueled by our vision to create a healthier world. How? Our global team of more than 7,000 employees is commi...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    RecroBangalore, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    MareanaBengaluru, Karnataka, India
    Mareana is looking for experienced Data Engineer with a strong development background using, RDMS, graph database and NoSQL platforms. This role is responsible for developing and enhancing Mareana’s...Show moreLast updated: 28 days ago
    • Promoted
    Data Engineer

    Data Engineer

    AppsForBharatBengaluru, Karnataka, India
    We are looking for a Senior Data Engineer to lead the design and development of a next-generation data platform that powers real-time and batch applications at scale. This platform supports business...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineer

    Data Engineer

    thinkbridgebangalore district, karnataka, in
    We are a global digital product development firm that helps growth-stage companies gain the technology sophistication and maturity of leading modern digital businesses. We differentiate ourselves by...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Ironbook AIhosur, tamil nadu, in
    Data Engineer (Microsoft Fabric & Azure) - Relocation to KL.The Data Engineer is responsible for designing, building, and maintaining scalable data pipelines and modern data lakehouse architectures...Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    DevRabbit IT Solutionshosur, tamil nadu, in
    We are looking for a highly skilled.Data Engineer / Analytics Engineer.The ideal candidate will have strong expertise in. Python, Advanced SQL, DBT, and Snowflake.Design, develop, and maintain robus...Show moreLast updated: 8 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    DigitalzoneBengaluru, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineer

    Data Engineer

    DraconXBangalore, IN
    DraconX specializes in creating intelligent, scalable digital solutions that drive growth and innovation for startups and enterprises. As pioneers in AI business automation and SaaS platforms, we ex...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer

    Data Engineer

    SelectorBengaluru, Karnataka, India
    Selector is building an operational intelligence platform for digital infrastructure.By adopting an AI / ML-based analytics approach, the platform provides actionable multi-dimensional.It enables ope...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer || 6 to 8 years

    Data Engineer || 6 to 8 years

    Innova ESIhosur, tamil nadu, in
    Data Engineer for one of the MNC company with INNIOVA.Strong expertise in Apache Spark (batch + streaming) and Hive.Proficiency in Python, Scala, or Java. Knowledge of orchestration tools (Airflow / ...Show moreLast updated: 8 hours ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    CoffeeBeansbangalore, karnataka, in
    Founded in the year 2017, CoffeeBeans specialises in offering high end consulting services in technology, product, and processes. We help our clients attain significant improvement in quality of del...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    AAA Globalhosur, tamil nadu, in
    Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team. In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 28 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Grid DynamicsBengaluru, Karnataka, India
    Grid Dynamics (Nasdaq : GDYN) is a digital-native technology services provider that accelerates growth and bolsters competitive advantage for Fortune 1000 companies. Grid Dynamics provides digital tra...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Dexian Indiahosur, tamil nadu, in
    Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Constructing infrastructure for efficient ETL processes from vari...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Nile Connect LLPBengaluru, Karnataka, India
    We’re Hiring : Data Engineer (5–9 Years Experience).Are you a passionate Data Engineer ready to work with cutting-edge technologies and high-performing teams? We’re looking for an energetic, self-mo...Show moreLast updated: 3 days ago