Talent.com
Data Engineer

Data Engineer

MyData Insights Pvt LtdMalappuram, IN
1 day ago
Job description

Role : Data Engineer

Experience : 6–12 years

Location : Remote

Engagement : Contract (4–6 Months)

Work Type : Remote

About the Role

We are seeking an experienced Data Engineer to support data modernization and analytics initiatives across multi-cloud environments. The ideal candidate has a strong background in building scalable data solutions on AWS, Azure, or GCP , along with hands-on expertise in CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices .

Experience working in Pharma or Life Sciences environments is a strong plus (not mandatory).

Key Responsibilities

Cloud Data Engineering

  • Design, build, and optimize scalable data pipelines across AWS, Azure, or GCP.
  • Develop ingestion, transformation, and orchestration pipelines using cloud-native services (e.g., AWS Glue, Azure Data Factory, GCP Dataflow).
  • Implement ETL / ELT workflows for large-scale structured and unstructured datasets.

CI / CD, Cloud Build & Deployment

  • Build and maintain CI / CD pipelines for infrastructure and application deployments.
  • Work with Azure DevOps, GitHub Actions, GitLab CI, Jenkins, or Google Cloud Build .
  • Ensure automated deployments, version control, and environment consistency.
  • Infrastructure as Code (IaC)

  • Use Terraform to design, provision, and manage cloud infrastructure.
  • Implement reusable IaC modules for multi-cloud data architecture.
  • Cloud Architecture & Operations

  • Work across AWS, Azure, and GCP to build secure, scalable, and cost-efficient data platforms.
  • Collaborate with architecture teams on network, security, IAM, and storage configurations.
  • Optimize data workflows for performance, cost, and reliability.
  • Data Integration & Analytics Support

  • Build data models, pipelines, and transformations to support analytics, ML, and reporting needs.
  • Work with Data Scientists, BI teams, and domain experts to ensure data availability and quality.
  • Documentation & Collaboration

  • Maintain clear technical documentation covering pipelines, architecture, and workflows.
  • Collaborate with cross-functional teams including cloud engineering, QA, and domain SMEs.
  • Required Skills

  • 6–12 years of experience as a Data Engineer in cloud-driven environments.
  • Strong hands-on experience with at least one of the following cloud platforms :
  • AWS (Glue, Lambda, S3, EMR, Redshift)
  • Azure (ADF, Synapse, Databricks, Storage, Functions)
  • GCP (BigQuery, Dataflow, Cloud Build, Cloud Functions)
  • Strong experience with CI / CD pipelines (Azure DevOps, GitHub Actions, Jenkins, GCP Cloud Build).
  • Solid expertise in Terraform for IaC.
  • Strong Python or SQL experience for building data pipelines.
  • Experience with data modeling, ETL / ELT patterns, and distributed data processing.
  • Exposure to infrastructure and application deployment automation.
  • Good-to-Have Skills

  • Pharma / Life Sciences domain experience.
  • Experience with DataOps practices.
  • Familiarity with regulatory and compliance requirements (GxP, HIPAA preferred).
  • Experience with containerization (Docker, Kubernetes).
  • Create a job alert for this search

    Data Engineer • Malappuram, IN

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    DigitalzoneKozhikode, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 17 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalThrissur, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer – CDP

    Data Engineer – CDP

    Integers.AiKozhikode, IN
    Job Description : Data Engineer – CDP.Data Engineer with strong CDP expertise.The ideal candidate will have hands-on experience working with Customer Data Platforms—specifically Real-Time CDP and Sa...Show moreLast updated: 2 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    BayOne SolutionsMalappuram, IN
    We are seeking a highly experienced Data Engineer to join our MarTech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engine...Show moreLast updated: 30+ days ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    PamTen IncKozhikode, IN
    You will work ongoing support activities and support project efforts as needed.You triage identified issues across Account source platforms, integrations and Customer Data Hub.You will analyze and ...Show moreLast updated: 10 days ago
    • Promoted
    Databricks Data Engineer Lead – Sustainability Project

    Databricks Data Engineer Lead – Sustainability Project

    Blue Cloud Softech Solutions LimitedMalappuram, IN
    BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level ...Show moreLast updated: 3 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeKozhikode, IN
    We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy ServicesThrissur, IN
    TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer (GCP)

    Data Engineer (GCP)

    HISH IT SERVICESKozhikode, IN
    We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery). This role requires a hands-on developer who can collaborate closely wit...Show moreLast updated: 9 days ago
    • Promoted
    Data Engineer

    Data Engineer

    RecroMalappuram, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    AWS Data Engineer

    AWS Data Engineer

    COVET IT INCMalappuram, IN
    Please go through the below requirements and let me know your interest and forward your resume along with your contact information to raja@covetitinc. We are seeking a highly skilled AWS Data Engine...Show moreLast updated: 6 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    MindlanceThrissur, IN
    We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    Randstad EnterpriseKozhikode, IN
    Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show moreLast updated: 30+ days ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    AdastraKozhikode, IN
    We are looking for a proactive and solution-oriented GCP Data Engineer to join our team.This role requires hands-on experience in Google Cloud Platform (GCP), especially with BigQuery and Airflow, ...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer

    Data Engineer

    AceolutionMalappuram, IN
    Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    LanceSoft, Inc.Thrissur, IN
    This team is looking to hire a motivated Sr.Data Engineer who will be working closely with team of highly motivated data engineers to build a state-of-the-art marketing data platform to solve vario...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer

    Data Engineer

    MyData Insights Pvt LtdThrissur, IN
    The ideal candidate has a strong background in building scalable data solutions on.CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices.Design, bu...Show moreLast updated: 1 day ago
    • Promoted
    Freelance Data Engineer

    Freelance Data Engineer

    Leading MNCKozhikode, IN
    Looking for a Freelance Data Engineer to join a team of rockstar developers.The candidate should have a minimum of 8+ yrs. If you're looking for freelance / part time opportunity (along with your day...Show moreLast updated: 30+ days ago