Talent.com
Data Engineer

Data Engineer

MyData Insights Pvt LtdBangalore, IN
2 days ago
Job description

Role : Data Engineer

Experience : 6–12 years

Location : Remote

Engagement : Contract (4–6 Months)

Work Type : Remote

About the Role

We are seeking an experienced Data Engineer to support data modernization and analytics initiatives across multi-cloud environments. The ideal candidate has a strong background in building scalable data solutions on AWS, Azure, or GCP , along with hands-on expertise in CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices .

Experience working in Pharma or Life Sciences environments is a strong plus (not mandatory).

Key Responsibilities

Cloud Data Engineering

  • Design, build, and optimize scalable data pipelines across AWS, Azure, or GCP.
  • Develop ingestion, transformation, and orchestration pipelines using cloud-native services (e.g., AWS Glue, Azure Data Factory, GCP Dataflow).
  • Implement ETL / ELT workflows for large-scale structured and unstructured datasets.

CI / CD, Cloud Build & Deployment

  • Build and maintain CI / CD pipelines for infrastructure and application deployments.
  • Work with Azure DevOps, GitHub Actions, GitLab CI, Jenkins, or Google Cloud Build .
  • Ensure automated deployments, version control, and environment consistency.
  • Infrastructure as Code (IaC)

  • Use Terraform to design, provision, and manage cloud infrastructure.
  • Implement reusable IaC modules for multi-cloud data architecture.
  • Cloud Architecture & Operations

  • Work across AWS, Azure, and GCP to build secure, scalable, and cost-efficient data platforms.
  • Collaborate with architecture teams on network, security, IAM, and storage configurations.
  • Optimize data workflows for performance, cost, and reliability.
  • Data Integration & Analytics Support

  • Build data models, pipelines, and transformations to support analytics, ML, and reporting needs.
  • Work with Data Scientists, BI teams, and domain experts to ensure data availability and quality.
  • Documentation & Collaboration

  • Maintain clear technical documentation covering pipelines, architecture, and workflows.
  • Collaborate with cross-functional teams including cloud engineering, QA, and domain SMEs.
  • Required Skills

  • 6–12 years of experience as a Data Engineer in cloud-driven environments.
  • Strong hands-on experience with at least one of the following cloud platforms :
  • AWS (Glue, Lambda, S3, EMR, Redshift)
  • Azure (ADF, Synapse, Databricks, Storage, Functions)
  • GCP (BigQuery, Dataflow, Cloud Build, Cloud Functions)
  • Strong experience with CI / CD pipelines (Azure DevOps, GitHub Actions, Jenkins, GCP Cloud Build).
  • Solid expertise in Terraform for IaC.
  • Strong Python or SQL experience for building data pipelines.
  • Experience with data modeling, ETL / ELT patterns, and distributed data processing.
  • Exposure to infrastructure and application deployment automation.
  • Good-to-Have Skills

  • Pharma / Life Sciences domain experience.
  • Experience with DataOps practices.
  • Familiarity with regulatory and compliance requirements (GxP, HIPAA preferred).
  • Experience with containerization (Docker, Kubernetes).
  • Create a job alert for this search

    Data Engineer • Bangalore, IN

    Related jobs
    • Promoted
    Data Engineer 2

    Data Engineer 2

    YubiBangalore Urban, Karnataka, India
    As a Data Engineer, you will be part of a highly talented Data Engineering team.Responsible for developing reusable capabilities and tools to automate various types of data processing pipelines.You...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Networth CorpBengaluru, Karnataka, India
    Working along with architects for planning, designing, integrating, and implementing complex solutions in Azure Cloud computing services. End to end development lifecycle of complex large-scale and ...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy ServicesGreater Bengaluru Area, India
    TCS has always been in the spotlight for being adept in the next big technologies.What we can offer you is a space to explore varied technologies and quench your techie soul.Required Skill : Azure D...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    MareanaBengaluru, Karnataka, India
    Mareana is looking for experienced Data Engineer with a strong development background using, RDMS, graph database and NoSQL platforms. This role is responsible for developing and enhancing Mareana’s...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    HCLTechGreater Bengaluru Area, India
    F2F Hackathon scheduled on 22nd Nov 2025.If you are passionate about building scalable data solutions on Google Cloud and enjoy solving real-time data engineering challenges, this is the perfect op...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    RecroBengaluru, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Bricks Engineer

    Data Bricks Engineer

    Relevance LabGreater Bengaluru Area, India
    SQL skills and hands-on experience using.AI-assisted development tools).The ideal candidate will be responsible for designing, developing, and optimizing data pipelines, supporting analytics worklo...Show moreLast updated: 18 hours ago
    • Promoted
    Lead Data Engineer [T500-21309]

    Lead Data Engineer [T500-21309]

    ANSRBengaluru, Karnataka, India
    ANSR is hiring for one of its clients.Martens is an iconic British brand founded in 1960 in Northamptonshire.Produced originally for workers looking for tough, durable boots, the brand was quickly ...Show moreLast updated: 16 days ago
    • Promoted
    • New!
    Data engineer - AWS - Inperson drive

    Data engineer - AWS - Inperson drive

    Live ConnectionsGreater Bengaluru Area, India
    Show moreLast updated: 18 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    DigitalzoneBengaluru, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 18 days ago
    • Promoted
    • New!
    Data Engineer I

    Data Engineer I

    LiciousGreater Bengaluru Area, India
    SDE 1 – Data Platform Engineer.We are looking for a passionate and motivated.Software Development Engineer (SDE 1) – Data Platform. Data Platform Engineering team at.In this role, you’ll design, bui...Show moreLast updated: 18 hours ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    VIDA Digital IdentityGreater Bengaluru Area, India
    At VIDA we’re building the future of digital identity.As a Data Engineer you’ll work across the stack—from platform and infrastructure to data pipelines and end-user tooling.You’ll help us moderniz...Show moreLast updated: 18 hours ago
    • Promoted
    Data Engineer – CDP

    Data Engineer – CDP

    Integers.AiBengaluru, IN
    Job Description : Data Engineer – CDP.Data Engineer with strong CDP expertise.The ideal candidate will have hands-on experience working with Customer Data Platforms—specifically Real-Time CDP and Sa...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Tata Consultancy ServicesGreater Bengaluru Area, India
    Previous experience as a data engineer or in a similar role.Must have experience with MS Azure services such as Data Lake Storage, Data Factory, Databricks, HDInsight, Azure SQL Database, Azure Syn...Show moreLast updated: 16 hours ago
    • Promoted
    • New!
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy ServicesGreater Bengaluru Area, India
    TCS has always been in the spotlight for being adept in the next big technologies.What we can offer you is a space to explore varied technologies and quench your techie soul.Required Skill Set : AWS...Show moreLast updated: 18 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalBengaluru, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer - Databricks

    Lead Data Engineer - Databricks

    Tredence Inc.Bengaluru, Karnataka, India
    Tredence is a global data science solutions provider founded in 2013 by Shub Bhowmick, Sumit Mehra, and Shashank Dubey focused on solving the last-mile problem in AI. Headquartered in San Jose, Cali...Show moreLast updated: 18 days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    ArcanaGreater Bengaluru Area, India
    Join our dynamic team at the forefront of cutting-edge technology as we seek a seasoned Senior Data Engineer.Embark on a journey where your deep-rooted expertise in computer science fundamentals, a...Show moreLast updated: 18 hours ago