Data EngineerMyData Insights Pvt Ltd • Madurai, IN

Data Engineer

MyData Insights Pvt Ltd • Madurai, IN

6 days ago

Job description

Role : Data Engineer

Experience : 6–12 years

Location : Remote

Engagement : Contract (4–6 Months)

Work Type : Remote

About the Role

We are seeking an experienced Data Engineer to support data modernization and analytics initiatives across multi-cloud environments. The ideal candidate has a strong background in building scalable data solutions on AWS, Azure, or GCP , along with hands-on expertise in CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices .

Experience working in Pharma or Life Sciences environments is a strong plus (not mandatory).

Key Responsibilities

Cloud Data Engineering

Design, build, and optimize scalable data pipelines across AWS, Azure, or GCP.
Develop ingestion, transformation, and orchestration pipelines using cloud-native services (e.g., AWS Glue, Azure Data Factory, GCP Dataflow).
Implement ETL / ELT workflows for large-scale structured and unstructured datasets.

CI / CD, Cloud Build & Deployment

Build and maintain CI / CD pipelines for infrastructure and application deployments.

Work with Azure DevOps, GitHub Actions, GitLab CI, Jenkins, or Google Cloud Build .

Ensure automated deployments, version control, and environment consistency.

Infrastructure as Code (IaC)

Use Terraform to design, provision, and manage cloud infrastructure.

Implement reusable IaC modules for multi-cloud data architecture.

Cloud Architecture & Operations

Work across AWS, Azure, and GCP to build secure, scalable, and cost-efficient data platforms.

Collaborate with architecture teams on network, security, IAM, and storage configurations.

Optimize data workflows for performance, cost, and reliability.

Data Integration & Analytics Support

Build data models, pipelines, and transformations to support analytics, ML, and reporting needs.

Work with Data Scientists, BI teams, and domain experts to ensure data availability and quality.

Documentation & Collaboration

Maintain clear technical documentation covering pipelines, architecture, and workflows.

Collaborate with cross-functional teams including cloud engineering, QA, and domain SMEs.

Required Skills

6–12 years of experience as a Data Engineer in cloud-driven environments.

Strong hands-on experience with at least one of the following cloud platforms :

AWS (Glue, Lambda, S3, EMR, Redshift)

Azure (ADF, Synapse, Databricks, Storage, Functions)

GCP (BigQuery, Dataflow, Cloud Build, Cloud Functions)

Strong experience with CI / CD pipelines (Azure DevOps, GitHub Actions, Jenkins, GCP Cloud Build).

Solid expertise in Terraform for IaC.

Strong Python or SQL experience for building data pipelines.

Experience with data modeling, ETL / ELT patterns, and distributed data processing.

Exposure to infrastructure and application deployment automation.

Good-to-Have Skills

Pharma / Life Sciences domain experience.

Experience with DataOps practices.

Familiarity with regulatory and compliance requirements (GxP, HIPAA preferred).

Experience with containerization (Docker, Kubernetes).

Create a job alert for this search

Data Engineer • Madurai, IN

Related jobs

Data Engineer

Insight Global • Madurai, IN

GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show more

Last updated: 30+ days ago • Promoted

Customer Engineer (Data Engineer)

Konecta • Madurai, IN

In this role, you will be the technical point of contact for the customer – a trusted partner for their IT leadership – as the primary engineer on the project, working with multifunctional teams bo...Show more

Last updated: 3 days ago • Promoted

Data Engineer

Randstad Enterprise • Madurai, IN

Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show more

Last updated: 30+ days ago • Promoted

Senior Data Engineer

RapidBrains • Madurai, IN

Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer with deep expertise in Azure Data Engineering to design, build, and optimize large-scale data pipelines.The ideal candidate...Show more

Last updated: 13 days ago • Promoted

Data Engineer

Recro • Madurai, IN

Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show more

Last updated: 30+ days ago • Promoted

Data Engineer - Palantir Foundry

NP Group • madurai, India

Data Engineer - Palantir Foundry, Workshop, Pyspark & Typescript.Long Term (initially 6 months) full time contract.We have an immediate requirement for an experienced Data Engineer to join the glob...Show more

Last updated: 12 days ago • Promoted

Data Engineer

Tata Consultancy Services • Madurai, IN

Data Engineering & Azure ecosystem).We are looking for a passionate.This role involves working on ETL processes, data warehousing, and analytics solutions to enable high-quality insights for busine...Show more

Last updated: 30+ days ago • Promoted

GCP Data Engineer

Xsell Resources • madurai, tamil nadu, in

Seeking a GCP Certified Data Engineer to work remotely from India for our Fortune 5 healthcare client in the US.No notice periods more than 15 days. GCP Google Cloud Professional Data Engineer Certi...Show more

Last updated: 21 days ago • Promoted

Data Engineer

Straive • Madurai, Tamil Nadu, India

Job Title : Data Engineer Location : Remote Job Type : Full time Years of Experience- 6-9 years About Straive : Straive is a market leading Content and Data Technology company providing data services...Show more

Last updated: 30+ days ago • Promoted

Data Engineer - Offshore

iO Associates • Madurai, Tamil Nadu, India

Data Engineer Duration : 12 Months Working Pattern : 5 Working Days per Month Location : Remote Overview We are seeking an experienced Data Engineer with strong hands-on expertise in Snowflake and Py...Show more

Last updated: 12 days ago • Promoted

Snowflake Data Engineer

Newpage Solutions • madurai, tamil nadu, in

Location : Remote | Type : Contract.Newpage Solutions is a global digital health innovation company helping people live longer, healthier lives. We partner with life sciences organizations—including p...Show more

Last updated: 22 days ago • Promoted

Data Engineer

BayOne Solutions • Madurai, IN

We are seeking a highly experienced Data Engineer to join our MarTech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engine...Show more

Last updated: 30+ days ago • Promoted

Data Engineer (GCP)

HISH IT SERVICES • Madurai, IN

We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery). This role requires a hands-on developer who can collaborate closely wit...Show more

Last updated: 14 days ago • Promoted

Data Engineer

Digitalzone • Madurai, IN

As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show more

Last updated: 22 days ago • Promoted

Data Engineer

IntraEdge • Madurai, IN

We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

Vriba Solutions • Madurai, IN

Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions. Data validation, quality & cleansing.Translate busin...Show more

Last updated: 30+ days ago • Promoted

Lead Data Engineer

Cimpress • Madurai, Tamil Nadu, India

Our Team : Enterprise Business Solutions Vista’s Enterprise Business Solutions (EBS) domain is working to make our company one of the most data-driven organizations to support Finance, Supply Chain,...Show more

Last updated: 22 days ago • Promoted

Data Engineer

System Soft Technologies • Madurai, Tamil Nadu, India

Title : Data Engineer Location : Remote (3–4-hour time zone overlaps with EST if off shore) Duration : 6 months Musts : Python NextFlow Plus : Computer Vision Image Processing Project Overview : Exper...Show more

Last updated: 1 day ago • Promoted