Data Engineer

MyData Insights Pvt LtdPune, IN

18 hours ago

Job description

Role : Data Engineer

Experience : 6–12 years

Location : Remote

Engagement : Contract (4–6 Months)

Work Type : Remote

About the Role

We are seeking an experienced Data Engineer to support data modernization and analytics initiatives across multi-cloud environments. The ideal candidate has a strong background in building scalable data solutions on AWS, Azure, or GCP , along with hands-on expertise in CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices .

Experience working in Pharma or Life Sciences environments is a strong plus (not mandatory).

Key Responsibilities

Cloud Data Engineering

Design, build, and optimize scalable data pipelines across AWS, Azure, or GCP.
Develop ingestion, transformation, and orchestration pipelines using cloud-native services (e.g., AWS Glue, Azure Data Factory, GCP Dataflow).
Implement ETL / ELT workflows for large-scale structured and unstructured datasets.

CI / CD, Cloud Build & Deployment

Build and maintain CI / CD pipelines for infrastructure and application deployments.

Work with Azure DevOps, GitHub Actions, GitLab CI, Jenkins, or Google Cloud Build .

Ensure automated deployments, version control, and environment consistency.

Infrastructure as Code (IaC)

Use Terraform to design, provision, and manage cloud infrastructure.

Implement reusable IaC modules for multi-cloud data architecture.

Cloud Architecture & Operations

Work across AWS, Azure, and GCP to build secure, scalable, and cost-efficient data platforms.

Collaborate with architecture teams on network, security, IAM, and storage configurations.

Optimize data workflows for performance, cost, and reliability.

Data Integration & Analytics Support

Build data models, pipelines, and transformations to support analytics, ML, and reporting needs.

Work with Data Scientists, BI teams, and domain experts to ensure data availability and quality.

Documentation & Collaboration

Maintain clear technical documentation covering pipelines, architecture, and workflows.

Collaborate with cross-functional teams including cloud engineering, QA, and domain SMEs.

Required Skills

6–12 years of experience as a Data Engineer in cloud-driven environments.

Strong hands-on experience with at least one of the following cloud platforms :

AWS (Glue, Lambda, S3, EMR, Redshift)

Azure (ADF, Synapse, Databricks, Storage, Functions)

GCP (BigQuery, Dataflow, Cloud Build, Cloud Functions)

Strong experience with CI / CD pipelines (Azure DevOps, GitHub Actions, Jenkins, GCP Cloud Build).

Solid expertise in Terraform for IaC.

Strong Python or SQL experience for building data pipelines.

Experience with data modeling, ETL / ELT patterns, and distributed data processing.

Exposure to infrastructure and application deployment automation.

Good-to-Have Skills

Pharma / Life Sciences domain experience.

Experience with DataOps practices.

Familiarity with regulatory and compliance requirements (GxP, HIPAA preferred).

Experience with containerization (Docker, Kubernetes).

Create a job alert for this search

Data Engineer • Pune, IN

Related jobs

Promoted

Data Engineer

RecroPune, IN

Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

KPI PartnersPune, Maharashtra, India

KPI Partners is seeking a talented Data Engineer with expertise in STIBO (STEP) development to join our dynamic team.The ideal candidate will be responsible for designing, developing, and implement...Show moreLast updated: 14 days ago

Promoted

Data Engineer

EXLPune, Maharashtra, India

We are seeking an experienced GCP Data Engineer with strong expertise in designing, building, and managing scalable data pipelines and analytical solutions on Google Cloud Platform (GCP).The ideal ...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Tata Consultancy ServicesPune, IN

TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Persistent SystemsPune, Maharashtra, India

About Position : We are seeking for Data engineer with AWS, databricks experience.Role : Data Engineer - Location : All Persistent Location - Experience : 5 to 12 Years - Job Type : Full Time Employmen...Show moreLast updated: 30+ days ago

Promoted
New!

Data Engineer (Remote)

QAAgility TechnologiesPune, IN

Remote

The ideal candidate will be responsible for designing, developing, and maintaining robust data pipelines that support key business functions across the supply chain domain.This role requires strong...Show moreLast updated: 18 hours ago

Promoted

Lead Data Engineer

Persistent SystemsPune, Maharashtra, India

About Position : We’re looking for a Lead Technical Engineer who can bridge data engineering depth with FinOps insight.You’ll design and implement scalable data solutions across Databricks and Snow...Show moreLast updated: 4 days ago

Promoted

5676 - Data Engineer

EXLPune, Maharashtra, India

Location - Pune, Bangalore, Noida, Gurgaon, Hyderabad.The ideal candidate will have strong expertise in Snowflake, Hadoop ecosystem, PySpark, and SQL, and will play a key role in enabling data-driv...Show moreLast updated: 16 days ago

Promoted

Data Engineer

SynechronPune, Maharashtra, India

We have immediate opportunity for.Notice Period : Immediate to 30 Days.At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines cre...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

DigitalzonePune, IN

As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 16 days ago

Promoted
New!

Data Engineer

NexionPro ServicesPune, IN

PySpark-based data processing workflows.Collaborate with data architects, analysts, and cross-functional teams to understand business requirements and translate them into technical solutions.Optimi...Show moreLast updated: 18 hours ago

Promoted

Data Engineer

BayOne SolutionsPune, IN

We are seeking a highly experienced Data Engineer to join our MarTech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engine...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

K&K Talents - IndiaPune, IN

This position is with one of our clients in.Location : Chennai ,Bangalore , Hyderabad , Gurgaon , Bhopal, Pune,Jaipur.Experience in data engineering, with a focus on data architecture and pipeline d...Show moreLast updated: 30+ days ago

Promoted

AWS Data Engineer

Capgemini InventPune, Maharashtra, India

At Capgemini Invent, we believe difference drives change.As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to...Show moreLast updated: 1 day ago

Promoted

Lead Data Engineer

Searce IncPune, Maharashtra, India

Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 24 days ago

Promoted

Data Engineer

Insight GlobalPune, IN

GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

OWOWPune, IN

Data Engineer – AI-Powered Marketing Personalization Platform.AI-powered marketing personalization platform (V2.You’ll design and implement a robust multi-database infrastructure that enables real-...Show moreLast updated: 30+ days ago

Promoted
New!

Data Engineer

JIT Global Infosystems Pvt. Ltd.Pune, IN

Applications, Analytics, and Consulting services to clients worldwide.By combining technological expertise with deep domain knowledge, we ensure tangible improvements in business performance.Our ex...Show moreLast updated: 18 hours ago