Data EngineerMyData Insights Pvt Ltd • pune, maharashtra, in

No longer accepting applications

Data Engineer

MyData Insights Pvt Ltd • pune, maharashtra, in

6 days ago

Job description

Role : Data Engineer

Experience : 6–12 years

Location : Remote

Engagement : Contract (4–6 Months)

Work Type : Remote

About the Role

We are seeking an experienced Data Engineer to support data modernization and analytics initiatives across multi-cloud environments. The ideal candidate has a strong background in building scalable data solutions on AWS, Azure, or GCP , along with hands-on expertise in CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices .

Experience working in Pharma or Life Sciences environments is a strong plus (not mandatory).

Key Responsibilities

Cloud Data Engineering

Design, build, and optimize scalable data pipelines across AWS, Azure, or GCP.
Develop ingestion, transformation, and orchestration pipelines using cloud-native services (e.g., AWS Glue, Azure Data Factory, GCP Dataflow).
Implement ETL / ELT workflows for large-scale structured and unstructured datasets.

CI / CD, Cloud Build & Deployment

Build and maintain CI / CD pipelines for infrastructure and application deployments.

Work with Azure DevOps, GitHub Actions, GitLab CI, Jenkins, or Google Cloud Build .

Ensure automated deployments, version control, and environment consistency.

Infrastructure as Code (IaC)

Use Terraform to design, provision, and manage cloud infrastructure.

Implement reusable IaC modules for multi-cloud data architecture.

Cloud Architecture & Operations

Work across AWS, Azure, and GCP to build secure, scalable, and cost-efficient data platforms.

Collaborate with architecture teams on network, security, IAM, and storage configurations.

Optimize data workflows for performance, cost, and reliability.

Data Integration & Analytics Support

Build data models, pipelines, and transformations to support analytics, ML, and reporting needs.

Work with Data Scientists, BI teams, and domain experts to ensure data availability and quality.

Documentation & Collaboration

Maintain clear technical documentation covering pipelines, architecture, and workflows.

Collaborate with cross-functional teams including cloud engineering, QA, and domain SMEs.

Required Skills

6–12 years of experience as a Data Engineer in cloud-driven environments.

Strong hands-on experience with at least one of the following cloud platforms :

AWS (Glue, Lambda, S3, EMR, Redshift)

Azure (ADF, Synapse, Databricks, Storage, Functions)

GCP (BigQuery, Dataflow, Cloud Build, Cloud Functions)

Strong experience with CI / CD pipelines (Azure DevOps, GitHub Actions, Jenkins, GCP Cloud Build).

Solid expertise in Terraform for IaC.

Strong Python or SQL experience for building data pipelines.

Experience with data modeling, ETL / ELT patterns, and distributed data processing.

Exposure to infrastructure and application deployment automation.

Good-to-Have Skills

Pharma / Life Sciences domain experience.

Experience with DataOps practices.

Familiarity with regulatory and compliance requirements (GxP, HIPAA preferred).

Experience with containerization (Docker, Kubernetes).

Create a job alert for this search

Data Engineer • pune, maharashtra, in

Related jobs

Data Engineer

Recro • Pune, IN

Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show more

Last updated: 30+ days ago • Promoted

AWS Data Engineer

Capgemini Invent • Pune, Maharashtra, India

At Capgemini Invent, we believe difference drives change.As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to...Show more

Last updated: 7 days ago • Promoted

Data Engineer

METRO / MAKRO • Pune, Maharashtra, India

Building and maintaining dashboards tailored to the target audience to track key KPIs and in-depth reports for a heavy ML-driven product. .Digging into data to uncover new use cases and identi...Show more

Last updated: 12 days ago • Promoted

Data Engineer

Vriba Solutions • Pune, IN

Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions. Data validation, quality & cleansing.Translate busin...Show more

Last updated: 30+ days ago • Promoted

Lead Data Engineer

INDI Staffing Services • Pune, IN

At INDI, we're passionate about empowering individuals and businesses worldwide.Our cutting-edge recruiters connect leading companies with top talent, fostering a dynamic environment where innovati...Show more

Last updated: 22 days ago • Promoted

5676 - Data Engineer

EXL • Pune, Maharashtra, India

Location - Pune, Bangalore, Noida, Gurgaon, Hyderabad.The ideal candidate will have strong expertise in Snowflake, Hadoop ecosystem, PySpark, and SQL, and will play a key role in enabling data-driv...Show more

Last updated: 22 days ago • Promoted

Data Engineer

Synechron • Pune, Maharashtra, India

We have immediate opportunity for.Notice Period : Immediate to 30 Days.At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines cre...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

Digitalzone • Pune, IN

As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show more

Last updated: 22 days ago • Promoted

Data Engineer

Randstad Enterprise • Pune, IN

Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

BayOne Solutions • Pune, IN

We are seeking a highly experienced Data Engineer to join our MarTech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engine...Show more

Last updated: 30+ days ago • Promoted

Lead Data Engineer

Searce Inc • Pune, Maharashtra, India

Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

Persistent Systems • pune, maharashtra, in

We are seeking for Data engineer with AWS, databricks experience.Location : All Persistent Location.Job Type : Full Time Employment. Must have knowledge and working experience in Databricks, PySpark a...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

Insight Global • Pune, IN

GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show more

Last updated: 30+ days ago • Promoted

Data Engineer - Palantir Foundry

NP Group • pune, India

Data Engineer - Palantir Foundry, Workshop, Pyspark & Typescript.Long Term (initially 6 months) full time contract.We have an immediate requirement for an experienced Data Engineer to join the glob...Show more

Last updated: 12 days ago • Promoted

Senior Data Engineer ( Palantir)

Lear Corporation • Pune, Maharashtra, India

Lear, a global automotive technology leader in Seating and E-Systems, is Making every drive better by delivering intelligent in-vehicle experiences for customers around the world.With over 100 year...Show more

Last updated: 19 days ago • Promoted

Data Engineer l

Confidential • Pune, India

We are Allvue Systems, the leading provider of software solutions for the Private Capital and Credit markets.Whether a client wants an end-to-end technology suite, or independently focused modules,...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

Azoca Technologies • Pune, IN

We are seeking an experienced Data Engineer with strong hands-on expertise in Microsoft Fabric to design, build, and maintain scalable data solutions supporting global clients.The ideal candidate w...Show more

Last updated: 15 hours ago • Promoted • New!

Customer Engineer (Data Engineer)

Konecta • pune, India

In this role, you will be the technical point of contact for the customer – a trusted partner for their IT leadership – as the primary engineer on the project, working with multifunctional teams bo...Show more

Last updated: 3 days ago • Promoted