Data EngineerMyData Insights Pvt Ltd • secunderabad, telangana, in

No longer accepting applications

Data Engineer

MyData Insights Pvt Ltd • secunderabad, telangana, in

8 days ago

Job description

Role : Data Engineer

Experience : 6–12 years

Location : Remote

Engagement : Contract (4–6 Months)

Work Type : Remote

About the Role

We are seeking an experienced Data Engineer to support data modernization and analytics initiatives across multi-cloud environments. The ideal candidate has a strong background in building scalable data solutions on AWS, Azure, or GCP , along with hands-on expertise in CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices .

Experience working in Pharma or Life Sciences environments is a strong plus (not mandatory).

Key Responsibilities

Cloud Data Engineering

Design, build, and optimize scalable data pipelines across AWS, Azure, or GCP.
Develop ingestion, transformation, and orchestration pipelines using cloud-native services (e.g., AWS Glue, Azure Data Factory, GCP Dataflow).
Implement ETL / ELT workflows for large-scale structured and unstructured datasets.

CI / CD, Cloud Build & Deployment

Build and maintain CI / CD pipelines for infrastructure and application deployments.

Work with Azure DevOps, GitHub Actions, GitLab CI, Jenkins, or Google Cloud Build .

Ensure automated deployments, version control, and environment consistency.

Infrastructure as Code (IaC)

Use Terraform to design, provision, and manage cloud infrastructure.

Implement reusable IaC modules for multi-cloud data architecture.

Cloud Architecture & Operations

Work across AWS, Azure, and GCP to build secure, scalable, and cost-efficient data platforms.

Collaborate with architecture teams on network, security, IAM, and storage configurations.

Optimize data workflows for performance, cost, and reliability.

Data Integration & Analytics Support

Build data models, pipelines, and transformations to support analytics, ML, and reporting needs.

Work with Data Scientists, BI teams, and domain experts to ensure data availability and quality.

Documentation & Collaboration

Maintain clear technical documentation covering pipelines, architecture, and workflows.

Collaborate with cross-functional teams including cloud engineering, QA, and domain SMEs.

Required Skills

6–12 years of experience as a Data Engineer in cloud-driven environments.

Strong hands-on experience with at least one of the following cloud platforms :

AWS (Glue, Lambda, S3, EMR, Redshift)

Azure (ADF, Synapse, Databricks, Storage, Functions)

GCP (BigQuery, Dataflow, Cloud Build, Cloud Functions)

Strong experience with CI / CD pipelines (Azure DevOps, GitHub Actions, Jenkins, GCP Cloud Build).

Solid expertise in Terraform for IaC.

Strong Python or SQL experience for building data pipelines.

Experience with data modeling, ETL / ELT patterns, and distributed data processing.

Exposure to infrastructure and application deployment automation.

Good-to-Have Skills

Pharma / Life Sciences domain experience.

Experience with DataOps practices.

Familiarity with regulatory and compliance requirements (GxP, HIPAA preferred).

Experience with containerization (Docker, Kubernetes).

Create a job alert for this search

Data Engineer • secunderabad, telangana, in

Related jobs

Customer Engineer (Data Engineer)

Konecta • Hyderabad, IN

In this role, you will be the technical point of contact for the customer – a trusted partner for their IT leadership – as the primary engineer on the project, working with multifunctional teams bo...Show more

Last updated: 5 days ago • Promoted

Data Engineer

Prudent Technologies and Consulting, Inc. • Hyderabad, Telangana, India

Seeking an experienced Senior Data Engineer with over 9 years of industry experience to architect, build, and manage advanced data pipelines and platforms in a cloud environment.The ideal candidate...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

Cliff IT Solutions Inc. • Hyderabad, Republic Of India, IN

Company Description Cliff IT Solutions is a leading provider of Identity Management and Security governance solutions for onsite and cloud applications. Our services help organizations reduce risk a...Show more

Last updated: 12 days ago • Promoted

Data Engineer - Palantir Foundry

NP Group • Hyderabad, IN

Data Engineer - Palantir Foundry, Workshop, Pyspark & Typescript.Long Term (initially 6 months) full time contract.We have an immediate requirement for an experienced Data Engineer to join the glob...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

HCLTech • Hyderabad, Telangana, India

Data Engineer - Databricks Job Description.The Data Engineer - Databricks will be responsible for building and optimizing our data pipelines, architectures, and data sets.He will work closely with ...Show more

Last updated: 22 days ago • Promoted

Data Engineer

Randstad Enterprise • Hyderabad, IN

Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

RapidBrains • Hyderabad, Telangana, India

Design, develop, and optimize large-scale data analytics and data warehouse solutions using Azure Data Factory and Azure Databricks. Build and maintain data lake architectures to process multi-forma...Show more

Last updated: 1 day ago • Promoted

Data Engineer

Radiant Digital • Hyderabad, Telangana, India

As a Data Engineer, you will play a key role in designing, developing, and optimizing data pipelines and storage solutions in a complex, enterprise-scale data warehouse environment.You will contrib...Show more

Last updated: 3 days ago • Promoted

Data Engineer Lead

JRD Systems • Hyderabad, Telangana, India

The ideal candidate will have a strong background in.Databricks, Azure Data Factory, Alteryx, Ab Initio, Talend, and Informatica. This role will lead the design and delivery of.Databricks (PySpark, ...Show more

Last updated: 9 days ago • Promoted

Data Engineer

Vriba Solutions • Hyderabad, IN

Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions. Data validation, quality & cleansing.Translate busin...Show more

Last updated: 30+ days ago • Promoted

Lead Data Engineer

nexocean • Hyderabad, Telangana, India

Job Description : We are excited to announce an opening for Lead Data Engineer ! Skills Required : SQL, Python, Snowflake, ADF, ETL, Data Pipeline Experience Range : 8 - 12 years Job Description...Show more

Last updated: 1 day ago • Promoted

Data Engineer

ADP • Hyderabad, Telangana, India

Position : Data Engineer with 3 to 10 Years experience in PySpark and Data bricks.In this role candidate will be responsible for understanding complex data sets, managing multiple disparate data so...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

Straive • Hyderabad, Telangana, India

Design, build and maintain scalable.Implement core ETL / ELT logic in Scala and Python; author efficient Spark DataFrame / Dataset jobs. Write and optimize complex SQL for ingestion, transformation and ...Show more

Last updated: 11 days ago • Promoted

Lead Data Engineer

ValueMomentum • Hyderabad, Telangana, India

Primary skills : Databricks, PySpark, SQL.Secondary skills : Advanced SQL, Azure Data Factory, and Azure Data Lake.About the Job We are seeking a Tech Lead –. Databricks Data Engineer with experience ...Show more

Last updated: 1 day ago • Promoted

Data Engineer

Insight Global • Hyderabad, IN

GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

Grantify • Hyderabad, IN

Grantify is an innovative education platform that connects students and universities through a transparent admissions and tuition-matching ecosystem. By aligning student budgets and academic aspirat...Show more

Last updated: 22 hours ago • Promoted • New!

Data Engineer

Travel & Payments • Hyderabad, Telangana, India

At Yuno, we are building the payment infrastructure that enables all companies to participate in the global market.Founded by a team of seasoned experts in the payments and IT industries, Yuno prov...Show more

Last updated: 30+ days ago • Promoted

Data Engineer / Databricks

ValueMomentum • Hyderabad, Telangana, India

Databricks Engineer-Databricks.Primary skills : Databricks, PySpark, SQL.Secondary skills : Advanced SQL, Azure Data Factory, and Azure Data lake. Design and develop ETL pipelines using ADF for data i...Show more

Last updated: 1 day ago • Promoted