Data EngineerMyData Insights Pvt Ltd • Mangalore, IN

Data Engineer

MyData Insights Pvt Ltd • Mangalore, IN

6 days ago

Job description

Role : Data Engineer

Experience : 6–12 years

Location : Remote

Engagement : Contract (4–6 Months)

Work Type : Remote

About the Role

We are seeking an experienced Data Engineer to support data modernization and analytics initiatives across multi-cloud environments. The ideal candidate has a strong background in building scalable data solutions on AWS, Azure, or GCP , along with hands-on expertise in CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices .

Experience working in Pharma or Life Sciences environments is a strong plus (not mandatory).

Key Responsibilities

Cloud Data Engineering

Design, build, and optimize scalable data pipelines across AWS, Azure, or GCP.
Develop ingestion, transformation, and orchestration pipelines using cloud-native services (e.g., AWS Glue, Azure Data Factory, GCP Dataflow).
Implement ETL / ELT workflows for large-scale structured and unstructured datasets.

CI / CD, Cloud Build & Deployment

Build and maintain CI / CD pipelines for infrastructure and application deployments.

Work with Azure DevOps, GitHub Actions, GitLab CI, Jenkins, or Google Cloud Build .

Ensure automated deployments, version control, and environment consistency.

Infrastructure as Code (IaC)

Use Terraform to design, provision, and manage cloud infrastructure.

Implement reusable IaC modules for multi-cloud data architecture.

Cloud Architecture & Operations

Work across AWS, Azure, and GCP to build secure, scalable, and cost-efficient data platforms.

Collaborate with architecture teams on network, security, IAM, and storage configurations.

Optimize data workflows for performance, cost, and reliability.

Data Integration & Analytics Support

Build data models, pipelines, and transformations to support analytics, ML, and reporting needs.

Work with Data Scientists, BI teams, and domain experts to ensure data availability and quality.

Documentation & Collaboration

Maintain clear technical documentation covering pipelines, architecture, and workflows.

Collaborate with cross-functional teams including cloud engineering, QA, and domain SMEs.

Required Skills

6–12 years of experience as a Data Engineer in cloud-driven environments.

Strong hands-on experience with at least one of the following cloud platforms :

AWS (Glue, Lambda, S3, EMR, Redshift)

Azure (ADF, Synapse, Databricks, Storage, Functions)

GCP (BigQuery, Dataflow, Cloud Build, Cloud Functions)

Strong experience with CI / CD pipelines (Azure DevOps, GitHub Actions, Jenkins, GCP Cloud Build).

Solid expertise in Terraform for IaC.

Strong Python or SQL experience for building data pipelines.

Experience with data modeling, ETL / ELT patterns, and distributed data processing.

Exposure to infrastructure and application deployment automation.

Good-to-Have Skills

Pharma / Life Sciences domain experience.

Experience with DataOps practices.

Familiarity with regulatory and compliance requirements (GxP, HIPAA preferred).

Experience with containerization (Docker, Kubernetes).

Create a job alert for this search

Data Engineer • Mangalore, IN

Related jobs

Data Engineer

Azoca Technologies • Mangalore, IN

We are seeking an experienced Data Engineer with strong hands-on expertise in Microsoft Fabric to design, build, and maintain scalable data solutions supporting global clients.The ideal candidate w...Show more

Last updated: 12 hours ago • Promoted • New!

Data Engineer

Vriba Solutions • Mangalore, IN

Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions. Data validation, quality & cleansing.Translate busin...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

Tata Consultancy Services • Mangalore, IN

Locations : Hyderabad, Kolkata, Noida, Chennai, Bangalore.Designing and building Databricks data pipelines is required.Experience in transforming the data using Azure Databricks & Delta lake.Hands-o...Show more

Last updated: 30+ days ago • Promoted

Senior Data Engineer

RapidBrains • Mangalore, IN

Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer with deep expertise in Azure Data Engineering to design, build, and optimize large-scale data pipelines.The ideal candidate...Show more

Last updated: 13 days ago • Promoted

Data Engineer

Digitalzone • Mangalore, IN

As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show more

Last updated: 22 days ago • Promoted

Data Engineer

Insight Global • Mangalore, IN

GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show more

Last updated: 30+ days ago • Promoted

Customer Engineer (Data Engineer)

Konecta • Mangalore, IN

In this role, you will be the technical point of contact for the customer – a trusted partner for their IT leadership – as the primary engineer on the project, working with multifunctional teams bo...Show more

Last updated: 3 days ago • Promoted

Data Engineer

BayOne Solutions • Mangalore, IN

We are seeking a highly experienced Data Engineer to join our MarTech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engine...Show more

Last updated: 30+ days ago • Promoted

AWS Data Engineer

Brillio • mangalore, karnataka, in

We’re Hiring : AWS Data Engineer.Locations : Open (India – Bangalore, Pune, Hyderabad, Chennai, Gurgaon).Design, develop, and maintain scalable data pipelines on AWS. Implement ETL workflows and data ...Show more

Last updated: 7 hours ago • Promoted • New!

Data Engineer

Recro • Mangalore, IN

Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

Randstad Enterprise • Mangalore, IN

Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show more

Last updated: 30+ days ago • Promoted

Senior Data Engineer

Meril • mangalore, karnataka, in

We're Hiring : Senior Data Engineer.We are looking for a highly skilled.If you are passionate about modern data architectures, cloud platforms, and high-performance engineering, we want to meet you....Show more

Last updated: 7 hours ago • Promoted • New!

Data Engineer - STIBO (STEP)

KPI Partners • Mangalore, IN

KPI Partners is seeking a talented.The ideal candidate will be responsible for designing, developing, and implementing data solutions that enhance our data management practices and streamline proce...Show more

Last updated: 12 hours ago • Promoted • New!

Senior Data Engineer

Mindlance • Mangalore, IN

We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show more

Last updated: 6 days ago • Promoted

Data Engineer

IntraEdge • Mangalore, IN

We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show more

Last updated: 30+ days ago • Promoted

Data Engineer (GCP)

HISH IT SERVICES • Mangalore, IN

We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery). This role requires a hands-on developer who can collaborate closely wit...Show more

Last updated: 14 days ago • Promoted

GCP Data Engineer

Capgemini Invent • mangalore, karnataka, in

At Capgemini Invent, we believe difference drives change.As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to...Show more

Last updated: 7 hours ago • Promoted • New!

Data Engineer - Palantir Foundry

NP Group • mangalore, karnataka, in

Data Engineer - Palantir Foundry, Workshop, Pyspark & Typescript.Long Term (initially 6 months) full time contract.We have an immediate requirement for an experienced Data Engineer to join the glob...Show more

Last updated: 30+ days ago • Promoted