Data EngineerMyData Insights Pvt Ltd • Kolkata, IN
Data Engineer
MyData Insights Pvt Ltd • Kolkata, IN
5 days ago
Job descriptionBuild and maintain CI / CD pipelines for infrastructure and application deployments. Work with Azure DevOps, GitHub Actions, GitLab CI, Jenkins, or Google Cloud Build . Ensure automated deployments, version control, and environment consistency. Use Terraform to design, provision, and manage cloud infrastructure. Implement reusable IaC modules for multi-cloud data architecture. Work across AWS, Azure, and GCP to build secure, scalable, and cost-efficient data platforms. Collaborate with architecture teams on network, security, IAM, and storage configurations. Optimize data workflows for performance, cost, and reliability. Build data models, pipelines, and transformations to support analytics, ML, and reporting needs. Work with Data Scientists, BI teams, and domain experts to ensure data availability and quality. Maintain clear technical documentation covering pipelines, architecture, and workflows. Collaborate with cross-functional teams including cloud engineering, QA, and domain SMEs. 6–12 years of experience as a Data Engineer in cloud-driven environments. Strong hands-on experience with at least one of the following cloud platforms : AWS (Glue, Lambda, S3, EMR, Redshift) Azure (ADF, Synapse, Databricks, Storage, Functions) GCP (BigQuery, Dataflow, Cloud Build, Cloud Functions) Strong experience with CI / CD pipelines (Azure DevOps, GitHub Actions, Jenkins, GCP Cloud Build). Solid expertise in Terraform for IaC. Strong Python or SQL experience for building data pipelines. Experience with data modeling, ETL / ELT patterns, and distributed data processing. Exposure to infrastructure and application deployment automation. Pharma / Life Sciences domain experience. Experience with DataOps practices. Familiarity with regulatory and compliance requirements (GxP, HIPAA preferred). Experience with containerization (Docker, Kubernetes).
Role : Data Engineer
Experience : 6–12 years
Location : Remote
Engagement : Contract (4–6 Months)
Work Type : Remote
About the Role
We are seeking an experienced Data Engineer to support data modernization and analytics initiatives across multi-cloud environments. The ideal candidate has a strong background in building scalable data solutions on AWS, Azure, or GCP , along with hands-on expertise in CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices .
Experience working in Pharma or Life Sciences environments is a strong plus (not mandatory).
Key Responsibilities
Cloud Data Engineering
- Design, build, and optimize scalable data pipelines across AWS, Azure, or GCP.
- Develop ingestion, transformation, and orchestration pipelines using cloud-native services (e.g., AWS Glue, Azure Data Factory, GCP Dataflow).
- Implement ETL / ELT workflows for large-scale structured and unstructured datasets.
CI / CD, Cloud Build & Deployment
Infrastructure as Code (IaC)
Cloud Architecture & Operations
Data Integration & Analytics Support
Documentation & Collaboration
Required Skills
Good-to-Have Skills
Create a job alert for this search
Data Engineer • Kolkata, IN
Related jobs
Data Engineer
Vriba Solutions • Kolkata, IN
Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions.
Data validation, quality & cleansing.Translate busin...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
RapidBrains • Kolkata, IN
Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer with deep expertise in Azure Data Engineering to design, build, and optimize large-scale data pipelines.The ideal candidate...Show more
Last updated: 12 days ago • Promoted
Data Engineer
System Soft Technologies • Kolkata, IN
Location : Remote (3–4-hour time zone overlaps with EST if off shore).Experience with next flow is required, as the consultant will make targeted enhancements to existing workflows and pipelines.Whi...Show more
Last updated: 1 day ago • Promoted
Customer Engineer (Data Engineer)
Konecta • Kolkata, IN
In this role, you will be the technical point of contact for the customer – a trusted partner for their IT leadership – as the primary engineer on the project, working with multifunctional teams bo...Show more
Last updated: 2 days ago • Promoted
Data Engineer (GCP)
HISH IT SERVICES • Kolkata, IN
We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery).
This role requires a hands-on developer who can collaborate closely wit...Show more
Last updated: 13 days ago • Promoted
Data Engineer
Insight Global • Kolkata, IN
GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts.
Proficiency in ETL / ELT pipeline development...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Randstad Enterprise • Kolkata, IN
Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ).
GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Digitalzone • Kolkata, IN
As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.
Develop and maintain scalable ETL / ELT pipelines using Py...Show more
Last updated: 21 days ago • Promoted
Data Engineer
Recro • Kolkata, IN
Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake.
AI Data Enablement : Collaborate wi...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
BayOne Solutions • Kolkata, IN
We are seeking a highly experienced Data Engineer to join our MarTech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engine...Show more
Last updated: 30+ days ago • Promoted
GCP Data Engineer
PamTen Inc • Kolkata, IN
You will work ongoing support activities and support project efforts as needed.You triage identified issues across Account source platforms, integrations and Customer Data Hub.You will analyze and ...Show more
Last updated: 14 days ago • Promoted
Data Engineer - Palantir Foundry
NP Group • kolkata, India
Data Engineer - Palantir Foundry, Workshop, Pyspark & Typescript.Long Term (initially 6 months) full time contract.We have an immediate requirement for an experienced Data Engineer to join the glob...Show more
Last updated: 11 days ago • Promoted
Aws Data Engineer
LTIMindtree • Kolkata, Republic Of India, IN
Greetings from LTIMindtree !!!.We are really impressed by your AWS experience.We are having multiple opportunities and projects which are based on AWS, Glue, Lamda.
I’d love to tell you a little mor...Show more
Last updated: 2 days ago • Promoted
Senior Data Engineer
Mindlance • Kolkata, IN
We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show more
Last updated: 5 days ago • Promoted
Data Engineer
Tata Consultancy Services • Kolkata, IN
Role : Databricks Senior Developer.Required Technical Skill Set : Databricks, Spark and Data Migration experience.Desired Competencies (Technical / Behavioral Competency).
Databricks, Spark and Data M...Show more
Last updated: 30+ days ago • Promoted
Data Engineer (Data brick)
Tata Consultancy Services • Kolkata, West Bengal, India
TCS has been a great pioneer in feeding the fire of young techies like you.We are global leaders in the technology arena and there's nothing that can stop us from growing together.Databricks, Spark...Show more
Last updated: 1 day ago • Promoted
Data Engineer
IntraEdge • Kolkata, IN
We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team.
You will be responsible for building scalable and reli...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Aceolution • Kolkata, IN
Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show more
Last updated: 30+ days ago • Promoted