Data Engineer
MyData Insights Pvt LtdChennai, IN2 days ago
Job descriptionBuild and maintain CI / CD pipelines for infrastructure and application deployments. Work with Azure DevOps, GitHub Actions, GitLab CI, Jenkins, or Google Cloud Build . Ensure automated deployments, version control, and environment consistency. Use Terraform to design, provision, and manage cloud infrastructure. Implement reusable IaC modules for multi-cloud data architecture. Work across AWS, Azure, and GCP to build secure, scalable, and cost-efficient data platforms. Collaborate with architecture teams on network, security, IAM, and storage configurations. Optimize data workflows for performance, cost, and reliability. Build data models, pipelines, and transformations to support analytics, ML, and reporting needs. Work with Data Scientists, BI teams, and domain experts to ensure data availability and quality. Maintain clear technical documentation covering pipelines, architecture, and workflows. Collaborate with cross-functional teams including cloud engineering, QA, and domain SMEs. 6–12 years of experience as a Data Engineer in cloud-driven environments. Strong hands-on experience with at least one of the following cloud platforms : AWS (Glue, Lambda, S3, EMR, Redshift) Azure (ADF, Synapse, Databricks, Storage, Functions) GCP (BigQuery, Dataflow, Cloud Build, Cloud Functions) Strong experience with CI / CD pipelines (Azure DevOps, GitHub Actions, Jenkins, GCP Cloud Build). Solid expertise in Terraform for IaC. Strong Python or SQL experience for building data pipelines. Experience with data modeling, ETL / ELT patterns, and distributed data processing. Exposure to infrastructure and application deployment automation. Pharma / Life Sciences domain experience. Experience with DataOps practices. Familiarity with regulatory and compliance requirements (GxP, HIPAA preferred). Experience with containerization (Docker, Kubernetes).
Role : Data Engineer
Experience : 6–12 years
Location : Remote
Engagement : Contract (4–6 Months)
Work Type : Remote
About the Role
We are seeking an experienced Data Engineer to support data modernization and analytics initiatives across multi-cloud environments. The ideal candidate has a strong background in building scalable data solutions on AWS, Azure, or GCP , along with hands-on expertise in CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices .
Experience working in Pharma or Life Sciences environments is a strong plus (not mandatory).
Key Responsibilities
Cloud Data Engineering
- Design, build, and optimize scalable data pipelines across AWS, Azure, or GCP.
- Develop ingestion, transformation, and orchestration pipelines using cloud-native services (e.g., AWS Glue, Azure Data Factory, GCP Dataflow).
- Implement ETL / ELT workflows for large-scale structured and unstructured datasets.
CI / CD, Cloud Build & Deployment
Infrastructure as Code (IaC)
Cloud Architecture & Operations
Data Integration & Analytics Support
Documentation & Collaboration
Required Skills
Good-to-Have Skills
Create a job alert for this search
Data Engineer • Chennai, IN
Related jobs
- Promoted
Data Engineer
DigitalzoneChennai, IN As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.
Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 19 days ago
- Promoted
Data Engineer – CDP
Integers.AiChennai, IN Job Description : Data Engineer – CDP.Data Engineer with strong CDP expertise.The ideal candidate will have hands-on experience working with Customer Data Platforms—specifically Real-Time CDP and Sa...Show moreLast updated: 1 day ago
- Promoted
Data Engineer
MastekChennai, Tamil Nadu, India Work closely with our data science team to help build complex algorithms that provide unique insights into our data.Use agile software development processes to make iterative improvements to our ba...Show moreLast updated: 1 day ago
- Promoted
GCP Data Engineer
Tata Consultancy ServicesChennai, Tamil Nadu, India Familiarity with CI / CD pipelines and version control (e.Strong problem-solving skills and ability to work in a fast-paced environment.
GCP Professional Data Engineer certification.Experience with da...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer (GCP)
HISH IT SERVICESChennai, IN We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery).
This role requires a hands-on developer who can collaborate closely wit...Show moreLast updated: 10 days ago
- Promoted
Data Engineer
RecroChennai, IN Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake.
AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
EXLChennai, Tamil Nadu, India Collaborate with project stakeholders (client) to identify product and technical requirements.Develop, implement, and tune large-scale distributed systems and pipelines that process large volume of...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Tata Consultancy ServicesChennai, IN TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
SGS & CoChennai, Tamil Nadu, India Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in.
The ideal candidate will play a ke...Show moreLast updated: 19 days ago
- Promoted
Data Engineer
JMAN GroupChennai, Tamil Nadu, India JMAN Group is a fast-growing data engineering & data science consultancy.We work primarily with Private Equity Funds and their Portfolio Companies to create commercial value using Data & Artificial...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
BayOne SolutionsChennai, IN We are seeking a highly experienced Data Engineer to join our MarTech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engine...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Insight GlobalChennai, IN GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts.
Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
loanDNAChennai, Tamil Nadu, India We are seeking an experienced Snowflake Developer with a minimum of 5 years of hands-on experience in Snowflake development, integration, migration, and deployment.
The ideal candidate will be respo...Show moreLast updated: 15 days ago
- Promoted
Data Engineer
JIT Global Infosystems Pvt. Ltd.Chennai, Tamil Nadu, India Applications, Analytics, and Consulting services to clients worldwide.By combining technological expertise with deep domain knowledge, we ensure tangible improvements in business performance.Our ex...Show moreLast updated: 1 day ago
- Promoted
Data Engineer
Randstad EnterpriseChennai, IN Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ).
GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show moreLast updated: 30+ days ago
- Promoted
Lead Data Engineer
JMAN GroupChennai, Tamil Nadu, India JMAN Group is a fast-growing data engineering & data science consultancy.We work primarily with Private Equity Funds and their Portfolio Companies to create commercial value using Data & Artificial...Show moreLast updated: 25 days ago
- Promoted
Data Engineer
IntraEdgeChennai, IN We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team.
You will be responsible for building scalable and reli...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
XANDER CONSULTING AND ADVISORY PRIVATE LIMITEDChennai Description : - Design, develop, and maintain scalable data pipelines using Azure Databricks, Apache Spark, and Delta Lake.
Implement data ingestion, transformation, ...Show moreLast updated: 27 days ago