Talent.com
Data Engineer
Data EngineerMyData Insights Pvt Ltd • secunderabad, telangana, in
No longer accepting applications
Data Engineer

Data Engineer

MyData Insights Pvt Ltd • secunderabad, telangana, in
9 days ago
Job description

Role : Data Engineer

Experience : 6–12 years

Location : Remote

Engagement : Contract (4–6 Months)

Work Type : Remote

About the Role

We are seeking an experienced Data Engineer to support data modernization and analytics initiatives across multi-cloud environments. The ideal candidate has a strong background in building scalable data solutions on AWS, Azure, or GCP , along with hands-on expertise in CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices .

Experience working in Pharma or Life Sciences environments is a strong plus (not mandatory).

Key Responsibilities

Cloud Data Engineering

  • Design, build, and optimize scalable data pipelines across AWS, Azure, or GCP.
  • Develop ingestion, transformation, and orchestration pipelines using cloud-native services (e.g., AWS Glue, Azure Data Factory, GCP Dataflow).
  • Implement ETL / ELT workflows for large-scale structured and unstructured datasets.

CI / CD, Cloud Build & Deployment

  • Build and maintain CI / CD pipelines for infrastructure and application deployments.
  • Work with Azure DevOps, GitHub Actions, GitLab CI, Jenkins, or Google Cloud Build .
  • Ensure automated deployments, version control, and environment consistency.
  • Infrastructure as Code (IaC)

  • Use Terraform to design, provision, and manage cloud infrastructure.
  • Implement reusable IaC modules for multi-cloud data architecture.
  • Cloud Architecture & Operations

  • Work across AWS, Azure, and GCP to build secure, scalable, and cost-efficient data platforms.
  • Collaborate with architecture teams on network, security, IAM, and storage configurations.
  • Optimize data workflows for performance, cost, and reliability.
  • Data Integration & Analytics Support

  • Build data models, pipelines, and transformations to support analytics, ML, and reporting needs.
  • Work with Data Scientists, BI teams, and domain experts to ensure data availability and quality.
  • Documentation & Collaboration

  • Maintain clear technical documentation covering pipelines, architecture, and workflows.
  • Collaborate with cross-functional teams including cloud engineering, QA, and domain SMEs.
  • Required Skills

  • 6–12 years of experience as a Data Engineer in cloud-driven environments.
  • Strong hands-on experience with at least one of the following cloud platforms :
  • AWS (Glue, Lambda, S3, EMR, Redshift)
  • Azure (ADF, Synapse, Databricks, Storage, Functions)
  • GCP (BigQuery, Dataflow, Cloud Build, Cloud Functions)
  • Strong experience with CI / CD pipelines (Azure DevOps, GitHub Actions, Jenkins, GCP Cloud Build).
  • Solid expertise in Terraform for IaC.
  • Strong Python or SQL experience for building data pipelines.
  • Experience with data modeling, ETL / ELT patterns, and distributed data processing.
  • Exposure to infrastructure and application deployment automation.
  • Good-to-Have Skills

  • Pharma / Life Sciences domain experience.
  • Experience with DataOps practices.
  • Familiarity with regulatory and compliance requirements (GxP, HIPAA preferred).
  • Experience with containerization (Docker, Kubernetes).
  • Create a job alert for this search

    Data Engineer • secunderabad, telangana, in

    Related jobs
    Data Engineer

    Data Engineer

    Prudent Technologies and Consulting, Inc. • Hyderabad, Telangana, India
    Seeking an experienced Senior Data Engineer with over 9 years of industry experience to architect, build, and manage advanced data pipelines and platforms in a cloud environment.The ideal candidate...Show more
    Last updated: 30+ days ago • Promoted
    Databricks Data Engineer

    Databricks Data Engineer

    zRanga LLC • Hyderabad, Telangana, India
    Company Description zRanga is a specialized staffing and talent solutions provider helping enterprises scale quickly with high-quality technology and business professionals.With a team backed by 50...Show more
    Last updated: 9 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    Cliff IT Solutions Inc. • Hyderabad, Republic Of India, IN
    Company Description Cliff IT Solutions is a leading provider of Identity Management and Security governance solutions for onsite and cloud applications. Our services help organizations reduce risk a...Show more
    Last updated: 12 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    ValueMomentum • Hyderabad, India
    Primary skills : Databricks, PySpark, SQL.Secondary skills : Advanced SQL, Azure Data Factory, and Azure Data lake.About the Job We are seeking a Tech Lead –. Databricks Data Engineer with exper...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer

    Data Engineer

    HCLTech • Hyderabad, Telangana, India
    Data Engineer - Databricks Job Description.The Data Engineer - Databricks will be responsible for building and optimizing our data pipelines, architectures, and data sets.He will work closely with ...Show more
    Last updated: 23 days ago • Promoted
    Data Engineer Lead

    Data Engineer Lead

    JRD Systems • Hyderabad, Telangana, India
    The ideal candidate will have a strong background in.Databricks, Azure Data Factory, Alteryx, Ab Initio, Talend, and Informatica. This role will lead the design and delivery of.Databricks (PySpark, ...Show more
    Last updated: 10 days ago • Promoted
    Data Engineer

    Data Engineer

    RapidBrains • Hyderabad, India
    Design, develop, and optimize large-scale data analytics and data warehouse solutions using Azure Data Factory and Azure Databricks. Build and maintain data lake architectures to process multi-forma...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer / Databricks

    Data Engineer / Databricks

    ValueMomentum • Hyderabad, Republic Of India, IN
    Databricks Engineer-Databricks.Primary skills : Databricks, PySpark, SQL.Secondary skills : Advanced SQL, Azure Data Factory, and Azure Data lake. Design and develop ETL pipelines using ADF for data i...Show more
    Last updated: 2 days ago • Promoted
    Data Engineer

    Data Engineer

    Vriba Solutions • Hyderabad, IN
    Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions. Data validation, quality & cleansing.Translate busin...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    ADP • Hyderabad, Telangana, India
    Position : Data Engineer with 3 to 10 Years experience in PySpark and Data bricks.In this role candidate will be responsible for understanding complex data sets, managing multiple disparate data so...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Quest Diagnostics • Hyderabad, Republic Of India, IN
    Work as part of a small agile team to design and implement new features and technologies.Deliver high quality, high performance code in an agile environment. Use, evaluate, and learn exciting new te...Show more
    Last updated: 30+ days ago • Promoted
    Data Platform Engineer

    Data Platform Engineer

    Prudent Technologies and Consulting, Inc. • Hyderabad, Republic Of India, IN
    Seeking an experienced Senior Data Engineer with over 9 years of industry experience to architect, build, and manage advanced data pipelines and platforms in a cloud environment.The ideal candidate...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Straive • Hyderabad, Telangana, India
    Design, build and maintain scalable.Implement core ETL / ELT logic in Scala and Python; author efficient Spark DataFrame / Dataset jobs. Write and optimize complex SQL for ingestion, transformation and ...Show more
    Last updated: 12 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Sonatype • Hyderabad, Republic Of India, IN
    At Sonatype, we help organizations build better, more secure software by enabling them to understand and control their software supply chains. Our products are trusted by thousands of engineering te...Show more
    Last updated: 1 hour ago • Promoted • New!
    Data Engineer

    Data Engineer

    Insight Global • Hyderabad, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Travel & Payments • Hyderabad, Telangana, India
    At Yuno, we are building the payment infrastructure that enables all companies to participate in the global market.Founded by a team of seasoned experts in the payments and IT industries, Yuno prov...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Grantify • Hyderabad, IN
    Grantify is an innovative education platform that connects students and universities through a transparent admissions and tuition-matching ecosystem. By aligning student budgets and academic aspirat...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer

    Data Engineer

    Radiant Digital • Hyderabad, India
    As a Data Engineer, you will play a key role in designing, developing, and optimizing data pipelines and storage solutions in a complex, enterprise-scale data warehouse environment.You will contrib...Show more
    Last updated: 3 days ago • Promoted