Talent.com
Senior Cloud Migration Engineer ( EMR Serverless)

Senior Cloud Migration Engineer ( EMR Serverless)

ConfidentialBengaluru / Bangalore, India
19 days ago
Job description

Position Summary

We are seeking a highly skilled Senior Cloud Migration Engineer to lead the transformation of our EMR workloads from EC2-based infrastructure to EMR Serverless. This strategic role focuses on enhancing scalability, reducing operational overhead, and improving cost efficiency across our cloud-native data processing platform.

______________

Key Responsibilities

Migration Planning & Assessment

  • Analyze existing EC2-based EMR jobs to assess their suitability for serverless migration
  • Prioritize workloads based on business impact, complexity, and readiness
  • Conduct deep code discovery and ensure alignment with production standards
  • Audit and synchronize code repositories with live production environments

Technical Implementation

  • Transition Hadoop / HDFS workloads to Amazon S3-based architectures
  • Refactor data processing pipelines to leverage Amazon Athena
  • Upgrade and modernize runtime environments (e.g., Python versions)
  • Ensure full dependency compatibility across target serverless stacks
  • Infrastructure Modernization

  • Integrate EMR Serverless logging with AWS CloudWatch
  • Configure centralized logging via AWS Log Groups
  • Optimize workflows for observability and performance in a serverless model
  • Migrate legacy scheduling (e.g., Control-M, cron) to AWS Step Functions
  • DevOps - Git Hub and Workflow Experience
  • Quality Assurance & Deployment

  • Design and implement robust testing strategies across staging and QA environments
  • Document test plans, validation procedures, and migration outcomes
  • Collaborate with the AMI and QA teams for pre-deployment sign-offs
  • Execute controlled production rollouts with post-deployment monitoring
  • ______________

    Required Qualifications

  • 5+ years of experience with Amazon EMR and big data platforms
  • Deep expertise in Apache Spark, Hadoop ecosystem, and AWS cloud services
  • Proficient in Python and version management
  • Hands-on experience with AWS Step Functions, CloudWatch, and serverless solutions
  • Familiarity with job schedulers like Control-M or cron
  • Strong knowledge of Amazon S3, Athena, and data lake architectures
  • ______________

    Preferred Qualifications

  • AWS Certifications (Solutions Architect, DevOps Engineer, or Data Analytics)
  • Experience with Infrastructure as Code (IaC) tools such as CloudFormation or Terraform
  • Proven success in enterprise-scale cloud / data migration projects
  • Experience working in Agile environments using JIRA or similar tools
  • ______________

    Success Metrics

  • Full migration of selected EMR jobs to EMR Serverless
  • Meet or exceed existing EC2-based performance benchmarks
  • Demonstrable cost savings post-migration
  • Zero data loss throughout the migration process
  • Successful completion of quality checks and stakeholder approvals
  • Skills Required

    Cron, Hadoop, Cloudformation, Amazon S3, Apache Spark, AWS CloudWatch, Jira, amazon emr , Terraform, Control-M, Python

    Create a job alert for this search

    Senior Cloud Engineer • Bengaluru / Bangalore, India

    Related jobs
    • Promoted
    Cloud Engineer (AWS, Azure)

    Cloud Engineer (AWS, Azure)

    BPMLinkshosur, tamil nadu, in
    Job Description – Cloud Engineer (AWS, Azure, Snowflake) : .We are looking for a skilled Cloud Engineer to take ownership of the existing multi-cloud infrastructure and data integration setup.Manage ...Show moreLast updated: 14 days ago
    • Promoted
    Senior Data Migration Engineer

    Senior Data Migration Engineer

    Innover DigitalBengaluru, Republic Of India, IN
    Hands-on Migration and Development.Directly develop and migrate 20+ complex data pipelines from Azure Data Factory (ADF) into optimized Fabric Data Pipelines and Spark Notebooks (PySpark / Scala).Rew...Show moreLast updated: 15 days ago
    • Promoted
    Senior Cloud Solutions Engineer

    Senior Cloud Solutions Engineer

    OracleBengaluru, Republic Of India, IN
    As a Senior Cloud Support Engineer, you will be the technical interface to customers, for resolution of problems related to the installation, recommended maintenance, and use of Oracle products.Hav...Show moreLast updated: 15 days ago
    • Promoted
    Senior Engineer Cloud [T500-20310]

    Senior Engineer Cloud [T500-20310]

    Albertsons Companies IndiaBengaluru, Karnataka, India
    About Albertsons Companies Inc.As a leading food and drug retailer in the United States, Albertsons Companies, Inc.Our well-known banners across the United States, including Albertsons, Safeway, Vo...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Azure cloud Engineer

    Senior Azure cloud Engineer

    Gloifyhosur, tamil nadu, in
    Senior Azure Cloud Engineer – Job Description.Hybrid (2–3 days onsite per week).Immediate to 21 days preferred.The role involves working closely with platform leads and DevOps teams to deliver scal...Show moreLast updated: 14 hours ago
    • Promoted
    Senior OpenStack Cloud Migration Consultant with Vmware, Kubernetes, Devops, Terraform, KVM background - 100% REMOTE - Contract Role - US EST / PST Work Shift

    Senior OpenStack Cloud Migration Consultant with Vmware, Kubernetes, Devops, Terraform, KVM background - 100% REMOTE - Contract Role - US EST / PST Work Shift

    iShiftBengaluru, IN
    Remote
    Job Title : Senior Openstack Cloud Migration Consultant with strong VVMware, Terraform, Kubernetes, Openstack and DevOps. Location : India based 100% REMOTE.Employment Type : Contract Basis role.We are...Show moreLast updated: 12 days ago
    • Promoted
    Senior Engineer Cloud - Sterling B2Bi [T500-20394]

    Senior Engineer Cloud - Sterling B2Bi [T500-20394]

    Albertsons Companies IndiaBengaluru, Karnataka, India
    About Albertsons Companies Inc.As a leading food and drug retailer in the United States, Albertsons Companies, Inc.Our well-known banners across the United States, including Albertsons, Safeway, Vo...Show moreLast updated: 30+ days ago
    • Promoted
    Cloud Engineer- Observability

    Cloud Engineer- Observability

    SmarshBengaluru, Karnataka, India
    Who are we? Smarsh empowers its customers to manage risk and unleash intelligence in their digital communications.Our growing community of over 6500 organizations in regulated industries counts on...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Aws Cloud Engineer_ Exp : 7+ Years

    Senior Aws Cloud Engineer_ Exp : 7+ Years

    Atyeti IncBengaluru, Republic Of India, IN
    Take a defined problem including one or more components and come up with the implementation with minimal guidance.Understand framework and tool ecosystem to implement components.Develop high qualit...Show moreLast updated: 6 days ago
    • Promoted
    Senior Support Engineer, Cloud Migrations

    Senior Support Engineer, Cloud Migrations

    ConfidentialBengaluru / Bangalore, India
    Atlassians can choose where they work â€' whether in an office, from home, or a combination of the two.That way, Atlassians have more control over supporting their family, personal goals, and other...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Cloud Engineer

    Senior Cloud Engineer

    Eagle Eye NetworksBengaluru, Republic Of India, IN
    Eagle Eye Networks is the global leader in cloud video surveillance, delivering AI-powered video intelligence to tens of thousands of businesses across 90+ countries. Headquartered in Austin, Texas,...Show moreLast updated: 15 days ago
    • Promoted
    Senior Cloud Engineer

    Senior Cloud Engineer

    ConfidentialBengaluru / Bangalore
    Build and maintain client relationships, providing technical leadership and guidance for current projects.Collaborate with stakeholders to understand business requirements, assist in project planni...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    VMware to XenServer Migration Engineer

    VMware to XenServer Migration Engineer

    TribolaTech IncBangalore, IN
    Job Title : VMware to XenServer Migration Engineer.Duration : 1+ month , till end of December.We are seeking a contractor to assist with a critical migration effort, moving workloads from.This is a t...Show moreLast updated: 16 hours ago
    • Promoted
    Senior Cloud Migration Engineer - AWS EMR

    Senior Cloud Migration Engineer - AWS EMR

    INDIGLOBE IT SOLUTIONS PRIVATE LIMITEDBangalore
    Estimated Start Date : Oct 1, 2025 Duration : 12 months (Contract-to-Hire) We are seeking a highly skilled Senior Cloud Migrat...Show moreLast updated: 30+ days ago
    • Promoted
    Senior AWS Cloud Engineer_ Exp : 7+ Years

    Senior AWS Cloud Engineer_ Exp : 7+ Years

    Atyeti IncBengaluru, Karnataka, India
    Take a defined problem including one or more components and come up with the implementation with minimal guidance.Understand framework and tool ecosystem to implement components.Develop high qualit...Show moreLast updated: 6 days ago
    • Promoted
    • New!
    Cloud Engineer-Observability

    Cloud Engineer-Observability

    SmarshBengaluru, Karnataka, India
    The Observability team builds and manages the single telemetry and observability service used by all product teams on the Smarsh platform. It provides "as a service" telemetry, monitoring, and visua...Show moreLast updated: 16 hours ago
    • Promoted
    • New!
    Sr Cloud Engineer (ML operations)

    Sr Cloud Engineer (ML operations)

    Moody'sBangalore, India
    At Moody's, we unite the brightest minds to turn today's risks into tomorrow's opportunities.We do this by striving to create an inclusive environment where everyone feels welcome to be who they ar...Show moreLast updated: 8 hours ago
    • Promoted
    Senior Cloud SRE Engineer (Azure)

    Senior Cloud SRE Engineer (Azure)

    London Stock Exchange GroupBangalore, India
    In this role, you will be joining our Cloud SRE team within.Cloud & Productivity Engineering.This team focuses on applying software Engineering practices to IT operations tasks to maintain and impr...Show moreLast updated: 30+ days ago