Talent.com
AWS Data Engineer
AWS Data EngineerValueMomentum • gurugram, uttar pradesh, in
No longer accepting applications
AWS Data Engineer

AWS Data Engineer

ValueMomentum • gurugram, uttar pradesh, in
2 days ago
Job description

Job Title : SSE – Data Engineer

Primary Skill : Python, Pyspark Mandatory, StepFunctions, Lamda, Iceberg, Lake Formation and AWS Services and pipelines and experience in data implementation and medallion architecture.

Location : Hyderabad / Pune / Coimbatore

Experience : 4 - 8 years of experience

Mode of Work : 5 Days Work from office

Job Summary : We are looking for a Senior Data Engineer who will be responsible for building AWS Data pipelines as per requirements. Should have strong analytical skills, design capabilities, problem solving skills. Based on stakeholders’ requirements, should be able to propose solutions to the customer for review. Discuss pros / cons of different solution designs and optimization strategies.

Responsibilities :

  • Provide technical and development support to clients to build and maintain data pipelines.
  • Develop data mapping documents listing business and transformational rules.
  • Develop, unit test, deploy and maintain data pipelines.
  • Design a Storage Layer for storing tabular / semi-structured / unstructured data.
  • Design pipelines for batch / real-time processing of large data volumes.
  • Analyze source specifications and build data mapping documents.
  • Identify and document applicable non-functional code sets and reference data across insurance domains.
  • Understand profiling results and validate data quality rules.
  • Utilize data analysis tools to construct and manipulate datasets to support analyses.
  • Collaborate with and support Quality Assurance (QA) in building functional scenarios and validating results.

Requirements :

  • 5+ years’ experience developing and maintaining modern ingestion pipeline using technologies like (AWS pipelines, Lamda, Spark, Apache Nifi etc).
  • Basic understanding of the MLOPs lifecycle (Data prep ->
  • model training ->

    model deployment ->

    model inference ->

    model re-training).

  • Should be able to design data pipelines for batch / real time using Lambda, Step Functions, API Gateway, SNS, S3.
  • Must have experience in Data modernization project moving data from Legacy systems to Cloud Based Technology
  • Hands on experience on AWS Cloud and its Native components like S3, Athena, Redshift & Jupyter Notebooks.
  • Requirements Gathering - Active involvement during requirements discussions with project sponsors, defining the project scope and delivery timelines, Design & Development.
  • Strong in Spark Scala & Python pipelines (ETL & Streaming).
  • Strong experience in metadata management tools like AWS Glue.
  • Strong experience in coding with languages like Java, Python,Pyspark.
  • Good-to-have AWS Developer certified.
  • Good-to-have Postman-API and Apache Airflow or similar schedulers experience.
  • Working with cross-functional teams to meet strategic goals.
  • Experience in high volume data environments and medallion architecture.
  • Critical thinking and excellent verbal and written communication skills.
  • Strong problem-solving and analytical abilities should be able to work and deliver individually.
  • Good knowledge of data warehousing concepts.
  • Desired Skill Set : Lambda, Step Functions, API Gateway, SNS, S3 (unstructured data), DynamoDB (semi-structured data), Aurora PostgreSQL (tabular data), AWS Sagemaker, AWS CodeCommit / GitLab, AWS CodeBuild, AWS Code Pipeline, AWS ECR, SQS, Eventbridge, Cloudwatch, Splunk, Boto3, PyTest .

    Aboutthe Company :

    ValueMomentum is amongst the fastestgrowing insurance-focused IT services providersin North America.Leading insurers trust ValueMomentum with their core, digital and data transformation initiatives. Having grown consistently every year by 24%, we have now grown to over 4000 employees. ValueMomentum is committed to integrity and to ensuring that each team and employee is successful. We foster an open work culture where employees' opinions are valued. We believe in teamwork and cultivate a sense of fun, fellowship, and pride among our employees.

    Benefits :

    We at ValueMomentum offer you the opportunity to grow by working alongside the experts. Some of the benefits you can avail are :

  • Competitive compensation package comparable to the best in the industry.
  • Career Advancement : Individual Career Development, coaching and mentoring programs for professional and leadership skill development.
  • Comprehensive training and certification programs.
  • Performance Management : Goal Setting, continuous feedback and year-end appraisal. Reward & recognition for the extraordinary performers.
  • Benefits : Comprehensive health benefits, wellness and fitness programs. Paid time off and holidays.
  • Culture : A highly transparent organization with an open-door policy and a vibrant culture
  • Create a job alert for this search

    Aws Data Engineer • gurugram, uttar pradesh, in

    Related jobs
    AWS DE - Manager

    AWS DE - Manager

    Talent Worx • Gurugram, HR, IN
    Quick Apply
    We are seeking experienced AWS Data Engineers to design, implement, and maintain robust data pipelines and analytics solutions using AWS services. The ideal candidate will have a strong background i...Show more
    Last updated: 30+ days ago
    AWS Architect

    AWS Architect

    Infigonia Group • Gurgaon, Haryana, India
    Infigonia Group, FZ-LLC is recruiting for a new position for one of its ventures : .As a values driven group, we are seeking a candidate, internal or external who possesses the following qualificatio...Show more
    Last updated: 30+ days ago • Promoted
    Lead Engineer- Azure Iaas / Paas

    Lead Engineer- Azure Iaas / Paas

    Acuity Analytics • Gurugram, Haryana, India
    Acuity Knowledge Partners (Acuity) is a leading provider of bespoke research, analytics and technology solutions to the financial services sector, including asset managers, corporate and investment...Show more
    Last updated: 2 hours ago • Promoted • New!
    Generative AI Engineer

    Generative AI Engineer

    ElevenX Capital • Gurugram, Haryana, India
    We are building a next-generation conversational AI platform (voice and text).We are looking for an engineer with strong hands-on experience in Python and modern AI systems.Build, optimize, and mai...Show more
    Last updated: 18 hours ago • Promoted • New!
    DevOps Engineer

    DevOps Engineer

    Yum! India Global Services Private Limited • Gurugram, Haryana, India
    Forming the Yum Digital Tech Team, you’ll be working across teams to support the DevOps of the Digital products for web and app as well as the integrations to the many external services.Your focus ...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    EXL • Gurugram, Haryana, India
    Design and develop ETL / ELT pipelines using Azure Data Factory, Snowflake, and DBT.Build and maintain data integration workflows from various data sources to Snowflake. Write efficient and optimized ...Show more
    Last updated: 11 days ago • Promoted
    Data Engineer

    Data Engineer

    Impetus • Gurugram, Haryana, India
    GCP Developer for Gurgaon / Bangalore location.We are looking for a person with Bigdata, Spark, Pyspark, Python & with GCP combination - Bigquery, Dataproc, Pubsub, Cloud Composer, GCS or etc.If you ...Show more
    Last updated: 30+ days ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Paritas Recruitment • gurgaon, haryana, in
    Azure Data Engineer - 6 Month+ Rolling Contract.Remote - (Sunday to Thursday working days).Paritas is working with a global IT Consultancy & leading Energy client who are seeking an experienced and...Show more
    Last updated: 17 hours ago • Promoted • New!
    Principal Data Engineer

    Principal Data Engineer

    Nexuspoint Consultant • gurgaon, haryana, in
    We are looking for an accomplished Principal Data Engineer to lead the ideation, architecture,.You will work closely with cloud, security, and infrastructure architects to ensure seamless.Lead the ...Show more
    Last updated: 17 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    Movate • Gurugram, Haryana, India
    Shift Timing – 3PM – 12AM (Work from office).Notice Period : Immediate to 15 days.Strong proficiency in SQL and Python for data transformation and automation. Hands-on experience building and support...Show more
    Last updated: 11 days ago • Promoted
    Data Engineer

    Data Engineer

    TerraGiG • gurgaon, India
    Lead the design, development, and implementation of data solutions using AWS and Snowflake.Collaborate with cross-functional teams to understand business requirements and translate them into techni...Show more
    Last updated: 2 days ago • Promoted
    Cloud Engineer

    Cloud Engineer

    EXL • gurgaon, haryana, in
    The person will be part of the EDP Data Platform (EDP) team for a major Insurance client.He / She will work with different stakeholders for architecting & Building EDP application platform to suppor...Show more
    Last updated: 30+ days ago • Promoted
    Sr Azure Data Engineer - Remote work

    Sr Azure Data Engineer - Remote work

    Techolution • gurgaon, haryana, in
    Remote
    The ideal candidate will have a strong foundation in.Job Title : Azure Data Engineer.Work Timings : 5 : 00 PM to 2 : 00 AM IST. If your expertise is primarily in.Lead the migration of large-scale SQL work...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer - AWS

    Data Engineer - AWS

    Recruin • Gurgaon, Haryana, India
    Only Immediate Joinees Responsibilities : Skills – AWS, DE, Airflow Key Responsibilities Design, develop, and maintain data pipelines using AWS services such as Glue, Lambda, Step Functions, EMR, Ki...Show more
    Last updated: 8 days ago • Promoted
    AWS Cloud Engineer

    AWS Cloud Engineer

    Talent Worx • Gurugram, HR, IN
    Quick Apply
    Talent Worx is looking for a proficient.In this role, you will play a key role in designing, deploying, and managing AWS cloud solutions that align with our organizational objectives.You will lever...Show more
    Last updated: 30+ days ago
    Staff Data Engineer

    Staff Data Engineer

    ANSR Summit Consulting • Gurgaon, India
    Participate in the entire data pipeline lifecycle, focusing on building data lakes, data warehouses and related processes. Contribute to the design and documentation of our data lake platform.Partne...Show more
    Last updated: 30+ days ago • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    Epergne Solutions • Gurgaon, Haryana, India
    Quick Apply
    Immediate / 10 Days To 15 days NP.The ideal candidate should have a solid background in data engineering, strong programming skills, and deep experience working with AWS cloud services.Optimize and...Show more
    Last updated: 30+ days ago
    AI Data Engineer

    AI Data Engineer

    Turing • Gurugram, Haryana, India
    We’re looking for experienced AI data engineers skilled in Python to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improve how AI models ...Show more
    Last updated: 20 hours ago • Promoted • New!