Talent.com
AWS Data Engineer
AWS Data EngineerValueMomentum • raipur, chattisgarh, in
AWS Data Engineer

AWS Data Engineer

ValueMomentum • raipur, chattisgarh, in
4 hours ago
Job description

Job Title : SSE – Data Engineer

Primary Skill : Python, Pyspark Mandatory, StepFunctions, Lamda, Iceberg, Lake Formation and AWS Services and pipelines and experience in data implementation and medallion architecture.

Location : Hyderabad / Pune / Coimbatore

Experience : 4 - 8 years of experience

Mode of Work : 5 Days Work from office

Job Summary : We are looking for a Senior Data Engineer who will be responsible for building AWS Data pipelines as per requirements. Should have strong analytical skills, design capabilities, problem solving skills. Based on stakeholders’ requirements, should be able to propose solutions to the customer for review. Discuss pros / cons of different solution designs and optimization strategies.

Responsibilities :

  • Provide technical and development support to clients to build and maintain data pipelines.
  • Develop data mapping documents listing business and transformational rules.
  • Develop, unit test, deploy and maintain data pipelines.
  • Design a Storage Layer for storing tabular / semi-structured / unstructured data.
  • Design pipelines for batch / real-time processing of large data volumes.
  • Analyze source specifications and build data mapping documents.
  • Identify and document applicable non-functional code sets and reference data across insurance domains.
  • Understand profiling results and validate data quality rules.
  • Utilize data analysis tools to construct and manipulate datasets to support analyses.
  • Collaborate with and support Quality Assurance (QA) in building functional scenarios and validating results.

Requirements :

  • 5+ years’ experience developing and maintaining modern ingestion pipeline using technologies like (AWS pipelines, Lamda, Spark, Apache Nifi etc).
  • Basic understanding of the MLOPs lifecycle (Data prep ->
  • model training ->

    model deployment ->

    model inference ->

    model re-training).

  • Should be able to design data pipelines for batch / real time using Lambda, Step Functions, API Gateway, SNS, S3.
  • Must have experience in Data modernization project moving data from Legacy systems to Cloud Based Technology
  • Hands on experience on AWS Cloud and its Native components like S3, Athena, Redshift & Jupyter Notebooks.
  • Requirements Gathering - Active involvement during requirements discussions with project sponsors, defining the project scope and delivery timelines, Design & Development.
  • Strong in Spark Scala & Python pipelines (ETL & Streaming).
  • Strong experience in metadata management tools like AWS Glue.
  • Strong experience in coding with languages like Java, Python,Pyspark.
  • Good-to-have AWS Developer certified.
  • Good-to-have Postman-API and Apache Airflow or similar schedulers experience.
  • Working with cross-functional teams to meet strategic goals.
  • Experience in high volume data environments and medallion architecture.
  • Critical thinking and excellent verbal and written communication skills.
  • Strong problem-solving and analytical abilities should be able to work and deliver individually.
  • Good knowledge of data warehousing concepts.
  • Desired Skill Set : Lambda, Step Functions, API Gateway, SNS, S3 (unstructured data), DynamoDB (semi-structured data), Aurora PostgreSQL (tabular data), AWS Sagemaker, AWS CodeCommit / GitLab, AWS CodeBuild, AWS Code Pipeline, AWS ECR, SQS, Eventbridge, Cloudwatch, Splunk, Boto3, PyTest .

    Aboutthe Company :

    ValueMomentum is amongst the fastestgrowing insurance-focused IT services providersin North America.Leading insurers trust ValueMomentum with their core, digital and data transformation initiatives. Having grown consistently every year by 24%, we have now grown to over 4000 employees. ValueMomentum is committed to integrity and to ensuring that each team and employee is successful. We foster an open work culture where employees' opinions are valued. We believe in teamwork and cultivate a sense of fun, fellowship, and pride among our employees.

    Benefits :

    We at ValueMomentum offer you the opportunity to grow by working alongside the experts. Some of the benefits you can avail are :

  • Competitive compensation package comparable to the best in the industry.
  • Career Advancement : Individual Career Development, coaching and mentoring programs for professional and leadership skill development.
  • Comprehensive training and certification programs.
  • Performance Management : Goal Setting, continuous feedback and year-end appraisal. Reward & recognition for the extraordinary performers.
  • Benefits : Comprehensive health benefits, wellness and fitness programs. Paid time off and holidays.
  • Culture : A highly transparent organization with an open-door policy and a vibrant culture
  • Create a job alert for this search

    Aws Data Engineer • raipur, chattisgarh, in

    Related jobs
    AWS DevOps Engineer

    AWS DevOps Engineer

    Fuzen IT Solutions • raipur, chattisgarh, in
    Fuzen IT Solutions specializes in leveraging advanced machine learning and artificial intelligence to drive breakthrough results for businesses. With a presence in Europe, the UK, and the USA, the c...Show more
    Last updated: 4 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    Synechron • raipur, chattisgarh, in
    We have immediate opportunity for.At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to...Show more
    Last updated: 30+ days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    9NEXUS • raipur, chattisgarh, in
    Job Title : Senior AWS Data Engineer.We are seeking a Senior AWS Data Engineer to design, build, and optimize large-scale data pipelines and analytics solutions using AWS services and Databricks.The...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    TerraGiG • raipur, chattisgarh, in
    Lead the design, development, and implementation of data solutions using AWS and Snowflake.Collaborate with cross-functional teams to understand business requirements and translate them into techni...Show more
    Last updated: 30+ days ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Wall Street Consulting Services LLC • raipur, chattisgarh, in
    We have an Immediate Opportunity for a.Looking for only local candidates only.Looking from Immediate joiner or one month notice only. Mode of work : Work from Office.We are seeking an experienced Dat...Show more
    Last updated: 13 days ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    EXL • raipur, chattisgarh, in
    We are seeking a highly skilled Senior Data Engineer with strong expertise in Azure data ecosystem, Snowflake, and modern data transformation frameworks. The ideal candidate will have extensive hand...Show more
    Last updated: 4 hours ago • Promoted • New!
    Senior AWS Cloud Engineer

    Senior AWS Cloud Engineer

    9NEXUS • raipur, chattisgarh, in
    Job Title : Senior Cloud Engineer (Data Platform).Seeking an experienced Cloud Engineer to support Data Platform function by enabling feature teams with secure, scalable, and reusable AWS infrastruc...Show more
    Last updated: 5 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Synechron • raipur, chattisgarh, in
    We have opprotunity for AWS Data Engineer.At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative techn...Show more
    Last updated: 4 hours ago • Promoted • New!
    Senior Databricks Data Engineer

    Senior Databricks Data Engineer

    Squash Apps • raipur, chattisgarh, in
    Squash Apps is a top-rated full-stack consulting company dedicated to building the next generation of scalable and robust web applications for visionary clients. We specialize in modern technologies...Show more
    Last updated: 4 hours ago • Promoted • New!
    AWS Devops Engineer

    AWS Devops Engineer

    eInfochips (An Arrow Company) • raipur, chattisgarh, in
    Infochips, an Arrow company, is a leading global provider of product engineering and semiconductor design services.With over 500+ products developed and 40M deployments in 140 countries, eInfochips...Show more
    Last updated: 4 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    Response Informatics • raipur, chattisgarh, in
    Designation : AWS Data Engineer.Skill Tech stack : AWS Data Engineer, Python, Pyspark, SQL, Data Pipeline, AWS, AWS Glue, lambda. Notice Period – Immediate to 4 week Joiner only (Don’t submit more th...Show more
    Last updated: 30+ days ago • Promoted
    AWS DevOps Engineer

    AWS DevOps Engineer

    Philodesign Technologies Inc • raipur, chattisgarh, in
    Hiring : AWS DevOps Engineer | 10+ Years Experience | Pune (Hybrid) | 30 LPA.Initially Remote → Later Hybrid in Pune (First Preference : Pune). We are seeking a highly experienced.The ideal candidate ...Show more
    Last updated: 4 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    AS Technology Corporation • raipur, chattisgarh, in
    We are seeking an experienced Data Engineer to design, build, and optimize scalable data pipelines and data infrastructure solutions. This role involves working with cloud platforms, big data framew...Show more
    Last updated: 30+ days ago • Promoted
    Aws Databricks Engineer

    Aws Databricks Engineer

    People Prime Worldwide • raipur, chattisgarh, in
    Experience : 5–12 Years (STRICTLY).Notice Period : Immediate Joiners.Our client is a global leader in digital transformation and IT services across 50+ countries. They specialize in cloud modernizatio...Show more
    Last updated: 4 hours ago • Promoted • New!
    Lead Data Engineer with AWS

    Lead Data Engineer with AWS

    People Prime Worldwide • raipur, chattisgarh, in
    Senior Data Engineer- (Python & AWS (Simplified JD).We are looking for a Senior Data Engineer who can build, maintain, and optimize large-scale data systems using. You will design data pipelines, en...Show more
    Last updated: 4 hours ago • Promoted • New!
    Azure Data Engineer

    Azure Data Engineer

    Sigmoid • raipur, chattisgarh, in
    We are looking for a skilled TL Azure Data Engineer with 9+ years of experience in big data technologies, particularly Python, PYSpark, SQL and data lakehouse architectures.The ideal candidate will...Show more
    Last updated: 4 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    MRF • raipur, chattisgarh, in
    Azure / SQL / Application - Data Engineer.Responsible to maintain the data required for managed application like Advanced Planning System, Dealer Management System, etc. Responsible for user access mana...Show more
    Last updated: 4 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    Zeza Technologies • raipur, chattisgarh, in
    Zeza is a vibrant team of programmers, data engineers, and data scientists passionate about innovation.We specialize in using data to drive business growth, solve complex challenges, and optimize o...Show more
    Last updated: 4 hours ago • Promoted • New!