Talent.com
AWS Data Engineer
AWS Data EngineerValueMomentum • Bengaluru, IN
No longer accepting applications
AWS Data Engineer

AWS Data Engineer

ValueMomentum • Bengaluru, IN
1 day ago
Job description

Job Title : SSE – Data Engineer

Primary Skill : Python, Pyspark Mandatory, StepFunctions, Lamda, Iceberg, Lake Formation and AWS Services and pipelines and experience in data implementation and medallion architecture.

Location : Hyderabad / Pune / Coimbatore

Experience : 4 - 8 years of experience

Mode of Work : 5 Days Work from office

Job Summary : We are looking for a Senior Data Engineer who will be responsible for building AWS Data pipelines as per requirements. Should have strong analytical skills, design capabilities, problem solving skills. Based on stakeholders’ requirements, should be able to propose solutions to the customer for review. Discuss pros / cons of different solution designs and optimization strategies.

Responsibilities :

  • Provide technical and development support to clients to build and maintain data pipelines.
  • Develop data mapping documents listing business and transformational rules.
  • Develop, unit test, deploy and maintain data pipelines.
  • Design a Storage Layer for storing tabular / semi-structured / unstructured data.
  • Design pipelines for batch / real-time processing of large data volumes.
  • Analyze source specifications and build data mapping documents.
  • Identify and document applicable non-functional code sets and reference data across insurance domains.
  • Understand profiling results and validate data quality rules.
  • Utilize data analysis tools to construct and manipulate datasets to support analyses.
  • Collaborate with and support Quality Assurance (QA) in building functional scenarios and validating results.

Requirements :

  • 5+ years’ experience developing and maintaining modern ingestion pipeline using technologies like (AWS pipelines, Lamda, Spark, Apache Nifi etc).
  • Basic understanding of the MLOPs lifecycle (Data prep ->
  • model training ->

    model deployment ->

    model inference ->

    model re-training).

  • Should be able to design data pipelines for batch / real time using Lambda, Step Functions, API Gateway, SNS, S3.
  • Must have experience in Data modernization project moving data from Legacy systems to Cloud Based Technology
  • Hands on experience on AWS Cloud and its Native components like S3, Athena, Redshift & Jupyter Notebooks.
  • Requirements Gathering - Active involvement during requirements discussions with project sponsors, defining the project scope and delivery timelines, Design & Development.
  • Strong in Spark Scala & Python pipelines (ETL & Streaming).
  • Strong experience in metadata management tools like AWS Glue.
  • Strong experience in coding with languages like Java, Python,Pyspark.
  • Good-to-have AWS Developer certified.
  • Good-to-have Postman-API and Apache Airflow or similar schedulers experience.
  • Working with cross-functional teams to meet strategic goals.
  • Experience in high volume data environments and medallion architecture.
  • Critical thinking and excellent verbal and written communication skills.
  • Strong problem-solving and analytical abilities should be able to work and deliver individually.
  • Good knowledge of data warehousing concepts.
  • Desired Skill Set : Lambda, Step Functions, API Gateway, SNS, S3 (unstructured data), DynamoDB (semi-structured data), Aurora PostgreSQL (tabular data), AWS Sagemaker, AWS CodeCommit / GitLab, AWS CodeBuild, AWS Code Pipeline, AWS ECR, SQS, Eventbridge, Cloudwatch, Splunk, Boto3, PyTest .

    Aboutthe Company :

    ValueMomentum is amongst the fastestgrowing insurance-focused IT services providersin North America.Leading insurers trust ValueMomentum with their core, digital and data transformation initiatives. Having grown consistently every year by 24%, we have now grown to over 4000 employees. ValueMomentum is committed to integrity and to ensuring that each team and employee is successful. We foster an open work culture where employees' opinions are valued. We believe in teamwork and cultivate a sense of fun, fellowship, and pride among our employees.

    Benefits :

    We at ValueMomentum offer you the opportunity to grow by working alongside the experts. Some of the benefits you can avail are :

  • Competitive compensation package comparable to the best in the industry.
  • Career Advancement : Individual Career Development, coaching and mentoring programs for professional and leadership skill development.
  • Comprehensive training and certification programs.
  • Performance Management : Goal Setting, continuous feedback and year-end appraisal. Reward & recognition for the extraordinary performers.
  • Benefits : Comprehensive health benefits, wellness and fitness programs. Paid time off and holidays.
  • Culture : A highly transparent organization with an open-door policy and a vibrant culture
  • Create a job alert for this search

    Aws Data Engineer • Bengaluru, IN

    Related jobs
    Data Engineer (AWS)

    Data Engineer (AWS)

    Sustainability Economics.ai • Bengaluru, Karnataka, India
    AI, enabling profitable energy transitions while powering end-to-end AI infrastructure.By integrating AI-driven cloud solutions with sustainable energy, we create scalable, intelligent ecosystems t...Show more
    Last updated: 13 days ago • Promoted
    AWS Engineer

    AWS Engineer

    Spryc Systems • Bangalore, IN
    We are seeking an experienced AWS Engineer to design, implement, and maintain AWS infrastructure and services in a managed service environment. The ideal candidate will possess deep expertise in AWS...Show more
    Last updated: 28 days ago • Promoted
    AWS Data Engineer (PySpark)

    AWS Data Engineer (PySpark)

    Atyeti Inc • Bengaluru, Karnataka, India
    Proficient with Python, PySpark and Airflow.Strong understanding of Object-Oriented Programming and Functional Programming paradigm. Must have experience working with Spark and its architecture.Know...Show more
    Last updated: 12 days ago • Promoted
    Aws Lead Data Engineer

    Aws Lead Data Engineer

    Tata Consultancy Services • Bengaluru, Republic Of India, IN
    In this key leadership role, you will lead the development of foundational components for a Lakehouse architecture on AWS and drive the migration of existing data processing workflows to the new La...Show more
    Last updated: 26 days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Atyeti Inc • Bengaluru, Karnataka, India
    Looking for Data Engineer who will be responsible for design, build and maintenance of data pipelines running on Airflow, Spark on the AWS Cloud platform. Build and maintain all facets of Data Pipel...Show more
    Last updated: 13 days ago • Promoted
    AWS Data Solutions Engineer

    AWS Data Solutions Engineer

    LTIMindtree • Bengaluru, Karnataka, India
    Dear Candidates, We are Hiring for "AWS Data Engineer" With "LTI Mindtree" FTE Skill – AWS Glue, Python ,ETL, Aws S3 and services Location : Bangalore Experience : 10-12 years ...Show more
    Last updated: 17 hours ago • Promoted • New!
    AWS Data Engineer

    AWS Data Engineer

    Brillio • Bengaluru, Karnataka, India
    We’re Hiring : AWS Data Engineer.Locations : Open (India – Bangalore, Pune, Hyderabad, Chennai, Gurgaon).Design, develop, and maintain scalable data pipelines on AWS. Implement ETL workflows and data ...Show more
    Last updated: 6 days ago • Promoted
    AWS Data Solutions Engineer

    AWS Data Solutions Engineer

    Ignisov Consulting Services • Bengaluru, Karnataka, India
    Role : AWS Data Engineer Job Location : Bangalore (Work from Office) Job Type : C2H Experience : 5 + Years Job Description : AWS Snowflake, Python, Pyspark Expansion of Data Products Support pipelin...Show more
    Last updated: 17 hours ago • Promoted • New!
    Data Engineer AWS

    Data Engineer AWS

    Trigent Software Private Limited • Bengaluru, Karnataka, India
    CDO EDP Foundation platform at Prudential Financials is looking for a Data Engineer to join a diverse team dedicated to providing best in class Data Platform to our customers stakeholders and partn...Show more
    Last updated: 8 days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Trigent Software Private Limited • Bangalore, Karnataka, India
    As an Application Lead you will lead the effort to design build and configure applications acting as the primary point of contact. Your typical day will involve collaborating with various teams to e...Show more
    Last updated: 5 days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Emids • Bengaluru, Karnataka, India
    We are looking for a highly skilled Data Engineer with strong expertise in AWS, Databricks, PySpark, and Airflow to join our growing Data Engineering team. The ideal candidate will be responsible fo...Show more
    Last updated: 7 days ago • Promoted
    AWS Lead Data engineer

    AWS Lead Data engineer

    Tata Consultancy Services • Bengaluru, Karnataka, India
    In this key leadership role, you will lead the development of foundational components for a Lakehouse architecture on AWS and drive the migration of existing data processing workflows to the new La...Show more
    Last updated: 26 days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy Services • Bengaluru, Karnataka, India
    Bangalore or Bhubaneswar or Hyderabad.Bachelor's degree in Engineering , Technology computer science, statistics, biostatistics, mathematics, biology or other health related field or equivalent exp...Show more
    Last updated: 30+ days ago • Promoted
    Aws Data Engineer

    Aws Data Engineer

    Brillio • Bangalore, Bangalore (division), India
    We’re Hiring : AWS Data Engineer.Locations : Open (India – Bangalore, Pune, Hyderabad, Chennai, Gurgaon).Design, develop, and maintain scalable data pipelines on AWS. Implement ETL workflows and data ...Show more
    Last updated: 2 hours ago • Promoted • New!
    AWS Engineer

    AWS Engineer

    ALIQAN Technologies • Bangalore, Karnataka, India
    AWS Engineer (Experience : 5-8 years).Develop and maintain scalable data processing pipelines on AWS.AWS-based data solutions while. Develop and optimize AWS Glue Lambda and Athena workloads for data....Show more
    Last updated: 19 days ago • Promoted
    Aws Data Engineer

    Aws Data Engineer

    Emids • Bengaluru, Republic Of India, IN
    We are looking for a highly skilled Data Engineer with strong expertise in AWS, Databricks, PySpark, and Airflow to join our growing Data Engineering team. The ideal candidate will be responsible fo...Show more
    Last updated: 7 days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Ignisov Consulting Services • Bengaluru, Karnataka, India
    Job Location : Bangalore (Work from Office).AWS Snowflake, Python, Pyspark.Support pipeline buildout, implementation, and RFC deployments for new business use cases. Assignment group / project repo seg...Show more
    Last updated: 9 days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    9NEXUS • bangalore district, India
    Job Title : Senior AWS Data Engineer.We are seeking a Senior AWS Data Engineer to design, build, and optimize large-scale data pipelines and analytics solutions using AWS services and Databricks.The...Show more
    Last updated: 3 hours ago • Promoted • New!