Talent.com
Aws Data Engineer
Aws Data EngineerValueMomentum • Tiruchirappalli, Republic Of India, IN
No longer accepting applications
Aws Data Engineer

Aws Data Engineer

ValueMomentum • Tiruchirappalli, Republic Of India, IN
18 hours ago
Job description

Job Title : SSE – Data Engineer

Primary Skill : Python, Pyspark Mandatory, StepFunctions, Lamda, Iceberg, Lake Formation and AWS Services and pipelines and experience in data implementation and medallion architecture.

Location : Hyderabad / Pune / Coimbatore

Experience : 4 - 8 years of experience

Mode of Work : 5 Days Work from office

Job Summary : We are looking for a Senior Data Engineer who will be responsible for building AWS Data pipelines as per requirements. Should have strong analytical skills, design capabilities, problem solving skills. Based on stakeholders’ requirements, should be able to propose solutions to the customer for review. Discuss pros / cons of different solution designs and optimization strategies.

Responsibilities :

  • Provide technical and development support to clients to build and maintain data pipelines.
  • Develop data mapping documents listing business and transformational rules.
  • Develop, unit test, deploy and maintain data pipelines.
  • Design a Storage Layer for storing tabular / semi-structured / unstructured data.
  • Design pipelines for batch / real-time processing of large data volumes.
  • Analyze source specifications and build data mapping documents.
  • Identify and document applicable non-functional code sets and reference data across insurance domains.
  • Understand profiling results and validate data quality rules.
  • Utilize data analysis tools to construct and manipulate datasets to support analyses.
  • Collaborate with and support Quality Assurance (QA) in building functional scenarios and validating results.

Requirements :

  • 5+ years’ experience developing and maintaining modern ingestion pipeline using technologies like (AWS pipelines, Lamda, Spark, Apache Nifi etc).
  • Basic understanding of the MLOPs lifecycle (Data prep ->
  • model training ->

    model deployment ->

    model inference ->

    model re-training).

  • Should be able to design data pipelines for batch / real time using Lambda, Step Functions, API Gateway, SNS, S3.
  • Must have experience in Data modernization project moving data from Legacy systems to Cloud Based Technology
  • Hands on experience on AWS Cloud and its Native components like S3, Athena, Redshift & Jupyter Notebooks.
  • Requirements Gathering - Active involvement during requirements discussions with project sponsors, defining the project scope and delivery timelines, Design & Development.
  • Strong in Spark Scala & Python pipelines (ETL & Streaming).
  • Strong experience in metadata management tools like AWS Glue.
  • Strong experience in coding with languages like Java, Python,Pyspark.
  • Good-to-have AWS Developer certified.
  • Good-to-have Postman-API and Apache Airflow or similar schedulers experience.
  • Working with cross-functional teams to meet strategic goals.
  • Experience in high volume data environments and medallion architecture.
  • Critical thinking and excellent verbal and written communication skills.
  • Strong problem-solving and analytical abilities should be able to work and deliver individually.
  • Good knowledge of data warehousing concepts.
  • Desired Skill Set : Lambda, Step Functions, API Gateway, SNS, S3 (unstructured data), DynamoDB (semi-structured data), Aurora PostgreSQL (tabular data), AWS Sagemaker, AWS CodeCommit / GitLab, AWS CodeBuild, AWS Code Pipeline, AWS ECR, SQS, Eventbridge, Cloudwatch, Splunk, Boto3, PyTest .

    Aboutthe Company :

    ValueMomentum is amongst the fastestgrowing insurance-focused IT services providersin North America.Leading insurers trust ValueMomentum with their core, digital and data transformation initiatives. Having grown consistently every year by 24%, we have now grown to over 4000 employees. ValueMomentum is committed to integrity and to ensuring that each team and employee is successful. We foster an open work culture where employees' opinions are valued. We believe in teamwork and cultivate a sense of fun, fellowship, and pride among our employees.

    Benefits :

    We at ValueMomentum offer you the opportunity to grow by working alongside the experts. Some of the benefits you can avail are :

  • Competitive compensation package comparable to the best in the industry.
  • Career Advancement : Individual Career Development, coaching and mentoring programs for professional and leadership skill development.
  • Comprehensive training and certification programs.
  • Performance Management : Goal Setting, continuous feedback and year-end appraisal. Reward & recognition for the extraordinary performers.
  • Benefits : Comprehensive health benefits, wellness and fitness programs. Paid time off and holidays.
  • Culture : A highly transparent organization with an open-door policy and a vibrant culture
  • Create a job alert for this search

    Aws Data Engineer • Tiruchirappalli, Republic Of India, IN

    Related jobs
    Data Engineer

    Data Engineer

    TerraGiG • Tiruchirappalli, IN
    Lead the design, development, and implementation of data solutions using AWS and Snowflake.Collaborate with cross-functional teams to understand business requirements and translate them into techni...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer (GCP)

    Data Engineer (GCP)

    HISH IT SERVICES • Tiruchirappalli, IN
    We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery). This role requires a hands-on developer who can collaborate closely wit...Show more
    Last updated: 20 days ago • Promoted
    Data Engineer

    Data Engineer

    Randstad Enterprise • Tiruchirappalli, IN
    Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    VRIZE • Tiruchirappalli, IN
    Design, architect, administer, and manage large database systems, particularly on Microsoft platforms such as SQL Server and Azure Database. Develop and optimize complex SQL queries for data extract...Show more
    Last updated: 7 days ago • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy Services • Tiruchirappalli, IN
    TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    CXC • Tiruchirappalli, IN
    Please apply only if you are available to work in Australian time zone and comfortable with 6 months contract duration • •. We’re seeking a highly skilled and autonomous.Power BI implementations to jo...Show more
    Last updated: 2 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    VXI Global Solutions • Tiruchirappalli, IN
    We are seeking talented and motivated Data Engineers to join our dynamic team and contribute to our mission of harnessing the power of data to drive growth and success. As a Data Engineer at VXI Glo...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    System Soft Technologies • Tiruchirappalli, IN
    Location : Remote (3–4-hour time zone overlaps with EST if off shore).Experience with next flow is required, as the consultant will make targeted enhancements to existing workflows and pipelines.Whi...Show more
    Last updated: 8 days ago • Promoted
    Data Engineer - Fully Remote (Global Data Platform & Analytics Projects)

    Data Engineer - Fully Remote (Global Data Platform & Analytics Projects)

    SkillsCapital • Tiruchirappalli, IN
    Remote
    These fully remote, long-term freelance roles are ideal for engineers who can build scalable data pipelines, work with modern cloud-native data stacks, and support large-scale enterprise data initi...Show more
    Last updated: 3 days ago • Promoted
    GCP Data Engineer

    GCP Data Engineer

    PamTen Inc • Tiruchirappalli, IN
    You will work ongoing support activities and support project efforts as needed.You triage identified issues across Account source platforms, integrations and Customer Data Hub.You will analyze and ...Show more
    Last updated: 21 days ago • Promoted
    Senior AWS Cloud Engineer

    Senior AWS Cloud Engineer

    9NEXUS • Tiruchirappalli, IN
    Job Title : Senior Cloud Engineer (Data Platform).Seeking an experienced Cloud Engineer to support Data Platform function by enabling feature teams with secure, scalable, and reusable AWS infrastruc...Show more
    Last updated: 6 days ago • Promoted
    Azure Data Engineer – Databricks, DBT

    Azure Data Engineer – Databricks, DBT

    Tata Consultancy Services • Tiruchirappalli, IN
    Role • •Azure Data Engineer – Databricks, DBT.Required Technical Skill Set • •Data Lake architecture, Azure Services – ADLS, ADF, Azure Databricks, Synapse. Build the solution for optimal extraction, tr...Show more
    Last updated: 8 days ago • Promoted
    Data Engineer

    Data Engineer

    Staffingine LLC • Tiruchirappalli, IN
    The Data Engineer will be responsible for designing, developing, and optimizing scalable data pipelines and cloud-based data solutions. This role requires strong Python programming skills, expertise...Show more
    Last updated: 5 days ago • Promoted
    Data Engineer

    Data Engineer

    Vriba Solutions • Tiruchirappalli, IN
    AWS, Snowflake, Kafka, Airflow, GitHub, PySpark, Python.Design, develop, and maintain scalable ETL / ELT pipelines.Ingest data from various sources (APIs, databases, files, etc.Implement both real-ti...Show more
    Last updated: 30+ days ago • Promoted
    PySpark Data Engineer

    PySpark Data Engineer

    EXTRAGIG • Tiruchirappalli, IN
    Contract Assistant – Data Engineer Support (Remote, EST Hours).PySpark Data Engineer with daily activities.This is a remote contract role. Execute creative software and data solutions, including des...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    IntraEdge • Tiruchirappalli, IN
    We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show more
    Last updated: 30+ days ago • Promoted
    Databricks Data Engineer Lead – Sustainability Project

    Databricks Data Engineer Lead – Sustainability Project

    Blue Cloud Softech Solutions Limited • Tiruchirappalli, IN
    BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level ...Show more
    Last updated: 14 days ago • Promoted
    Principal Data Engineer

    Principal Data Engineer

    CodeMyMobile • Tiruchirappalli, IN
    Experience Required - 7 to 10 Years.Are you a Data Engineer who cares about clean engineering, autonomy, and solving real data challenges? If this sounds like you, we’d love to connect!.Email your ...Show more
    Last updated: 28 days ago • Promoted