Talent.com
AWS Data Engineer
AWS Data EngineerValueMomentum • ludhiana, punjab, in
No longer accepting applications
AWS Data Engineer

AWS Data Engineer

ValueMomentum • ludhiana, punjab, in
1 day ago
Job description

Job Title : SSE – Data Engineer

Primary Skill : Python, Pyspark Mandatory, StepFunctions, Lamda, Iceberg, Lake Formation and AWS Services and pipelines and experience in data implementation and medallion architecture.

Location : Hyderabad / Pune / Coimbatore

Experience : 4 - 8 years of experience

Mode of Work : 5 Days Work from office

Job Summary : We are looking for a Senior Data Engineer who will be responsible for building AWS Data pipelines as per requirements. Should have strong analytical skills, design capabilities, problem solving skills. Based on stakeholders’ requirements, should be able to propose solutions to the customer for review. Discuss pros / cons of different solution designs and optimization strategies.

Responsibilities :

  • Provide technical and development support to clients to build and maintain data pipelines.
  • Develop data mapping documents listing business and transformational rules.
  • Develop, unit test, deploy and maintain data pipelines.
  • Design a Storage Layer for storing tabular / semi-structured / unstructured data.
  • Design pipelines for batch / real-time processing of large data volumes.
  • Analyze source specifications and build data mapping documents.
  • Identify and document applicable non-functional code sets and reference data across insurance domains.
  • Understand profiling results and validate data quality rules.
  • Utilize data analysis tools to construct and manipulate datasets to support analyses.
  • Collaborate with and support Quality Assurance (QA) in building functional scenarios and validating results.

Requirements :

  • 5+ years’ experience developing and maintaining modern ingestion pipeline using technologies like (AWS pipelines, Lamda, Spark, Apache Nifi etc).
  • Basic understanding of the MLOPs lifecycle (Data prep ->
  • model training ->

    model deployment ->

    model inference ->

    model re-training).

  • Should be able to design data pipelines for batch / real time using Lambda, Step Functions, API Gateway, SNS, S3.
  • Must have experience in Data modernization project moving data from Legacy systems to Cloud Based Technology
  • Hands on experience on AWS Cloud and its Native components like S3, Athena, Redshift & Jupyter Notebooks.
  • Requirements Gathering - Active involvement during requirements discussions with project sponsors, defining the project scope and delivery timelines, Design & Development.
  • Strong in Spark Scala & Python pipelines (ETL & Streaming).
  • Strong experience in metadata management tools like AWS Glue.
  • Strong experience in coding with languages like Java, Python,Pyspark.
  • Good-to-have AWS Developer certified.
  • Good-to-have Postman-API and Apache Airflow or similar schedulers experience.
  • Working with cross-functional teams to meet strategic goals.
  • Experience in high volume data environments and medallion architecture.
  • Critical thinking and excellent verbal and written communication skills.
  • Strong problem-solving and analytical abilities should be able to work and deliver individually.
  • Good knowledge of data warehousing concepts.
  • Desired Skill Set : Lambda, Step Functions, API Gateway, SNS, S3 (unstructured data), DynamoDB (semi-structured data), Aurora PostgreSQL (tabular data), AWS Sagemaker, AWS CodeCommit / GitLab, AWS CodeBuild, AWS Code Pipeline, AWS ECR, SQS, Eventbridge, Cloudwatch, Splunk, Boto3, PyTest .

    Aboutthe Company :

    ValueMomentum is amongst the fastestgrowing insurance-focused IT services providersin North America.Leading insurers trust ValueMomentum with their core, digital and data transformation initiatives. Having grown consistently every year by 24%, we have now grown to over 4000 employees. ValueMomentum is committed to integrity and to ensuring that each team and employee is successful. We foster an open work culture where employees' opinions are valued. We believe in teamwork and cultivate a sense of fun, fellowship, and pride among our employees.

    Benefits :

    We at ValueMomentum offer you the opportunity to grow by working alongside the experts. Some of the benefits you can avail are :

  • Competitive compensation package comparable to the best in the industry.
  • Career Advancement : Individual Career Development, coaching and mentoring programs for professional and leadership skill development.
  • Comprehensive training and certification programs.
  • Performance Management : Goal Setting, continuous feedback and year-end appraisal. Reward & recognition for the extraordinary performers.
  • Benefits : Comprehensive health benefits, wellness and fitness programs. Paid time off and holidays.
  • Culture : A highly transparent organization with an open-door policy and a vibrant culture
  • Create a job alert for this search

    Aws Data Engineer • ludhiana, punjab, in

    Related jobs
    Sales Engineer

    Sales Engineer

    JK Fenner (India) Ltd • Ludhiana, Punjab, India
    Fenner (India) Limited is looking for a Sales Engineer - Gearbox / Gearmotor - Ludhiana.Fenner (India) Limited is a part of the renowned JK Organization. We have been an undisputed market leader in In...Show more
    Last updated: 30+ days ago • Promoted
    Electrical Engineer

    Electrical Engineer

    Evio Private Limited • Amritsar / Ludhiana Area, India
    Electrical Engineer / Project Engineer.Electrical Engineering / Diploma in Electrical Engineering.Planning and billing for electrical site works. Installation and management of.Coordinate with clien...Show more
    Last updated: 20 days ago • Promoted
    Senior Software Engineer

    Senior Software Engineer

    Programmers.io • ludhiana, punjab, in
    Senior AI-Integrated Software Engineer (.Remote until office reopens, Work from Home.We are looking for a dynamic and innovative. The ideal candidate will bring hands-on experience in AI-assisted de...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer (Python, React)

    Senior Software Engineer (Python, React)

    Better Software • ludhiana, punjab, in
    Better Software is a product development studio that partners with entrepreneurs and enterprises to launch new initiatives. Many of these products evolve into large-scale systems, and we act as long...Show more
    Last updated: 30+ days ago • Promoted
    Senior SQL Developer

    Senior SQL Developer

    Programmers.io • ludhiana, punjab, in
    Job Title : Senior SQL Developer.Shift Timings : 2 : 30 PM - 11 : 30 PM IST.Location : Remote, India, Work from Home.Experience Required : 7 - 13 Years. Design, develop, and maintain SQL Server database...Show more
    Last updated: 27 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    CXC • ludhiana, India
    Please apply only if you are available to work in Australian time zone and comfortable with 6 months contract duration • •. We’re seeking a highly skilled and autonomous.Power BI implementations to jo...Show more
    Last updated: 2 days ago • Promoted
    Senior Java Software Engineer

    Senior Java Software Engineer

    ACL Digital • ludhiana, punjab, in
    Responsible for designing and building backend system.Focus on scalable APIs, workflow frameworks, and automation platforms that improve customer and agent experiences. Acts as a strong individual c...Show more
    Last updated: 30+ days ago • Promoted
    Senior AWS Cloud Engineer

    Senior AWS Cloud Engineer

    9NEXUS • ludhiana, India
    Job Title : Senior Cloud Engineer (Data Platform).Seeking an experienced Cloud Engineer to support Data Platform function by enabling feature teams with secure, scalable, and reusable AWS infrastruc...Show more
    Last updated: 1 day ago • Promoted
    Freelance Data Quality Engineer

    Freelance Data Quality Engineer

    Leading MNC • ludhiana, India
    Freelance Data Quality Engineer.The candidate should have a minimum of 8+ yrs.If you're looking for freelance / part time opportunity (along with your day job) & a chance to work with the top 0.You ...Show more
    Last updated: 12 days ago • Promoted
    Quality Assurance Manager

    Quality Assurance Manager

    Gursimar pharma pvt ltd • Ludhiana, Punjab, India
    Job Description : Quality Assurance Manager.Greenfield – Facility under setup (WHO-GMP compliant).You will lead the establishment of the entire QA framework for a new pharmaceutical formulation manu...Show more
    Last updated: 16 days ago • Promoted
    Sr. Azure Data Architect & Presales Solution

    Sr. Azure Data Architect & Presales Solution

    Programmers.io • ludhiana, punjab, in
    Job Title : Azure Data Architect.Location : Hyderabad, Pune, Jaipur.Experience required : 12+ years.We are seeking a highly experienced. The ideal candidate should bring strong expertise in SQL, ETL / EL...Show more
    Last updated: 22 days ago • Promoted
    Data Engineer

    Data Engineer

    TerraGiG • ludhiana, India
    Lead the design, development, and implementation of data solutions using AWS and Snowflake.Collaborate with cross-functional teams to understand business requirements and translate them into techni...Show more
    Last updated: 2 days ago • Promoted
    Sales Executive

    Sales Executive

    Coats • Ludhiana, Punjab, India
    Coats is a world leader in thread manufacturing and structural components for apparel and footwear, as well as an innovative pioneer in performance materials. These critical solutions are used to cr...Show more
    Last updated: 13 days ago • Promoted
    Graphic Designer (UI / UX)

    Graphic Designer (UI / UX)

    Drake Software Services • Ludhiana, Punjab, India
    Opening for Graphics designer - UI / UX to conceptualise and create the graphical user interface and the related graphics for software applications running on any of the Mobile, Desktop, or Web-based...Show more
    Last updated: 30+ days ago • Promoted
    Full Stack Engineer

    Full Stack Engineer

    Programmers.io • ludhiana, punjab, in
    We are seeking highly skilled Senior.Laravel and modern frontend frameworks (Vue.The candidate should have deep technical expertise, leadership ability, and experience architecting scalable web sol...Show more
    Last updated: 18 days ago • Promoted
    Big Data Engineer

    Big Data Engineer

    K&K Talents - India • ludhiana, India
    This position is with one of our.Title : Big Data Engineer (Scala & Spark).Required Experience : 8 Years and above.We are seeking a highly skilled. Azure cloud, Big Data technologies, and distributed ...Show more
    Last updated: 1 day ago • Promoted
    SALES HEAD (BUYING HOUSE)

    SALES HEAD (BUYING HOUSE)

    Square Corporation • Ludhiana, Punjab, India
    Textiles / Spinning / Yarn Manufacturing.Square Corporation is seeking an experienced and results-driven person to sell, manage and. India, Bangladesh and Sri-Lanka.Be part of a fast-growing textile...Show more
    Last updated: 2 days ago • Promoted
    Generative AI Engineer

    Generative AI Engineer

    Turing • ludhiana, punjab, in
    Turing is looking for people with LLM experience to join us in solving business problems for our Fortune 500 customers.You will be a key member of the Turing GenAI delivery organization and part of...Show more
    Last updated: 25 days ago • Promoted