Talent.com
AWS Data Pipeline Engineer
AWS Data Pipeline EngineerTata Consultancy Services • Pune, Republic Of India, IN
AWS Data Pipeline Engineer

AWS Data Pipeline Engineer

Tata Consultancy Services • Pune, Republic Of India, IN
19 days ago
Job description

Role AWS Data Engineer

Required Technical Skill Set AWS Redshift, Glue, PySpark

Desired Experience Range 4-10 Years

Location of Requirement Chennai / Pune

Desired Competencies (Technical / Behavioral Competency)

Must-Have

  • Strong hands-on experience in Python programming and PySpark
  • Experience using AWS services (RedShift, Glue, EMR, S3 & Lambda)
  • Experience working with Apache Spark and Hadoop ecosystem.
  • Experience in writing and optimizing SQL for data manipulations
  • Good Exposure to scheduling tools. Airflow is preferable.
  • Must Have Data Warehouse Experience with AWS Redshift or Hive
  • Experience in implementing security measures for data protection.
  • Expertise to build / test complex data pipelines for ETL processes (batch and near real time)
  • Readable documentation of all the components being developed.
  • Knowledge of Database technologies for OLTP and OLAP workloads

Good-to-Have

  • Good understanding of Data warehouse and Data Lakes
  • Familiarize ETL tools like Netezza or Informatica.
  • Experience working with NoSQL databases like DynamoDB or MongoDB.
  • Good to have exposure to AWS services (Step Functions, Athena)
  • Data Modelling exposure
  • Familiarity with Investment Banking domain
  • Create a job alert for this search

    Data Pipeline Engineer • Pune, Republic Of India, IN

    Related jobs
    Data Engineer

    Data Engineer

    TerraGiG • India, India
    Lead the design, development, and implementation of data solutions using AWS and Snowflake.Collaborate with cross-functional teams to understand business requirements and translate them into techni...Show more
    Last updated: 4 days ago • Promoted
    Data Engineer

    Data Engineer

    Staffingine LLC • India, India
    The Data Engineer will be responsible for designing, developing, and optimizing scalable data pipelines and cloud-based data solutions. This role requires strong Python programming skills, expertise...Show more
    Last updated: 7 days ago • Promoted
    Azure Data Pipeline Engineer

    Azure Data Pipeline Engineer

    MRF • Chennai, Republic Of India, IN
    Azure / SQL / Application - Data Engineer.Responsible to maintain the data required for managed application like Advanced Planning System, Dealer Management System, etc. Responsible for user access mana...Show more
    Last updated: 3 days ago • Promoted
    Aws Data Engineer

    Aws Data Engineer

    Tata Consultancy Services • Pune, Republic Of India, IN
    Required Technical Skill Set AWS Redshift, Glue, PySpark.Desired Experience Range 4-10 Years.Location of Requirement Chennai / Pune. Desired Competencies (Technical / Behavioral Competency).Must-Have -...Show more
    Last updated: 30+ days ago • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Adastra • India, India
    We are looking for a proactive and solution-oriented GCP Data Engineer to join our team.This role requires hands-on experience in Google Cloud Platform (GCP), especially with BigQuery and Airflow, ...Show more
    Last updated: 17 days ago • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    Impetus • Chennai, Republic Of India, IN
    Impetus Technologies is a digital engineering company focused on delivering expert services and products to help enterprises achieve their transformation goals. We solve the analytics, AI, and cloud...Show more
    Last updated: 2 days ago • Promoted
    Data Engineer

    Data Engineer

    IntraEdge • India, India
    We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show more
    Last updated: 30+ days ago • Promoted
    AWS Data Architect

    AWS Data Architect

    ACL Digital • India, India
    AWS (S3, Redshift, Glue, Lake Formation, IAM).Proficient in data modeling, performance tuning, and security best practices. .AWS Certified Solutions Architect preferred.Show more
    Last updated: 21 days ago • Promoted
    AWS Data Pipeline Engineer

    AWS Data Pipeline Engineer

    Response Informatics • Pune, Republic Of India, IN
    Designation : AWS Data Engineer.Skill Tech stack : AWS Data Engineer, Python, Pyspark, SQL, Data Pipeline, AWS, AWS Glue, lambda. Notice Period – Immediate to 4 week Joiner only (Don’t submit more th...Show more
    Last updated: 3 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Ironbook AI • India, India
    We are seeking an experienced and driven Lead Data Engineer to spearhead the.AI use cases across the organization.Minimum 7 years of experience in data engineering, with at.Strong hands-on experien...Show more
    Last updated: 22 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    Tata Consultancy Services • India
    TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Pipeline Engineer (GCP)

    Lead Data Pipeline Engineer (GCP)

    AuxoAI • Republic Of India, IN
    AuxoAI is seeking a Senior Data Engineer to lead the design, development, and optimization of modern data pipelines and cloud-native platforms using Google Cloud Platform (GCP).This role is ideal f...Show more
    Last updated: 3 days ago • Promoted
    Lead Data Pipeline Engineer

    Lead Data Pipeline Engineer

    Ironbook AI • Republic Of India, IN
    The ideal candidate will have strong experience with cloud platforms, modern ETL / ELT tools, and deep technical skills in Python, SQL, and distributed data frameworks. Design, develop, and maintain s...Show more
    Last updated: 19 hours ago • Promoted • New!
    AWS Engineer

    AWS Engineer

    Trigent Software Private Limited • India, KA, India
    Quick Apply
    BDC7B Summary : As a Data Platform Engineer, you will assist with the data platform blueprint and design, encompassing the relevant data platform components. Your typical day will involve collaborati...Show more
    Last updated: 5 days ago
    AWS Engineer

    AWS Engineer

    Spryc Systems • India, India
    We are seeking an experienced AWS Engineer to design, implement, and maintain AWS infrastructure and services in a managed service environment. The ideal candidate will possess deep expertise in AWS...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Ironbook AI • India, India
    The ideal candidate will have strong experience with cloud platforms, modern ETL / ELT tools, and deep technical skills in Python, SQL, and distributed data frameworks. Design, develop, and maintain s...Show more
    Last updated: 22 hours ago • Promoted • New!
    GCP Data Engineer

    GCP Data Engineer

    PamTen Inc • India, India
    You will work ongoing support activities and support project efforts as needed.You triage identified issues across Account source platforms, integrations and Customer Data Hub.You will analyze and ...Show more
    Last updated: 23 days ago • Promoted
    AI Data Engineer

    AI Data Engineer

    Turing • India, India
    We’re looking for experienced AI data engineers skilled in Python to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improve how AI models ...Show more
    Last updated: 2 days ago • Promoted