Talent.com
This job offer is not available in your country.
Data Engineer(AWS,S3, Datalake, AWS Glue, Lambda, RMR,"Python", Pyspark Engineer)

Data Engineer(AWS,S3, Datalake, AWS Glue, Lambda, RMR,"Python", Pyspark Engineer)

Tata Consultancy ServicesBengaluru, Karnataka, India
13 hours ago
Job description

Job Description

SN

Required Information

Details

Role

AWS Data Engineer

Required Technical Skill Set

AWS

Desired Experience Range

4-6 yrs.

Location of Requirement

Pune

Desired Competencies (Technical / Behavioral Competency)

Must-Have

  • Should have expertise in creating data warehouses in AWS utilizing the following tools : EC2, S3, EMR, Athena, Sagemaker, Aurora and Snowflake., Kafka, Kinesis, Glue, Lambda, DMS, AppFlow, PowerBI
  • Advanced development experience in cloud technologies such as AWS Aurora / RDS / S3, Lambda, JSON, Python
  • Proficiency in scripting, querying, and / or analytics tools : Linux, python, SQL (already covered in description)

Analyze, re-architect and re-platform on premise / cloud data sources to AWS platform using AWS Glue.

  • Design, build and automate AWS data pipelines from ingestion of data into consumption layer using Java / Python
  • Good-to-Have

  • Basic knowledge in Redhat Linux and Windows Operating Systems
  • Good at Console and the AWS CLI and APIs
  • Knowledge of writing infrastructure as code (IaC) using CloudFormation or Terraform.
  • AWS API's for integration
  • SN

    Role descriptions / Expectations from the Role

    Ability to understand and articulate the different functions within AWS and design appropriate solution, HLD, LLD around it.

    Ability to identify and gather requirements to define a solution to be built and operated on AWS, perform high level and low-level design.

    AWS Data Engineer will be responsible for building the services as per the design

    Create a job alert for this search

    Data • Bengaluru, Karnataka, India

    Related jobs
    • Promoted
    • New!
    AWS Data Engineer - SSE

    AWS Data Engineer - SSE

    CGIbangalore, India
    We are seeking a skilled and motivated AWS Data Engineer with hands-on experience in building and managing data pipelines using AWS Glue, S3, and Athena. The ideal candidate will have a strong backg...Show moreLast updated: 14 hours ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    L&T Technology ServicesBengaluru, Karnataka, India
    Graduate with 8-10 years of experience working as a AWS Data Engineer.Excellent knowledge of PySpark, JavaScript, AWS - RDS, and Redshift.Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    AWS Data Engineer

    AWS Data Engineer

    White Forcebangalore, India
    Proficiency in Python, SQL, and PySpark.Strong knowledge of Big Data ecosystems, including Hadoop, Hive, Sqoop, HDFS, and HBase. Expertise in the Spark ecosystem : Spark Core, Spark Streaming, Spark ...Show moreLast updated: 14 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Bahwan CyberTekBengaluru, Karnataka, India
    We are seeking a skilled and motivated Data Engineer with 5–8 years of experience in building scalable data pipelines using Python, PySpark, and AWS services. The ideal candidate will have hands-on ...Show moreLast updated: 1 day ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy ServicesBengaluru, Karnataka, India
    Greetings from TATA Consultancy Services.Pls find the Job Description below.Hands-on experience in Pyspark, Glue.Experience on EMR, S3, IAM, Lambda, Cloud formation, Python.AMI Rehydration, Python,...Show moreLast updated: 30+ days ago
    • Promoted
    TCS Hiring for AWS Senior Data Engineer with Pyspark, AWS, Glue_Bangalore

    TCS Hiring for AWS Senior Data Engineer with Pyspark, AWS, Glue_Bangalore

    Tata Consultancy ServicesBengaluru, Karnataka, India
    Job Title : AWS Senior Data Engineer with Pyspark, AWS, Glue.PySpark, AWS[ETL Concepts, S3, Glue, EMR, Redshift, DMS, AppFlow] ,Qlik Replicate, Data Testing. Hadoop, Teradata Background, IaC[Cloud Fo...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Software Engineer III - AWS Data Engineer

    Software Engineer III - AWS Data Engineer

    JPMorgan Chase & Co.bangalore, India
    Job Title : Senior AWS Data Engineer.We are seeking an experienced and highly skilled Senior AWS Data Engineer with over 10 years of experience to join our dynamic team. The ideal candidate will have...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    Data Engineer (Azure + AWS)

    Data Engineer (Azure + AWS)

    VidPro Consultancy Servicesbangalore, India
    We are seeking a highly skilled and motivated Data Engineer to join our dynamic team.You will be responsible for designing, implementing, and maintaining data pipelines to.Proficiency in Python pro...Show moreLast updated: 14 hours ago
    • Promoted
    AWS Data engineer / Architect

    AWS Data engineer / Architect

    Tata Consultancy ServicesBengaluru, Karnataka, India
    In this key leadership role, you will lead the development of foundational components for a Lakehouse architecture on AWS and drive the migration of existing data processing workflows to the new La...Show moreLast updated: 20 days ago
    • Promoted
    AWS Data Engineer- Sagemaker

    AWS Data Engineer- Sagemaker

    YASH TechnologiesBengaluru, Karnataka, India
    AWS Sagemaker, Power BI & Python.Any ETL Tool, Github, DevOPs(CI-CD).Python, PySpark , SQL, AWS with Designing, developing, testing and supporting data pipelines and applications.Strong understandi...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    AWS Data Engineer

    AWS Data Engineer

    Talent Worxbangalore, India
    We are seeking experienced AWS Data Engineers to design, implement, and maintain robust data pipelines and analytics solutions using AWS services. The ideal candidate will have a strong background i...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    AWS Data engineer

    AWS Data engineer

    Anicalls (Pty) Ltdbangalore, India
    Clear, concise communication abilities - writing, verbal, presentation - to all levels of technical and non-technical audiences with the ability to collaborate. Strong experience in CICD technologie...Show moreLast updated: 14 hours ago
    • Promoted
    AWS Data Engineer for Bangalore

    AWS Data Engineer for Bangalore

    DeloitteBengaluru, Karnataka, India
    Looking for Skilled AWS Data Engineer, Interested candidates please find the JD below : .Bachelor’s Degree and 3+ years’ experience in the implementation of modern data ecosystems in AWS / Cloud platfo...Show moreLast updated: 9 days ago
    • Promoted
    • New!
    Tech Lead - AWS Data Engineer Job

    Tech Lead - AWS Data Engineer Job

    YASH Technologiesbangalore, India
    Understanding the current business functionalities of the ETL processes and identifying areas for improvement.Designing and building AWS Glue workflows to replace existing ETL processes.Standardizi...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    AWS / Azure Data Engineer

    AWS / Azure Data Engineer

    Axiom Software Solutions Limitedbangalore, India
    Design, implement, and manage scalable ETL / ELT pipelines using AWS services and Databricks.Ingest and process structured, semi-structured, and unstructured data from multiple sources into AWS Data ...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    Lead Consultant - AWS Data Engineer

    Lead Consultant - AWS Data Engineer

    Genpactbangalore, India
    Ready to build the future with AI? .At Genpact, we don’t just keep up with technology—we set the pace.AI and digital innovation are redefining industries, and we’re leading the charge.Genpact’s AI ...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    AWS Data Engineer

    AWS Data Engineer

    Trigent Software Private Limitedbangalore, India
    As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams ...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    Sr. Data Engineer - AWS+Python+Pyspark Job

    Sr. Data Engineer - AWS+Python+Pyspark Job

    YASH Technologiesbangalore, India
    YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences,...Show moreLast updated: 14 hours ago
    • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    TEKsystemsbangalore, karnataka, in
    Your skills & Your Experience Experience.Analytics and Data Warehousing.Experience in building end-to-end solutions with the Big data platform, Spark or scala programming.Solid experience in ETL pi...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Innodata Inc.hosur, tamil nadu, in
    CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 26 days ago