Talent.com
AWS + Pyspark

AWS + Pyspark

ConfidentialChennai
2 days ago
Job description
  • Data Pipeline Development : Design, implement, and maintain scalable data pipelines using AWS services such as S3, Glue, Lambda, EMR, and Kinesis.
  • Data Processing and Transformation : Utilize PySpark, Spark, and SQL to perform complex data transformations and aggregations on large datasets within the AWS ecosystem.
  • Data Storage and Management : Design and implement data storage solutions using Amazon S3, RDS, DynamoDB, and Redshift, ensuring data quality, integrity, and accessibility.
  • Data Modeling and Warehousing : Develop and maintain data models to support analytics and reporting, leveraging Redshift as the data warehousing solution.
  • Infrastructure and Cloud Technologies : Provision and manage scalable data infrastructure using EC2, VPC, IAM, CloudFormation, and other relevant AWS services.
  • Performance Optimization and Monitoring : Continuously monitor and optimize data pipelines and systems using CloudWatch, identifying and resolving performance bottlenecks.
  • Collaboration and Knowledge Sharing : Work closely with data scientists, analysts, and other stakeholders to understand data requirements and provide technical guidance.

    • Qualifications :

    • Proficiency in Python, SQL, PySpark, and Spark.
    • Strong expertise in AWS data services (S3, Glue, Lambda, EMR, Redshift, DynamoDB, RDS).
    • Experience with data warehousing, ETL processes, and data modeling.
    • Excellent problem-solving, analytical, and communication skills.

      • Skills Required

      Amazon Redshift, Pyspark, Cloud Services, Dynamo Db, glue

    Create a job alert for this search

    Pyspark • Chennai

    Related jobs
    • Promoted
    • New!
    AWS Glue

    AWS Glue

    HCLTechChennai, Tamil Nadu, India
    Develop and maintain data models and transformations using DBT.Load and manage data in Snowflake, including staging and curated layers. Implement data ingestion processes from various sources using ...Show moreLast updated: 21 hours ago
    • Promoted
    Solinas - DevOps Lead - AWS / Google Cloud Platform

    Solinas - DevOps Lead - AWS / Google Cloud Platform

    Solinas Integrity Pvt. Ltd.Chennai
    Description : As a DevOps Lead, you will spearhead our DevOps initiatives and drive the efficiency and reliab...Show moreLast updated: 16 days ago
    • Promoted
    Cloud Engineer III - AWS / DevOps

    Cloud Engineer III - AWS / DevOps

    h3 Technologies, LLCChennai
    Designation name : Cloud Engineer III.PM IST UK based Shift timings.Looking for Immediate Joiners only.Job Purpose : AWS Engineer with strong technical leadership, ha...Show moreLast updated: 30+ days ago
    • Promoted
    Valuebound - AWS Cloud Architect

    Valuebound - AWS Cloud Architect

    ValueboundChennai
    Key Responsibilities : - Design and architect enterprise workloads on AWS, ensuring scalability, performance, and security.Develo...Show moreLast updated: 16 days ago
    • Promoted
    • New!
    AWS DevOps Engineer - IAC Terraform

    AWS DevOps Engineer - IAC Terraform

    SGS & CoChennai
    Job Summary : We are seeking a full-time remote AWS DevOps Engineer to join our team from any location in india.The AWS DevOps Engineer will be responsible fo...Show moreLast updated: 14 hours ago
    • Promoted
    AWS Engineer

    AWS Engineer

    Spryc SystemsChennai, IN
    We are seeking an experienced AWS Engineer to design, implement, and maintain AWS infrastructure and services in a managed service environment. The ideal candidate will possess deep expertise in AWS...Show moreLast updated: 18 days ago
    • Promoted
    AWS Senior Data Engineer

    AWS Senior Data Engineer

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    TCS is Hiring of AWS Senior Data Engineer Experience : 5 - 10 Yrs Location : Chennai Mode of Interview : Virtual Technical Skill Set - 10 + years of Overall experience in AWS Cloud Technologies -...Show moreLast updated: 6 days ago
    • Promoted
    AWS DevOps Engineer

    AWS DevOps Engineer

    h3 Technologies, LLCChennai
    Experience - 10+ Years.Designation name : Cloud Engineer III.PM - IST - UK based Shift timings.Looking for Immediate Joiners only.Job Purpose : A...Show moreLast updated: 30+ days ago
    • Promoted
    Team Lead - AWS / Azure / GCP

    Team Lead - AWS / Azure / GCP

    Soft Suave Technologies Private LimitedChennai
    Job Description : - Lead the development and implementation of secure, scalable, and cost-effective cloud architectures, especially on AWS,...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Cloud DevOps Lead

    AWS Cloud DevOps Lead

    Luxoft IndiaChennai, Tamil Nadu, India
    We're seeking a solid and creative AWS Cloud DevOps eager to solve scale problems and work on cutting-edge and open-source technologies. In this project, you will have the opportunity to write code ...Show moreLast updated: 11 days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy Serviceschennai, tamil nadu, in
    TCS is Hiring AWS Data Engineer Bangalore location.Strong hands-on experience in Python programming and PySpark.Experience using AWS services (RedShift, Glue, EMR, S3 & Lambda).Experience working w...Show moreLast updated: 30+ days ago
    • Promoted
    DevOps Engineer - AWS / Generative AI

    DevOps Engineer - AWS / Generative AI

    INSIGHT INDChennai
    Description : Role : DevOps - AWS GenAI Engineer Location : Chennai (WFO) ...Show moreLast updated: 23 days ago
    • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    CYAN360Chennai, IN
    Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
    • Promoted
    AWS devops engineer

    AWS devops engineer

    techifyappschennai, tamil nadu, in
    We are looking for a skilled AWS DevOps Engineer to join our growing engineering team.The ideal candidate should have strong hands-on experience in designing CI / CD pipelines, containerized deployme...Show moreLast updated: 2 days ago
    • Promoted
    • New!
    AWS Data Engineer

    AWS Data Engineer

    COVET IT INCchennai, tamil nadu, in
    Please go through the below requirements and let me know your interest and forward your resume along with your contact information to raja@covetitinc. We are seeking a highly skilled AWS Data Engine...Show moreLast updated: 22 hours ago
    • Promoted
    AWS DevOps Engineer - CI / CD Pipeline

    AWS DevOps Engineer - CI / CD Pipeline

    TRDFIN SUPPORT SERVICES PRIVATE LIMITEDChennai
    Job Description : We are looking for a highly skilled AWS DevOps Engineer with strong expertise in building, automating, and managing cloud...Show moreLast updated: 30+ days ago
    • Promoted
    Metayb - DevOps Engineer - AWS Platform

    Metayb - DevOps Engineer - AWS Platform

    MetaybChennai
    Skill Map : DevOps Role Description : Creates DevOps Pipeline for Various aspects of Delivery related to Model Implementation<...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Cloud Engineer

    AWS Cloud Engineer

    ProgliteChennai, IN
    Infrastructure & System Administration : .Deploy, manage, and optimize EC2 instances across dev, test, and production environments. Perform system administration and troubleshooting for Linux and Wind...Show moreLast updated: 30+ days ago