Talent.com
This job offer is not available in your country.
AWS Data Engineer - ETL

AWS Data Engineer - ETL

FirstcareercentreBangalore
30+ days ago
Job description

Job Summary :

We are seeking a highly skilled and experienced AWS Data Engineer to join our data team. The AWS Data Engineer will be responsible for designing, developing, and optimizing data pipelines, integrating various data sources, and implementing AWS cloud solutions. The ideal candidate should have a strong background in data engineering, cloud platforms (specifically AWS), and big data technologies.

Key Responsibilities :

Data Pipeline Development :

  • Design, build, and maintain scalable ETL pipelines using AWS services (e.g., Glue, Lambda, S3, Redshift, etc.).
  • Integrate data from multiple heterogeneous data sources into a data warehouse or data lake.
  • Optimize existing data pipelines for performance, reliability, and cost-effectiveness.

Cloud Infrastructure :

  • Manage and configure AWS services such as EC2, RDS, S3, Glue, Athena, Lambda, Redshift, and EMR.
  • Automate infrastructure provisioning using tools like CloudFormation or Terraform.
  • Ensure data security and compliance with AWS best practices (IAM roles, encryption, VPC).
  • Data Warehousing and Storage :

  • Design and implement scalable data warehousing solutions using Amazon Redshift, Snowflake, or other technologies.
  • Manage data storage in Amazon S3, ensuring efficient and cost-effective storage architectures (partitioning, compression).
  • Implement data versioning and backup strategies.
  • Data Modeling and Optimization :

  • Perform data modeling and schema design to support data warehouses and reporting systems.
  • Optimize SQL queries and database performance.
  • Implement data governance and quality control procedures (e.g., monitoring, alerting).
  • Collaboration :

  • Work closely with data scientists, analysts, and stakeholders to understand data needs.
  • Collaborate with DevOps and engineering teams to ensure the smooth operation of data infrastructure.
  • Monitoring & Reporting :

  • Set up monitoring for ETL pipelines and cloud infrastructure (CloudWatch, X-Ray, etc.).
  • Provide regular reports on data pipeline performance and optimize for continuous improvement.
  • Required Qualifications :

  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • 3+ years of experience in data engineering roles, with significant exposure to AWS services.
  • Strong proficiency in AWS services such as Glue, Redshift, S3, Lambda, and RDS.
  • Experience with big data tools such as Spark, Hadoop, or EMR.
  • Hands-on experience with ETL tools and techniques.
  • Proficiency in SQL and experience in data modeling and database performance tuning.
  • Knowledge of scripting languages such as Python or Scala.
  • Experience with CI / CD pipelines and infrastructure as code tools like Terraform or CloudFormation.
  • Familiarity with data formats such as Parquet, Avro, and JSON.
  • Experience in data warehousing solutions (Redshift, Snowflake, etc.).
  • Preferred Qualifications :

  • AWS certifications like AWS Certified Data Analytics - Specialty or AWS Certified Solutions Architect.
  • Knowledge of NoSQL databases like DynamoDB or MongoDB.
  • Experience with DevOps and container orchestration tools (e.g., Docker, Kubernetes).
  • Familiarity with machine learning or data science tools on AWS (e.g., SageMaker).
  • Experience in real-time data processing (e.g., using Kinesis or Kafka).
  • Soft Skills :

  • Strong problem-solving skills and ability to work in a fast-paced environment.
  • Excellent communication and teamwork skills.
  • Ability to multitask and manage multiple priorities effectively.
  • ref : hirist.tech)

    Create a job alert for this search

    Data Engineer Etl • Bangalore

    Related jobs
    • Promoted
    AWS Data Engineer - ETL / Amazon Athena

    AWS Data Engineer - ETL / Amazon Athena

    DeqodeBangalore
    Hiring : AWS Data Engineer Experience : 5-7 Years Experience | Hybrid | Bengaluru, Pune, Chennai, Mumbai, Gurugram &...Show moreLast updated: 30+ days ago
    • Promoted
    Senior AWS Data Engineer - Python / ETL

    Senior AWS Data Engineer - Python / ETL

    JavinBangalore
    Job Description : Responsibilities : - Design, develop, and maintain scalable data pipelines and ETL processes on AWS.Collabor...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer - ETL

    Data Engineer - ETL

    Edge in Asia Recruitment Private LimitedBangalore
    Our client is a leading global financial services firm providing a wide range of investment banking, securities, investment management and wealth management services. The ideal professional will be ...Show moreLast updated: 6 days ago
    Data ETL Engineer

    Data ETL Engineer

    IDTBangalore, Other, ,
    Quick Apply
    This is a full-time work from home opportunity for a star BI data engineer from India.Today it is an industry leader in prepaid communication and payment services and one of the world’s largest int...Show moreLast updated: 25 days ago
    • Promoted
    AWS Data Engineer - Python / SQL / ETL

    AWS Data Engineer - Python / SQL / ETL

    Majoris Technologies Pvt LtdBangalore
    Role : AWS Data Engineer Job Description : We are looking for an experienced AW...Show moreLast updated: 25 days ago
    • Promoted
    DBiz.ai - Senior AWS Data Engineer - ETL / Data Warehousing

    DBiz.ai - Senior AWS Data Engineer - ETL / Data Warehousing

    DBIZ AI SOLUTIONS PRIVATE LIMITEDBangalore
    Job Description : Experienced Senior Data Engineer (8+ Yrs) with deep expertise in AWS cloud Data services, particularly AWS Glue, to design, build, ...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer - ETL

    Data Engineer - ETL

    UppalBangalore
    We are seeking a talented and experienced Data Engineer with strong skills in Python, PySpark, SQL, and SparkSQL to join our growing data engineering team. The ideal candidate will have a deep under...Show moreLast updated: 30+ days ago
    • Promoted
    Perficient - Data Engineer - ETL / AWS

    Perficient - Data Engineer - ETL / AWS

    Perficient India Private LimitedBangalore
    Key Responsibilities : - Design, build, and maintain scalable ETL pipelines and data workflows using AWS Glue, Spark, a...Show moreLast updated: 27 days ago
    • Promoted
    AWS Data Engineer - ETL / PySpark / Python

    AWS Data Engineer - ETL / PySpark / Python

    ChangeleadersBangalore
    Position : AWS Data Engineer Experience : 5+ Yrs Location : Bangalore, Hyderabad, Chennai, Pune, Gurgaon <...Show moreLast updated: 14 days ago
    • Promoted
    Data Architect - AWS / ETL Migration

    Data Architect - AWS / ETL Migration

    FutureSoft India Pvt LtdBangalore
    Job Title : Data Architect AWS Cloud & ETL Migration Job Summary : We are looking for a highly skilled and experienced Dat...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer – ETL

    Data Engineer – ETL

    Demand AIBangalore, IN
    ETL development and data engineering.Looking for a Data Engineer specializing in ETL processes to design and implement data pipelines that support data integration and analytics initiatives.Design,...Show moreLast updated: 20 days ago
    • Promoted
    • New!
    Data Engineer - ETL

    Data Engineer - ETL

    First Phoenics SolutionsBangalore
    Job Title : Data Engineer Location : Hyderabad / Bengaluru Experience : <...Show moreLast updated: 5 hours ago
    • Promoted
    Data Engineer - ETL

    Data Engineer - ETL

    Grizmo Labs Private LimitedBangalore
    Responsibilities : - Design, develop, and maintain scalable data pipelines and ETL processes to handle large volumes of data efficiently. Ensure data integrity and rel...Show moreLast updated: 27 days ago
    • Promoted
    AWS Data Engineer - Python / ETL / SQL

    AWS Data Engineer - Python / ETL / SQL

    Voyager PartnersBangalore
    Role : AWS Data Engineer.Experience : 7+ Years.Notice Period : Immediate to 15 days.Location : Mumbai ,Ahmedabad, Bangalore. Key Responsibilities : < / b...Show moreLast updated: 25 days ago
    • Promoted
    Data Engineer - ETL

    Data Engineer - ETL

    GetHyrBangalore
    Location : Bangalore JD Title : Data : - Create prototypes and proof-of-concepts for iterative development....Show moreLast updated: 18 days ago
    • Promoted
    Data Engineer - ETL

    Data Engineer - ETL

    Microgreen Technologies Pvt. LtdBangalore
    Data Engineer (ETL Specialist) Location : Bangalore (Local Candidates Only) Experience : 5 - 7 YearsShow moreLast updated: 4 days ago
    • Promoted
    Data Engineer - ETL / Python

    Data Engineer - ETL / Python

    XHire.OneBangalore
    Responsibilities : - As a Data Engineer you will be a key operational and hands-on engineer delivering business tenancies as part of the data platform strategy execution across...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer - ETL / AWS SageMaker

    Senior Data Engineer - ETL / AWS SageMaker

    VIDPRO CONSULTANCY SERVICESBangalore
    About The Role Cloud Expertise : Strong experience with AWS, including services like S3, Glue, Lambda, and SageMaker.We are currently seeking a Senior Data Engineer t...Show moreLast updated: 30+ days ago