Talent.com
AWS Big Data Engineer / Architect - Hadoop / Hive

AWS Big Data Engineer / Architect - Hadoop / Hive

Coders Brain Technology Private LimitedBangalore
30+ days ago
Job description

About the Role :

We are looking for an experienced AWS Big Data Engineer & Architect to design, implement, and manage large-scale data platforms on AWS. The ideal candidate will have strong expertise in Big Data technologies, cloud-native architecture, and hands-on experience building scalable, secure, and high-performance data solutions.

Key Responsibilities :

  • Technical Architecture & Engineering
  • Design and implement end-to-end Big Data solutions on AWS, including data lakes, data warehouses, and streaming pipelines.
  • Develop ETL / ELT pipelines for batch and real-time processing.
  • Optimize data storage, processing, and querying for performance and cost efficiency.
  • Define data modeling, metadata management, and governance standards.
  • Ensure security, compliance, and high availability of all data solutions.
  • Prepare architecture diagrams, design documents, and technical blueprints for stakeholders.

Leadership & Collaboration :

  • Mentor and guide a team of Big Data engineers.
  • Collaborate with architects, data scientists, and business stakeholders to deliver data-driven solutions.
  • Evaluate emerging technologies and recommend innovative solutions to support business growth.
  • Mandatory Skills :

  • Strong experience in AWS Services : S3, Glue, Redshift, EMR, Athena, Kinesis, Lambda, DynamoDB.
  • Proficiency with Big Data frameworks : Spark, Hadoop, Hive, Kafka.
  • Programming skills in Python, SQL, and Java / Scala.
  • Expertise in data lake & data warehouse architecture, ETL / ELT pipelines, and data modeling.
  • Knowledge of security, IAM, encryption, VPC design, and compliance frameworks (GDPR / HIPAA).
  • Strong experience in solution architecture, system design, and integration.
  • Leadership skills mentoring teams and managing stakeholders.
  • AWS Certifications preferred (Solutions Architect Professional, Big Data Specialty).
  • (ref : hirist.tech)

    Create a job alert for this search

    Data • Bangalore

    Related jobs
    • Promoted
    • New!
    Senior Data Engineer - Hadoop

    Senior Data Engineer - Hadoop

    Nazztec Private LimitedBangalore
    Job Title : Senior Data Engineer Hadoop Location : Bangalore Employment Type : Full-time | OnsiteShow moreLast updated: 22 hours ago
    • Promoted
    Aptus Data Labs - Enterprise Data Architect - AWS

    Aptus Data Labs - Enterprise Data Architect - AWS

    Aptus Data LabsBangalore
    Job Title : Enterprise Data Architect (AWS) Experience : 12+ years Location : Bangalore Show moreLast updated: 2 days ago
    • Promoted
    AWS Data Architect- Leadership

    AWS Data Architect- Leadership

    QuantiphiBengaluru, Karnataka, India
    AWS Data Architect- Leadership.We are seeking a highly skilled and experienced Technical Leader for our AWS Data Engineering practice. The ideal candidate will be responsible for driving Data Engine...Show moreLast updated: 30+ days ago
    • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    CYAN360Bangalore, IN
    Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
    • Promoted
    GCP Data Architect

    GCP Data Architect

    Tata Consultancy Serviceshosur, tamil nadu, in
    Job Title : - GCP Data Architect.Design and Implement Data Architectures : Architect and build scalable, end-to-end data solutions on GCP, encompassing data ingestion, transformation, storage, and co...Show moreLast updated: 16 days ago
    • Promoted
    Big Data Engineer - Hadoop / Spark / Hive

    Big Data Engineer - Hadoop / Spark / Hive

    True TalentsBangalore
    Job Title : Big Data Engineer Location : Bangalore / Pune Employment Type : Full Time ...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Big Lead Data Engineer

    AWS Big Lead Data Engineer

    Coders Brain Technology Private LimitedBangalore
    About the Role : We are looking for an experienced AWS Big Data Lead Engineer to design, build, and manage scalable data solutions on AWS. The ideal candidate will hav...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Big data Architect

    AWS Big data Architect

    ConfidentialBengaluru / Bangalore
    Design and architect end to end solutions on AWS and create the HLD and LLD documents.Experience in real-time Data Ingestion and Processing. Hands-on experience in AWS S3, Kafka, Glue, PySpark, Pyth...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Developer - Hadoop

    Big Data Developer - Hadoop

    Ara Resources Pvt LtdBangalore
    About The Company : ARAs client is a leading IT solutions provider, offering Applications, Business Process Outsourcing ...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy ServicesBengaluru, Karnataka, India
    Role - AWS Data Engineer Required Technical Skill Set - AWS,Snowflake,ETL,Python,Pyspark, DBT Experience Range - 6+ Years Technical / Behavioral Competency : • 5+ years experience with Sowflake dev...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Engineer - Hadoop / Spark

    Big Data Engineer - Hadoop / Spark

    IT FirmBangalore
    Role Overview : As a Big Data Engineer, you will be responsible for building and maintaining scalable data pipelines and architectures that support data analytics, re...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer (AWS / Databricks)

    Senior Data Engineer (AWS / Databricks)

    AccoladeBengaluru, Karnataka, India
    The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 26 days ago
    • Promoted
    Data Architect - Big Data

    Data Architect - Big Data

    TekIT Software Solutions Pvt. Ltd.Bangalore
    Key Responsibilities : - Design and architect scalable, high-performance Big Data solutions and data platforms on AWS.Tr...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Engineer - Hadoop / Spark

    Big Data Engineer - Hadoop / Spark

    ImpacteersBangalore
    Position Overview : We are looking for a skilled and detail-oriented Big Data Engineer to design, develop, and maintain scalable data pipelines and architectures.The ...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    CoforgeBengaluru, Karnataka, India
    AWS Services, ETL, ETL Integration, CodePipeline, Jenkins, Glue, EMR, Athena, ECS, EKS, Kubernetes, CloudWatch, Prometheus, Grafana, Python, Shell, or PowerShell. We are looking for an experienced A...Show moreLast updated: 16 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Sonata SoftwareBengaluru, Karnataka, India
    Experience building data pipelines.Highly proficient in python, Data frames.Experience with AWS Lambda, Events (SQS), API calls, Kinesis, DynamoDB. Highly proficient in SQL Query.Snowflake or experi...Show moreLast updated: 15 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Response Informaticshosur, tamil nadu, in
    AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture. CICD - Terraform or CloudFo...Show moreLast updated: 26 days ago
    • Promoted
    Senior Data Engineer - Snowflake / AWS

    Senior Data Engineer - Snowflake / AWS

    ResourcetreeBangalore
    About the Role : A "Senior Data Engineer" is mid-level professional leading the design, build and evolution of the inhouse data platforms.You lead the const...Show moreLast updated: 21 days ago