Talent.com
Data Engineer - AWS/Big Data
Data Engineer - AWS/Big DataTechno-Comp Computer Services Pvt. Ltd. • Hyderabad
Data Engineer - AWS / Big Data

Data Engineer - AWS / Big Data

Techno-Comp Computer Services Pvt. Ltd. • Hyderabad
23 days ago
Job description

We have vacancies for Aws - Bigdata Specialist position.

We are looking for a highly skilled Senior AWS Data Engineer to join our growing data engineering team. The ideal candidate will have deep hands-on experience in AWS cloud services, big data processing frameworks, and advanced SQL programming. You will be responsible for building and maintaining scalable, high-performance data solutions that enable advanced analytics and data-driven decision-making across the organization.

This is a great opportunity for someone passionate about working with modern data technologies and optimizing large-scale distributed systems.

Key Responsibilities :

  • Design, build, and optimize data pipelines and ETL processes using AWS Glue, Lambda, RDS, and S3.
  • Develop scalable batch and streaming data processing workflows using Apache Spark, Spark Streaming, and Kafka.
  • Work with SQL and NoSQL databases (MySQL, PostgreSQL, Elasticsearch) to design schemas and optimize queries for high performance.
  • Write efficient and optimized SQL for data extraction, transformation, and analytics.
  • Build and maintain data ingestion, transformation, and integration solutions across multiple systems.
  • Collaborate with cross-functional teams (data science, analytics, engineering) to provide reliable, high-quality data.
  • Use Scala, Java, and Python for data processing and automation scripts.
  • Implement monitoring, logging, and alerting for data pipelines using AWS services (CloudWatch, CloudTrail).
  • Ensure data security, compliance, and governance using AWS best practices.

Required Skills & Experience :

  • 5+ years of experience with AWS Services including RDS, AWS Lambda, AWS Glue, EMR, S3, and related big data technologies.
  • 5+ years of experience working with Apache Spark, Spark Streaming, Kafka, and Hive.
  • Strong experience in SQL and NoSQL databases (MySQL, PostgreSQL, Elasticsearch).
  • Proficiency in Java and Scala, with hands-on scripting experience in Python and Unix / Linux shell.
  • Deep understanding of Spark programming paradigms (batch and stream processing).
  • Advanced knowledge of SQL, including query optimization, indexing, and performance tuning.
  • Strong analytical and problem-solving skills with the ability to handle large datasets efficiently.
  • (ref : hirist.tech)

    Create a job alert for this search

    Data Engineer • Hyderabad

    Related jobs
    Lead Data Engineer (AWS)

    Lead Data Engineer (AWS)

    Atyeti Inc • Hyderabad, Republic Of India, IN
    Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.SQL and cloud-native devel...Show more
    Last updated: 24 days ago • Promoted
    Senior AWS Data Engineer_Exp : 5+ Years

    Senior AWS Data Engineer_Exp : 5+ Years

    Atyeti Inc • Hyderabad, Telangana, India
    Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.Python; strong SQL and clo...Show more
    Last updated: 23 days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Vista Applied Solutions Group Inc • Hyderabad, IN
    Job Summary for AWS Data Engineer : .Job Qualification and Responsibilities for AWS Data Engineer : .Advanced SQL (performance tuning, joins, windows functions). Hands-on with AWS : Glue, Lambda, Redshif...Show more
    Last updated: 10 days ago • Promoted
    Senior Data Engineer - AWS & Python

    Senior Data Engineer - AWS & Python

    Egen • Hyderabad, Telangana, India
    Design, develop, and maintain ETL / ELT data pipelines using Python and AWS native services (Glue, Lambda, EMR, Step Functions, etc. Build and manage data lakes and data warehouses using Amazon S3, Re...Show more
    Last updated: 9 days ago • Promoted
    Sr. Data Engineer (AWS)

    Sr. Data Engineer (AWS)

    CACI Ltd • Hyderabad, Telangana, India
    CACI International Inc is an American multinational professional services and information technology company headquartered in Northern Virginia. CACI provides expertise and technology to enterprise ...Show more
    Last updated: 24 days ago • Promoted
    Data Engineer - AWS Focus

    Data Engineer - AWS Focus

    Tata Consultancy Services • Hyderabad, Republic Of India, IN
    AWS Python, AWS Glue, Lambda, Athena, AWS Pyspark.Good hands-on experience in Python programming and Pyspark / Scala.Data Engineering experience using AWS core services (Lambda, Glue, EMR, S3 and Red...Show more
    Last updated: 11 hours ago • Promoted • New!
    Data Engineer (Airflow, Azure)

    Data Engineer (Airflow, Azure)

    Luxoft • Hyderabad, Telangana, India
    This project is part of a strategic initiative to migrate legacy on-premises data systems to a modern, scalable cloud-based data platform using Snowflake on Azure. The goal is to enhance data access...Show more
    Last updated: 3 days ago • Promoted
    AWS Data Solutions Engineer

    AWS Data Solutions Engineer

    Tata Consultancy Services • Hyderabad, Republic Of India, IN
    TCS is looking for AWS data engineer.Location : Kolkata, Hyderabad, Bangalore, Chennai, Pune, Gurgaon.Strong hands-on experience with AWS Data Services : . Amazon S3, Glue, Redshift, Athena, Kinesis, E...Show more
    Last updated: 30+ days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Confidential • Hyderabad / Secunderabad, Telangana
    Design, develop, and maintain robust data pipelines and ETL processes using.Implement data processing solutions using.Understand complex data requirements by working closely with client Subject Mat...Show more
    Last updated: 30+ days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Insight Global • Hyderabad, Telangana, India
    We are seeking a highly skilled AWS Data Engineer to join our team and help design, build, and maintain scalable data pipelines and infrastructure in the cloud. The ideal candidate will have experie...Show more
    Last updated: 22 days ago • Promoted
    Azure Senior Data Engineer

    Azure Senior Data Engineer

    Tata Consultancy Services • Hyderabad, India
    TCS is hiring for AWS Data Engineer.Extensive coding experience including Python / Pyspark.Experience developing in Azure with key data technologies (e. ADLS, ADF, Azure Databricks etc.Software develo...Show more
    Last updated: 18 days ago • Promoted
    AWS Data Pipeline Engineer

    AWS Data Pipeline Engineer

    Tata Consultancy Services • Hyderabad, Republic Of India, IN
    We await your innovation at TCS : Hiring | Python AWS Data Engineer |.Greetings from TCS!! We are Hiring for Python AWS Data Engineer. Required Experience : 5-10 years.Work location : Bangalore,Chennai...Show more
    Last updated: 30+ days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Knack Consulting Services • Hyderabad, Telangana, India
    Design AWS architectures based on business requirements.Create architectural diagrams and documentation.Present cloud solutions to stakeholders. Design develop and maintain scalable ETL / ELT pipeline...Show more
    Last updated: 30+ days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy Services • Hyderabad, Telangana, India
    AWS Python , AWS Glue, Lambda, Athena, AWS Pyspark.Good hands-on experience in Python programming and Pyspark / Scala.Data Engineering experience using AWS core services (Lambda, Glue, EMR, S3 and Re...Show more
    Last updated: 30+ days ago • Promoted
    AWS Cloud Data Solutions Engineer

    AWS Cloud Data Solutions Engineer

    Tata Consultancy Services • Hyderabad, Republic Of India, IN
    We await your innovation at TCS : Hiring | Python AWS Data Engineer |.Greetings from TCS!! We are Hiring for Python AWS Data Engineer. Required Experience : 5-10 years.Work location : Bangalore,Chennai...Show more
    Last updated: 5 days ago • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    Epergne Solutions • Hyderabad, Telangana, India
    Quick Apply
    Immediate / 10 Days To 15 days NP.The ideal candidate should have a solid background in data engineering, strong programming skills, and deep experience working with AWS cloud services.Optimize and...Show more
    Last updated: 30+ days ago
    AWS data engineer

    AWS data engineer

    Tata Consultancy Services • Hyderabad, Telangana, India
    We await your innovation at TCS : Hiring | Python AWS Data Engineer |.Greetings from TCS!! We are Hiring for Python AWS Data Engineer. Required Experience : 5-10 years.Work location : Bangalore,Chennai...Show more
    Last updated: 6 days ago • Promoted
    Senior Data Engineer (AWS,Python, PySpark, SQL)

    Senior Data Engineer (AWS,Python, PySpark, SQL)

    SID Information Technologies • Hyderabad, Telangana, India
    Role : Senior Data Engineer (Python, PySpark, SQL, AWS) Experience : 6–10 years Location : Hyderabad Work Mode : Hybrid (3 days / week in-office) Join Time : Immediate Domain : Healthcare / Life Sci...Show more
    Last updated: 5 hours ago • Promoted • New!