Talent.com
This job offer is not available in your country.
Big Data Engineer (Spark | AWS | Scala / Java)

Big Data Engineer (Spark | AWS | Scala / Java)

Sky Systems, Inc. (SkySys)Hyderabad, IN
8 hours ago
Job description

Role : Big Data Engineer

Position Type : Full-Time Contract (40hrs / week)

Contract Duration : Long Term

Work Schedule : 8 hours / day (Mon-Fri)

Location : Hybrid - Hyderabad, India (3x days onsite / week)

We are looking for a skilled Big Data Engineer (5+ years’ experience) to join Experian’s dynamic data engineering team. You will design and optimize scalable data pipelines, APIs, and big data solutions on AWS to support our global data ecosystem.

Key Responsibilities :

  • Build and maintain scalable data pipelines with Spark / PySpark, Hadoop, and AWS (EMR, EC2, ECS) .
  • Develop and integrate RESTful APIs and AWS Gateway services using Scala / Java .
  • Ensure data quality, performance, and reliability across platforms.
  • Collaborate with cross-functional teams and support CI / CD deployment processes.

Must-Haves :

  • 5+ years of experience in Big Data Engineering.
  • Strong skills in Spark / PySpark, Hadoop, AWS (EMR, EC2, ECS) .
  • Proficiency in Scala / Java for backend / API development.
  • Solid understanding of RESTful APIs and Git / CI / CD pipelines.
  • Nice-to-Haves :

  • Experience in data security, real-time processing, and data lake architectures .
  • Familiarity with Docker / Kubernetes .
  • Create a job alert for this search

    Big Data Engineer • Hyderabad, IN

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    Bahwan CyberTekhyderabad, telangana, in
    We are seeking a skilled and motivated Data Engineer with 5–8 years of experience in building scalable data pipelines using Python, PySpark, and AWS services. The ideal candidate will have hands-on ...Show moreLast updated: 18 days ago
    • Promoted
    Senior Big Data Engineer

    Senior Big Data Engineer

    Grid Dynamicshyderabad, telangana, in
    Proven experience leading data engineering teams, including distributed teams across multiple geographies and time zones. Effective in managing cross-team collaboration with architects, product mana...Show moreLast updated: 21 days ago
    • Promoted
    • New!
    Big data engineer

    Big data engineer

    Virtusahyderabad, India
    Big data engineer - CREQ Description.Primary : big data concepts, aws, pyspark.Create Trigger based automation framework for Data Migration. Identify roles / access needed for data migration from fede...Show moreLast updated: 9 hours ago
    • Promoted
    • New!
    Data Engineer AWS

    Data Engineer AWS

    Anicalls (Pty) Ltdhyderabad, India
    Strong computer science fundamentals such as algorithms, data structures, multithreading, object-oriented development, distributed applications, client-server architecture.Design and implement Mach...Show moreLast updated: 9 hours ago
    • Promoted
    • New!
    Data Engineer SQL / C# / AWS

    Data Engineer SQL / C# / AWS

    Anicalls (Pty) Ltdhyderabad, India
    Advanced SQL development knowledge using MS SQL Server.Experience in Data Modeling and building data warehouse / data lake solutions that involve multiple disparate sources.Experience working in an A...Show moreLast updated: 9 hours ago
    • Promoted
    • New!
    Big Data Hadoop Engineer

    Big Data Hadoop Engineer

    Anicalls (Pty) Ltdhyderabad, India
    Work closely with our QA Team to ensure data integrity and overall system quality.Work closely with Technology Leadership, Product Managers, and Reporting Team for understanding the functional and ...Show moreLast updated: 9 hours ago
    • Promoted
    • New!
    DW and Big Data engineer

    DW and Big Data engineer

    Anicalls (Pty) Ltdhyderabad, India
    Cloud Data Analytics (AWS, Oracle, Azure, Snowflake) – Hands-on solution design experience in at least two of cloud platforms. Experience in growing & mining existing accounts.Experience in implemen...Show moreLast updated: 9 hours ago
    • Promoted
    Big Data Engineer

    Big Data Engineer

    Rapinno Tech Solutions Pvt.Ltd.hyderabad, telangana, in
    Locations : Hyderabad | Chennai | Pune | Bangalore.Skills : Scala, Python, Apache Spark, PySpark, AWS, CI / CD.Strong hands-on experience in Scala & distributed data processing.Show moreLast updated: 8 days ago
    • Promoted
    Bigdata Engineer

    Bigdata Engineer

    TAO Digital SolutionsHyderabad, Telangana, India
    Highly skilled Big Data Engineer with expertise in distributed systems, and advanced programming techniques.Candidate will possess experience in developing highly scalable Big Data pipelines, stron...Show moreLast updated: 8 days ago
    • Promoted
    • New!
    AWS – Data Engineer

    AWS – Data Engineer

    Epergne Solutionshyderabad, India
    Pune / Hyderabad / Chennai / Mysuru / Bhubaneswar / Mangalore / Trivandrum / Chandigarh / Jaipur / Nagpur / Indore / Gurgaon. Job Roles & Responsibilities : -.Leverage AWS services (S3, EC2, Lambda, Redshift, CloudFormati...Show moreLast updated: 9 hours ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    CoforgeHyderabad, Telangana, India
    As an AWS Data Engineer, you will be responsible for designing, developing, and optimizing robust, scalable, and secure data pipelines and infrastructure on AWS. You’ll work with diverse datasets an...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Sr Cloud Big Data Engineer, SMAI

    Sr Cloud Big Data Engineer, SMAI

    Micronhyderabad, India
    Our vision is to transform how the world uses information to enrich life for all.Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of...Show moreLast updated: 9 hours ago
    • Promoted
    • New!
    Bigdata Engineer - E6871

    Bigdata Engineer - E6871

    Nisumhyderabad, India
    Utilize your software engineering skills including Java, Spark, Python, Scala to Analyze disparate, complex systems and collaboratively design new products and services. Integrate new data sources a...Show moreLast updated: 9 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    ACL Digitalhyderabad, telangana, in
    Design, develop, and optimize Spark-based data pipelines on Databricks for large-scale data processing.Design, develop, and optimize AWS pipeline as applicable. Implement and manage GitHub asset bun...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Tech Lead - AWS Data Engineer Job

    Tech Lead - AWS Data Engineer Job

    YASH Technologieshyderabad, India
    Understanding the current business functionalities of the ETL processes and identifying areas for improvement.Designing and building AWS Glue workflows to replace existing ETL processes.Standardizi...Show moreLast updated: 9 hours ago
    • Promoted
    • New!
    AWS Big Data Engineer

    AWS Big Data Engineer

    Tiger Analyticshyderabad, India
    We are looking for a Senior Data Engineer to be based out of our Chennai, Bangalore & Hyderabad offices.This role involves a combination of hands-on contribution, customer engagement, and technical...Show moreLast updated: 9 hours ago
    • Promoted
    • New!
    Big Data Engineer

    Big Data Engineer

    Saaki Argus & Averil Consultinghyderabad, India
    Notice Period : Immediate Joiner or 30 Day.Hands-on experience on technologies like.Hive, Scala, Spark, AWS, HBase.Proficient in Hadoop distributions such as. Good working experience on technologies...Show moreLast updated: 9 hours ago
    • Promoted
    • New!
    Big Data Engineer

    Big Data Engineer

    Anicalls (Pty) Ltdhyderabad, India
    Bachelor's Degree or more in Computer.A solid track record of data management showing your flawless execution.Strong knowledge of and experience with statistics. Programming experience, ideally in ,...Show moreLast updated: 9 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    TechVeritohyderabad, telangana, in
    You will play a critical role in designing, building, and optimizing data workflows that enable scalable analytics and real-time insights. The ideal candidate is hands-on, detail-oriented, and passi...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Big Data Engineer (Spark, SparkSQL)

    Big Data Engineer (Spark, SparkSQL)

    Anicalls (Pty) Ltdhyderabad, India
    Experience on Spark Core, Spark-SQL, Scala-Programming, and Streaming datasets in Big Data platform.Should have extensive working experience in Hive and other components of the Hadoop ecosystem (HB...Show moreLast updated: 9 hours ago