Talent.com
This job offer is not available in your country.
Big Data Engineer (Spark | AWS | Scala / Java)

Big Data Engineer (Spark | AWS | Scala / Java)

Sky Systems, Inc. (SkySys)Pune, IN
11 hours ago
Job description

Role : Big Data Engineer

Position Type : Full-Time Contract (40hrs / week)

Contract Duration : Long Term

Work Schedule : 8 hours / day (Mon-Fri)

Location : Hybrid - Hyderabad, India (3x days onsite / week)

We are looking for a skilled Big Data Engineer (5+ years’ experience) to join Experian’s dynamic data engineering team. You will design and optimize scalable data pipelines, APIs, and big data solutions on AWS to support our global data ecosystem.

Key Responsibilities :

  • Build and maintain scalable data pipelines with Spark / PySpark, Hadoop, and AWS (EMR, EC2, ECS) .
  • Develop and integrate RESTful APIs and AWS Gateway services using Scala / Java .
  • Ensure data quality, performance, and reliability across platforms.
  • Collaborate with cross-functional teams and support CI / CD deployment processes.

Must-Haves :

  • 5+ years of experience in Big Data Engineering.
  • Strong skills in Spark / PySpark, Hadoop, AWS (EMR, EC2, ECS) .
  • Proficiency in Scala / Java for backend / API development.
  • Solid understanding of RESTful APIs and Git / CI / CD pipelines.
  • Nice-to-Haves :

  • Experience in data security, real-time processing, and data lake architectures .
  • Familiarity with Docker / Kubernetes .
  • Create a job alert for this search

    Big Data Engineer • Pune, IN

    Related jobs
    • Promoted
    • New!
    AWS – Data Engineer

    AWS – Data Engineer

    Epergne Solutionspune, India
    Pune / Hyderabad / Chennai / Mysuru / Bhubaneswar / Mangalore / Trivandrum / Chandigarh / Jaipur / Nagpur / Indore / Gurgaon. Job Roles & Responsibilities : -.Leverage AWS services (S3, EC2, Lambda, Redshift, CloudFormati...Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    Sr. Data Engineer - AWS+Python+Pyspark Job

    Sr. Data Engineer - AWS+Python+Pyspark Job

    YASH Technologiespune, India
    YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences,...Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    Big Data Engineer

    Big Data Engineer

    Hexaware Technologiespune, India
    Hands on experience working in a public cloud environment and on-prem infrastructure.Specialty on Columnar Databases like. AWS cloud infrastructure services (Redshift, S3, Lambda).Experience with a ...Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Netlinkpune, India
    Design, develop, and maintain efficient and scalable data pipelines using Python, PySpark, and Databricks on AWS.Work closely with data scientists, analysts, and other engineers to ensure smooth da...Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    Senior Big Data Software Engineer

    Senior Big Data Software Engineer

    Epampune, India
    EPAM is a leading global provider of digital platform engineering and development services.We are committed to having a positive impact on our customers, our employees, and our communities.We embra...Show moreLast updated: 12 hours ago
    • Promoted
    TCS Hiring for AWS Senior Data Engineer with Pyspark, AWS, Glue_Pune

    TCS Hiring for AWS Senior Data Engineer with Pyspark, AWS, Glue_Pune

    Tata Consultancy ServicesPune, Maharashtra, India
    Job Title : AWS Senior Data Engineer with Pyspark, AWS, Glue_Pune.PySpark, AWS[ETL Concepts, S3, Glue, EMR, Redshift, DMS, AppFlow] ,Qlik Replicate, Data Testing. Hadoop, Teradata Background, IaC[Clo...Show moreLast updated: 8 days ago
    • Promoted
    • New!
    Lead Big Data Software Engineer

    Lead Big Data Software Engineer

    Epampune, India
    EPAM is a leading global provider of digital platform engineering and development services.We are committed to having a positive impact on our customers, our employees, and our communities.We embra...Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Virtusapune, India
    Data Engineer - CREQ Description 6-8 years of relevant work experience showing growth as a Data Engineer.Hands On programming experience. Implementation Experience on Kafka, Kinesis, Spark, AWS Glu...Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    AWS Big data pyspark SQL Spark Airflow

    AWS Big data pyspark SQL Spark Airflow

    ScaleneWorkspune, India
    Job Title : AWS Big Data Engineer.We are looking for a highly skilled AWS Big Data Engineer with extensive experience in PySpark, SQL, Spark, and Airflow. The ideal candidate will have a strong backg...Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    AWS Data Engineer

    AWS Data Engineer

    Epergne Solutionspune, India
    Pune / Hyderabad / Chennai / Mysuru / Bhubaneswar / Mangalore / Trivandrum / Chandigarh / Jaipur / Nagpur / Indore / Gurgaon. Design, build, and optimize data pipelines and scalable data assets.Develop and maintain high-...Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    Digit 88 - Sr Big Data Engineer

    Digit 88 - Sr Big Data Engineer

    Nexthirepune, India
    Digit88 empowers digital transformation for innovative and high growth B2B and B2C SaaS companies as their trusted offshore software product engineering partner! We are a lean mid-stage software co...Show moreLast updated: 12 hours ago
    • Promoted
    Senior Big Data Engineer

    Senior Big Data Engineer

    VeltrisPune, IN
    Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries. We specialize in delivering next-gene...Show moreLast updated: 15 days ago
    • Promoted
    Lead Big Data Engineer

    Lead Big Data Engineer

    QualysPune, Maharashtra, India
    Come work at a place where innovation and teamwork come together to support the most exciting missions in the world!.We are seeking a talented Lead Big Data Engineer to deliver roadmap features of ...Show moreLast updated: 16 days ago
    • Promoted
    • New!
    AWS Data Engineer (Senior)

    AWS Data Engineer (Senior)

    Infogainpune, India
    AWS Data Engineer (Senior) with skills Data Engineering, AWS-Apps, SQL, AWS DBA, Redshift for location Pune, India.Posted on : August 09, Share on Linkedin Share on Twitter Share on Facebook.Minimum...Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    Tech Lead - AWS Data Engineer Job

    Tech Lead - AWS Data Engineer Job

    YASH Technologiespune, India
    Understanding the current business functionalities of the ETL processes and identifying areas for improvement.Designing and building AWS Glue workflows to replace existing ETL processes.Standardizi...Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    Senior Big Data Engineer

    Senior Big Data Engineer

    Qualyspune, India
    Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks. Working with a team of engineers and archit...Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    Senior Big Data Engineer - Performance

    Senior Big Data Engineer - Performance

    Qualyspune, India
    Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks. Working with a team of engineers and archit...Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    AWS Data Engineer

    AWS Data Engineer

    Techno Wisepune, India
    Fortune 500 Client programs, which aims towards building a Enterprise Data Lake on AWS Cloud platform and build Data pipelines by developing several AWS Data Integration, Engineering & Analytics re...Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    Data Engineer-AWS

    Data Engineer-AWS

    Crazy Solutionspune, India
    Design, develop, and maintain scalable and efficient data pipelines using industry-standard tools and technologies.Design, implement, and optimize complex SQL queries to extract, transform, and loa...Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    Senior Big Data Engineer

    Senior Big Data Engineer

    12542 Citicorp Services India Private Limitedpune, India
    The Applications Development Senior big Data Engineer is responsible for accomplishing results through the management of a team or department in an effort to establish and implement new or revised ...Show moreLast updated: 12 hours ago