Talent.com
This job offer is not available in your country.
Big Data Engineer (Spark | AWS | Scala / Java)

Big Data Engineer (Spark | AWS | Scala / Java)

Sky Systems, Inc. (SkySys)Anand, IN
8 hours ago
Job description

Role : Big Data Engineer

Position Type : Full-Time Contract (40hrs / week)

Contract Duration : Long Term

Work Schedule : 8 hours / day (Mon-Fri)

Location : Hybrid - Hyderabad, India (3x days onsite / week)

We are looking for a skilled Big Data Engineer (5+ years’ experience) to join Experian’s dynamic data engineering team. You will design and optimize scalable data pipelines, APIs, and big data solutions on AWS to support our global data ecosystem.

Key Responsibilities :

  • Build and maintain scalable data pipelines with Spark / PySpark, Hadoop, and AWS (EMR, EC2, ECS) .
  • Develop and integrate RESTful APIs and AWS Gateway services using Scala / Java .
  • Ensure data quality, performance, and reliability across platforms.
  • Collaborate with cross-functional teams and support CI / CD deployment processes.

Must-Haves :

  • 5+ years of experience in Big Data Engineering.
  • Strong skills in Spark / PySpark, Hadoop, AWS (EMR, EC2, ECS) .
  • Proficiency in Scala / Java for backend / API development.
  • Solid understanding of RESTful APIs and Git / CI / CD pipelines.
  • Nice-to-Haves :

  • Experience in data security, real-time processing, and data lake architectures .
  • Familiarity with Docker / Kubernetes .
  • Create a job alert for this search

    Big Data Engineer • Anand, IN

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeAnand, IN
    Snowflake, AWS (Lambda, Glue), DBT, and SQL.The ideal candidate will be responsible for enabling seamless data integration, transformation, and analytics to support business intelligence and advanc...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    AceolutionAhmedabad, IN
    We are looking for a freelancer to engage with us for 20-40 hours per week.Kindly find the JD below for your reference.Design, develop, and maintain scalable data pipelines and workflows.Work exten...Show moreLast updated: 9 days ago
    • Promoted
    • New!
    Big Data Engineer (Spark | AWS | Scala / Java)

    Big Data Engineer (Spark | AWS | Scala / Java)

    Sky Systems, Inc. (SkySys)Vadodara, IN
    Full-Time Contract (40hrs / week).Hybrid - Hyderabad, India (3x days onsite / week).Big Data Engineer (5+ years’ experience). Experian’s dynamic data engineering team.You will design and optimize scalab...Show moreLast updated: 8 hours ago
    • Promoted
    Senior Cloud Engineer AWS

    Senior Cloud Engineer AWS

    Matrix USAAnand, IN
    We are seeking an experienced AWS Developer proficient in Python and PySpark to design, develop, and maintain scalable, serverless data processing and workflow automation solutions on AWS.The ideal...Show moreLast updated: 5 days ago
    • Promoted
    Data Engineer

    Data Engineer

    XebiaVadodara, IN
    We’re Hiring : Data Engineer | Xebia.Any Xebia location (Hybrid, 3 days office per week).Immediate to 2 weeks – only apply if you can join early. Databricks, Python, SQL, and Postgres.The ideal candi...Show moreLast updated: 6 days ago
    • Promoted
    Lead Azure Data Engineer

    Lead Azure Data Engineer

    RandomTreesVadodara, IN
    We’re a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologies. If you're passionate about building r...Show moreLast updated: 27 days ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    XebiaVadodara, IN
    We’re Hiring : Principal Data Engineer | Any Xebia Location (Hybrid, 3 days in office per week).Any Xebia Location (Hybrid – 3 days in office per week). Data Engineering with 4+ years team leadership...Show moreLast updated: 23 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Otomeyt AIVadodara, IN
    We are seeking a highly skilled 7+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 19 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Otomeyt AIAhmedabad, IN
    We are seeking a highly skilled 5+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Innodata Inc.Vadodara, IN
    CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 26 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Bahwan CyberTekAhmedabad, IN
    Job Title : Data Engineer – Google Cloud Platform (GCP).We are seeking a skilled and motivated Data Engineer with hands-on experience in building scalable data pipelines and cloud-native data soluti...Show moreLast updated: 18 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Manuh TechnologiesAhmedabad, IN
    Strong proficiency in Python programming (Pandas, NumPy, PySpark, or similar).Hands-on experience with Dask for large-scale distributed data processing. Proven expertise as a Data Modeler (conceptua...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Big Data Engineer

    Senior Big Data Engineer

    VeltrisNadiad, IN
    Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries. We specialize in delivering next-gene...Show moreLast updated: 15 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DeltacubesVadodara, IN
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 16 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    InfogainVadodara, IN
    Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    HISH IT SERVICESAnand, IN
    Location : Remote(Banglore,Chennai,Pune).Pay : 14LPA - 18 LPA(Based on Experience).Timings : A couple of hours overlap with EST, as the client is Canada-based (till 12AM IST).Start Date : 20th Octob...Show moreLast updated: 7 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    BrightEdgeAhmedabad, IN
    BrightEdge About Us BrightEdge is a leading SEO and content performance marketing platform that transforms online content into tangible business results. Our platform processes massive amounts of da...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DexianAhmedabad, IN
    We seek a Senior Data Engineer colleague to join our world-class client, one of the.Employment / Contract Type : Contract. Duration : 1 year (with potential to be extended).Hours per Week : 40 (Full-time...Show moreLast updated: 27 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AINadiad, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 8 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data SolutionsVadodara, IN
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 8 days ago