Talent.com
This job offer is not available in your country.
Big Data Engineer (Spark | AWS | Scala / Java)

Big Data Engineer (Spark | AWS | Scala / Java)

Sky Systems, Inc. (SkySys)Chennai, IN
13 hours ago
Job description

Role : Big Data Engineer

Position Type : Full-Time Contract (40hrs / week)

Contract Duration : Long Term

Work Schedule : 8 hours / day (Mon-Fri)

Location : Hybrid - Hyderabad, India (3x days onsite / week)

We are looking for a skilled Big Data Engineer (5+ years’ experience) to join Experian’s dynamic data engineering team. You will design and optimize scalable data pipelines, APIs, and big data solutions on AWS to support our global data ecosystem.

Key Responsibilities :

  • Build and maintain scalable data pipelines with Spark / PySpark, Hadoop, and AWS (EMR, EC2, ECS) .
  • Develop and integrate RESTful APIs and AWS Gateway services using Scala / Java .
  • Ensure data quality, performance, and reliability across platforms.
  • Collaborate with cross-functional teams and support CI / CD deployment processes.

Must-Haves :

  • 5+ years of experience in Big Data Engineering.
  • Strong skills in Spark / PySpark, Hadoop, AWS (EMR, EC2, ECS) .
  • Proficiency in Scala / Java for backend / API development.
  • Solid understanding of RESTful APIs and Git / CI / CD pipelines.
  • Nice-to-Haves :

  • Experience in data security, real-time processing, and data lake architectures .
  • Familiarity with Docker / Kubernetes .
  • Create a job alert for this search

    Big Data Engineer • Chennai, IN

    Related jobs
    • Promoted
    • New!
    Big Data Engineer

    Big Data Engineer

    Saaki Argus & Averil Consultingchennai, India
    Notice Period : Immediate Joiner or 30 Day.Hands-on experience on technologies like.Hive, Scala, Spark, AWS, HBase.Proficient in Hadoop distributions such as. Good working experience on technologies...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    Talend Big Data Engineer

    Talend Big Data Engineer

    Anicalls (Pty) Ltdchennai, India
    This solution enables our Data Scientists and Data Analysts to actively detect trends, patterns, and relationships in data sets. Contribute to the data movement project enhancement and bug fixes for...Show moreLast updated: 14 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Otomeyt AIChennai, IN
    We are seeking a highly skilled 7+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 19 days ago
    • Promoted
    • New!
    AWS – Data Engineer

    AWS – Data Engineer

    Epergne Solutionschennai, India
    Pune / Hyderabad / Chennai / Mysuru / Bhubaneswar / Mangalore / Trivandrum / Chandigarh / Jaipur / Nagpur / Indore / Gurgaon. Job Roles & Responsibilities : -.Leverage AWS services (S3, EC2, Lambda, Redshift, CloudFormati...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    Hadoop Big data engineer

    Hadoop Big data engineer

    Anicalls (Pty) Ltdchennai, India
    As an individual contributor, design modules, apply creative problem-solving using tools and technologies.As individual contributor code and test modules. Interact and collaborate directly with soft...Show moreLast updated: 14 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    LTIMindtreeChennai, Tamil Nadu, India
    We are hiring for AWS Data Engineer.Notice period - immediate to 30 days.Seeking a Specialist with 5 to 7 years of experience in AWS IoT Data Engineering and strong Python skills to design and impl...Show moreLast updated: 18 days ago
    • Promoted
    • New!
    Big Data Engineer

    Big Data Engineer

    RiskInsight Consulting Pvt Ltdchennai, India
    Design, develop, and implement robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databases.Build and maintain scalable data pipelines for effective data ingestion, trans...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    Senior Big Data Cloud Engineer

    Senior Big Data Cloud Engineer

    Anicalls (Pty) Ltdchennai, India
    Experience designing, developing, and testing applications using proven or emerging technologies, in a variety of technologies and environments. Experience in using and tuning relational databases (...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    Senior Data Engineer( AWS Redshift)

    Senior Data Engineer( AWS Redshift)

    Anicalls (Pty) Ltdchennai, India
    Clear, concise communication abilities - writing, verbal, presentation - to all levels of technical and non-technical audiences with the ability to collaborate. Strong experience in CICD technologie...Show moreLast updated: 14 hours ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Persistent SystemsChennai, Tamil Nadu, India
    We are conducting an in-person hiring drive for the position of Mlops Engineer in Chennai on 6th Sep 2025.Interview Location is mentioned below : . Chennai : Olympia Pinnacle, #1, S.Old Mahabalipuram R...Show moreLast updated: 27 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Otomeyt AIChennai, IN
    We are seeking a highly skilled 5+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Innodata Inc.Chennai, IN
    CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 26 days ago
    • Promoted
    Senior Big Data Engineer

    Senior Big Data Engineer

    VeltrisChennai, IN
    Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries. We specialize in delivering next-gene...Show moreLast updated: 15 days ago
    • Promoted
    • New!
    Big Data Engineer

    Big Data Engineer

    Hexaware Technologieschennai, India
    Primary Tech skills – AZURE ,Databricks ,Pyspark,SQL.Secondary Tech skills – ADF, Synapse.Roles : •Experience in Pyspark, SQL, Cloud data warehouse like Azure Synapse, databricks •Experience working w...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    Sr. Big Data Engineer

    Sr. Big Data Engineer

    Anicalls (Pty) Ltdchennai, India
    Superior oral, and written communication skills, as well as the willingness to collaborate across teams of internal and external technical staff, business analysts, software support, and operations...Show moreLast updated: 14 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    ImpetusChennai, Tamil Nadu, India
    Bigdata, Pyspark, Python ,Hadoop / HDFS; Spark;.Develops and maintains scalable data pipelines to support continuing increases in data volume and complexity. Collaborates with analytics and business...Show moreLast updated: 25 days ago
    • Promoted
    • New!
    Senior Big Data Hadoop Engineer

    Senior Big Data Hadoop Engineer

    Anicalls (Pty) Ltdchennai, India
    Work closely with our QA Team to ensure data integrity and overall system quality.Work closely with Technology Leadership, Product Managers, and Reporting Team for understanding the functional and ...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    AWS Data Engineer

    AWS Data Engineer

    CBTSchennai, India
    Technical : solid understanding of Data Management, AWS tech stack like Python, Glue, Athena, Redshift, Lambda, data security, data governance, and privacy best practices to your AWS data pipelines....Show moreLast updated: 14 hours ago
    • Promoted
    AWS Data Engineer(Chennai, Indore,Pune)

    AWS Data Engineer(Chennai, Indore,Pune)

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    Good knowledge and experience in Pyspark for forming complex Transformation logic.Secondary : AWS Glue , Airflow.A minimum of 3 + years' experience and understanding of Python core concepts, and im...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Big Data Engineer (Spark, SparkSQL)...

    Big Data Engineer (Spark, SparkSQL)...

    Anicalls (Pty) Ltdchennai, India
    Experience on Spark Core, Spark-SQL, Scala-Programming, and Streaming datasets in Big Data platform.Should have extensive working experience in Hive and other components of the Hadoop ecosystem (HB...Show moreLast updated: 14 hours ago