Talent.com
Big Data Developer

Big Data Developer

ConfidentialChennai, India
8 days ago
Job description

We're hiring for one of the world's leading professional services firms, renowned for its commitment to innovation, excellence, and global impact. With a presence in over 150 countries, this organization provides services across consulting, audit, tax, risk advisory, and financial advisory — helping Fortune 500 companies and governments navigate complex challenges.

Job Title : Big Data Developer

Employment Type : Full-Time Employee (FTE)

Location : PAN India

Experience : 6+ years

About the Role :

We are seeking a highly skilled Big Data Developer with strong expertise in Spark and Scala to join our dynamic team. The ideal candidate will have hands-on experience with cloud platforms such as AWS, Azure, or GCP for big data processing and storage solutions. You will play a critical role in designing, developing, and maintaining scalable data pipelines and backend services using modern big data technologies.

Key Responsibilities :

  • Develop, optimize, and maintain large-scale data processing pipelines using Apache Spark and Scala
  • Implement and manage cloud-based big data storage and processing solutions on Azure Data Lake Storage (DLS) and Azure Databricks
  • Collaborate with cross-functional teams to understand data requirements and deliver scalable backend services using Java and Spring Boot framework
  • Ensure best practices in data security, performance optimization, and code quality
  • Troubleshoot and resolve production issues related to big data workflows and backend services
  • Continuously evaluate emerging technologies and propose enhancements to current systems

Must-Have Qualifications :

  • 6+ years of experience in Big Data development
  • Strong expertise in Apache Spark and Scala for data processing
  • Hands-on experience with cloud platforms such as AWS, Azure, or GCP, with a strong focus on Azure Data Lake Storage (DLS) and Azure Databricks
  • Proficient in backend development using Java and Spring Boot framework
  • Experience in designing and implementing scalable and fault-tolerant data pipelines
  • Solid understanding of big data architectures, ETL processes, and data modeling
  • Excellent problem-solving skills and ability to work in an agile environment
  • Preferred Skills :

  • Familiarity with containerization and orchestration tools like Docker and Kubernetes
  • Knowledge of streaming technologies such as Kafka
  • Experience with CI / CD pipelines and automated testing frameworks
  • What We Offer :

  • Competitive salary of based on experience and skills
  • Flexible working options with PAN India presence
  • Opportunity to work with cutting-edge big data technologies in a growing and innovative company
  • Collaborative and supportive work culture with career growth opportunities
  • Apply for this job

    Skills Required

    Java, Scala, Apache Spark, Kafka, Spring Boot, Azure Databricks, Gcp, Docker, Azure, Kubernetes, Aws

    Create a job alert for this search

    Big Data Developer • Chennai, India

    Related jobs
    • Promoted
    Senior Big Data Developer - ETL

    Senior Big Data Developer - ETL

    MOURITechChennai
    Looking for a Senior Big Data Developer to design, build, and optimize data pipelines and analytics solutions.Candidates with prior exposure to the Ericsson Wallet Platform will be given preference...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Engineer

    Big Data Engineer

    Alef Educationchennai, tamil nadu, in
    Alef Education began with a bold idea : that every learner deserves a personalised and meaningful education experience.What started in 2016 as a small pilot programme in Abu Dhabi has evolved into o...Show moreLast updated: 24 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    LTIMindtreeChennai, Tamil Nadu, India
    LTIMindtree is hiring for below positions and conducting only F2F-Inperson Drive in Chennai / Kolkata locations on 08th-Nov-2025(Saturday). Open Positions for Chennai / Kolkata based-(5+ to 12 Years onl...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Developer (Hive, Pyspark)

    Big Data Developer (Hive, Pyspark)

    Tata Consultancy Servicesmount, India
    Big Data Developer (Hive, Pyspark).Years of Experience : 4 to 10 yrs.Date of Interview : 5th Nov, 2025.Mode of Interview : Virtual Drive(Cisco or Webex). Hands-on experience of Hadoop, Python, PySpark,...Show moreLast updated: 4 days ago
    • Promoted
    Cognos Developer - Databricks & Big Data

    Cognos Developer - Databricks & Big Data

    Lancesoft India Pvt LtdChennai
    About the Role : LanceSoft is seeking an experienced COGNOS Developer to design, develop, and optimize business intelligence solutions using IBM Cognos Analytics.The ...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer with Snowflake Experience- Contract

    Data Engineer with Snowflake Experience- Contract

    Gravity Infosolutions, Inc.chennai, tamil nadu, in
    Data Engineer with Snowflake & Data Vault 2.The project involves setting up a new software tool to meet audit requirements and is therefore critical. Most data to be migrated is already in Snowflake...Show moreLast updated: 15 days ago
    • Promoted
    Big Data Engineer - Hadoop / Spark

    Big Data Engineer - Hadoop / Spark

    ImpacteersChennai
    Position Overview : We are looking for a skilled and detail-oriented Big Data Engineer to design, develop, and maintain scalable data pipelines and architectures.The ...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Apply Now! Big Data Engineer

    Apply Now! Big Data Engineer

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    Greetings from TCS! We are hiring for Bigdata Developer Job location : Chennai, Bangalore, Hyderabad, Mumbai, Kolkata, Pune, Indore, Ahmedabad, Kochi, Gurgaon Desired experience : 5 to 10 years R...Show moreLast updated: less than 1 hour ago
    • Promoted
    Big Data Developer

    Big Data Developer

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    Minimum 3+ Years of experience Hadoop, Hive SQL’s, Spark, Bigdata Eco System Tools.Preferable to have good technical knowledge on Cloud computing, AWS or Azure Cloud Services.Strong conceptual and ...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SGS & CoChennai, Tamil Nadu, India
    Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in. The ideal candidate will play a ke...Show moreLast updated: 5 days ago
    • Promoted
    Big Data Developer(Hive, Pyspark)

    Big Data Developer(Hive, Pyspark)

    Tata Consultancy Serviceschennai, tamil nadu, in
    Big Data Developer(Hive, Pyspark).Years of Experience : 4 to 10 yrs.Date of Interview : 25th Oct, 2025.Mode of Interview : Virtual Drive( Cisco or WebEx). Hands-on experience of Hadoop, Python, PySpark...Show moreLast updated: 18 days ago
    • Promoted
    Senior Developer

    Senior Developer

    CognizantChennai, Tamil Nadu, India
    Please go through the job description carefully.This role is ideal for professionals with strong experience in managing IBM Infosphere DataStage environments and a passion for optimizing enterprise...Show moreLast updated: 5 days ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Tata Consultancy Serviceschennai, tamil nadu, in
    Notice Period- 0 to 15 days / Serving Notice period.Skills : GCP, PySpark, Python, HDFS, Hadoop, SQL.Good Hands on knowledge on GCP. Should have worked on Data Migration projects, from On-prem to Clo...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Big Data

    Lead Big Data

    ConfidentialChennai
    Translate application storyboards and use cases into functional applications.Design, build, and maintain efficient, reusable, and reliable Java code. Ensure the best possible performance, quality, a...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Developer (Chennai / Gurgaon)

    Big Data Developer (Chennai / Gurgaon)

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    HDFS, Unix Script, Autosys ,Hive.Hands on experience on Spark framework, Unix scripting, Hive queries, writing UDF in Hive. Theortical knowledge and POC alone will not suffice.Good knowledge in Soft...Show moreLast updated: 26 days ago
    • Promoted
    Big Data Developer

    Big Data Developer

    USTchennai, tamil nadu, in
    The ideal candidate should demonstrate a deep understanding of big data concepts, programming fundamentals, and the ability to solve complex problems related to scalability, failure handling, and o...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Engineer

    Big Data Engineer

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    Chennai, Bangalore, Hyderabad, Mumbai, Kolkata, Pune, Indore, Ahmedabad, Kochi, Gurgaon.HDFS, Hive, Spark, Sqoop, Flume, Oozie, Unix Script, Autosys. Hands-on experience in Big data, Hadoop.Hands-on...Show moreLast updated: 18 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Veraxionchennai, tamil nadu, in
    Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 15 days ago