Talent.com
No longer accepting applications
Big Data Developer

Big Data Developer

ConfidentialPune, Chennai, Bengaluru / Bangalore
3 days ago
Job description

We are seeking an experienced Big Data Developer with 5–7 years of hands-on expertise in designing, developing, and optimizing large-scale data processing systems. The ideal candidate will have strong proficiency in Scala, Hadoop, Hive, and Spark, along with a solid understanding of distributed computing and data engineering best practices.

Key Responsibilities

  • Design, develop, and maintain big data solutions leveraging Hadoop, Hive, Spark, and Scala.
  • Build scalable and reliable data pipelines to ingest, transform, and process structured and unstructured data.
  • Optimize data processing workflows for performance, scalability, and cost efficiency.
  • Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality data solutions.
  • Implement best practices for data governance, security, and compliance.
  • Troubleshoot and resolve performance, data quality, and scalability issues in big data applications.
  • Contribute to architectural decisions and provide technical guidance to junior developers.

Required Skills & Qualifications

  • Experience : 5–7 years in big data development or data engineering roles.
  • Technical Skills :
  • Proficiency in Scala for data processing and application development.
  • Strong experience with Apache Spark (batch & streaming).
  • Hands-on expertise in Hadoop ecosystem (HDFS, YARN, MapReduce).
  • Proficient in Hive for data warehousing and querying.
  • Knowledge of SQL and performance tuning techniques.
  • Experience with distributed computing concepts and large-scale data processing.
  • Strong understanding of data structures, algorithms, and design patterns.
  • Familiarity with version control (Git), CI / CD, and Agile methodologies.
  • Skills Required

    Hadoop, Spark, Scala, Sql, Big Data, Spark And Scala, Scala Programming, Hive

    Create a job alert for this search

    Big Data Developer • Pune, Chennai, Bengaluru / Bangalore

    Related jobs
    • Promoted
    Big Data Developer

    Big Data Developer

    BayOne SolutionsChennai, IN
    We are seeking a highly skilled.The ideal candidate will have strong expertise in big data technologies, cloud platforms, microservices, and system design, with the ability to build scalable and ef...Show moreLast updated: 8 days ago
    • Promoted
    • New!
    Big Data Developer(Hive, Pyspark)

    Big Data Developer(Hive, Pyspark)

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    Big Data Developer(Hive, Pyspark).Years of Experience : 4 to 10 yrs.Date of Interview : 25th Oct, 2025.Mode of Interview : Virtual Drive( Cisco or WebEx). Hands-on experience of Hadoop, Python, PySpark...Show moreLast updated: 18 hours ago
    • Promoted
    Big Data Developer

    Big Data Developer

    HireAlphaChennai, Tamil Nadu, India
    Flink / Beam, Kafka, and Java / Scala.The ideal candidate will have deep knowledge of distributed systems, containerization, and security best practices, preferably in. Flink, Beam (or Spark Streaming)....Show moreLast updated: 4 days ago
    Big Data Developer

    Big Data Developer

    Talent WorxChennai, TN, IN
    Quick Apply
    We’re hiring for one of the world’s leading professional services firms, renowned for its commitment to innovation, excellence, and global impact. With a presence in over 150 countries, this organiz...Show moreLast updated: 22 days ago
    • Promoted
    Senior Big Data Developer - ETL

    Senior Big Data Developer - ETL

    MOURITechChennai
    Looking for a Senior Big Data Developer to design, build, and optimize data pipelines and analytics solutions.Candidates with prior exposure to the Ericsson Wallet Platform will be given preference...Show moreLast updated: 24 days ago
    • Promoted
    Cognos Developer - Databricks & Big Data

    Cognos Developer - Databricks & Big Data

    Lancesoft India Pvt LtdChennai
    About the Role : LanceSoft is seeking an experienced COGNOS Developer to design, develop, and optimize business intelligence solutions using IBM Cognos Analytics.The ...Show moreLast updated: 16 days ago
    • Promoted
    Staff / Senior Data Engineer

    Staff / Senior Data Engineer

    HG Insightschennai, tamil nadu, in
    At HG Insights we provides AI-powered revenue growth intelligence and technology intelligence data to help B2B companies refine their go-to-market (GTM) strategies by analyzing market size, identif...Show moreLast updated: 19 days ago
    • Promoted
    Big Data Engineer - Hadoop / Spark

    Big Data Engineer - Hadoop / Spark

    ImpacteersChennai
    Position Overview : We are looking for a skilled and detail-oriented Big Data Engineer to design, develop, and maintain scalable data pipelines and architectures.The ...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer - Big Data / Kafka

    Senior Data Engineer - Big Data / Kafka

    SMARTWORK IT SERVICESChennai
    Position : Senior Data Engineer (ETL / Big Data / Streaming) Experience : 810 years Location : Onsite Hybder...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    KaarTechChennai, Tamil Nadu, India
    Data Pipeline Development : Design, develop, and maintain scalable data pipelines to support various data analytics and reporting needs. Data Integration : Integrate data from multiple sources and ens...Show moreLast updated: 16 days ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Tata Consultancy Serviceschennai, tamil nadu, in
    Notice Period- 0 to 15 days / Serving Notice period.Skills : GCP, PySpark, Python, HDFS, Hadoop, SQL.Good Hands on knowledge on GCP. Should have worked on Data Migration projects, from On-prem to Clo...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Developer (Chennai / Gurgaon)

    Big Data Developer (Chennai / Gurgaon)

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    HDFS, Unix Script, Autosys ,Hive.Hands on experience on Spark framework, Unix scripting, Hive queries, writing UDF in Hive. Theortical knowledge and POC alone will not suffice.Good knowledge in Soft...Show moreLast updated: 8 days ago
    • Promoted
    Big Data Engineer - Hadoop / Hive

    Big Data Engineer - Hadoop / Hive

    Unison consulting pte ltdChennai
    Responsibilities : - Design, develop, and implement robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databases.Build and maintain scalabl...Show moreLast updated: 23 days ago
    • Promoted
    • New!
    Big Data Engineer

    Big Data Engineer

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    Chennai, Bangalore, Hyderabad, Mumbai, Kolkata, Pune, Indore, Ahmedabad, Kochi, Gurgaon.HDFS, Hive, Spark, Sqoop, Flume, Oozie, Unix Script, Autosys. Hands-on experience in Big data, Hadoop.Hands-on...Show moreLast updated: 12 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Straivechennai, tamil nadu, in
    The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 28 days ago
    • Promoted
    • New!
    Apply Now! Big Data Developer (Chennai / Gurgaon)

    Apply Now! Big Data Developer (Chennai / Gurgaon)

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    Role : Big Data Developer Experience : 6 Location : Chennai / Gurgaon Required Technical Skill Set : GCP , HDFS, Unix Script, Autosys ,Hive. Must Have : Hands on experience on Spark framework, Unix sc...Show moreLast updated: 3 hours ago
    • Promoted
    Reveille Technologies - Big Data Engineer

    Reveille Technologies - Big Data Engineer

    Reveille TechnologiesChennai
    Description : We are looking for highly skilled and motivated Big Data Engineers / Leads to join our team and drive the development of our next-generation data plat...Show moreLast updated: 16 days ago
    • Promoted
    Data Engineer - Big Data Technologies

    Data Engineer - Big Data Technologies

    Zyoin GroupChennai
    The core responsibilities for the job include the following : Data Pipeline Development : - Design, d...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Bahwan CyberTekchennai, tamil nadu, in
    We are seeking a skilled and motivated Data Engineer with 5–8 years of experience in building scalable data pipelines using Python, PySpark, and AWS services. The ideal candidate will have hands-on ...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Big Data Developer(Hive, Pyspark) (15h Left)

    Big Data Developer(Hive, Pyspark) (15h Left)

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    TCS is conducting Weekend Virtual Drive for Big Data Developer(Hive, Pyspark) Years of Experience : 4 to 10 yrs Location : Chennai Notice Period : 0- 90 days Date of Interview : 25th Oct, 2025 Mod...Show moreLast updated: 3 hours ago