Talent.com
This job offer is not available in your country.
Big Data Developer

Big Data Developer

BayOne SolutionsThiruvananthapuram, IN
1 day ago
Job description

Job Description :

We are seeking a highly skilled Full Stack Big Data Engineer to join our team. The ideal candidate will have strong expertise in big data technologies, cloud platforms, microservices, and system design, with the ability to build scalable and efficient data-driven applications. This role requires hands-on experience across data engineering, backend development, and cloud deployment, along with a strong foundation in modern DevOps and monitoring practices.

Key Responsibilities :

  • Design, build, and optimize big data pipelines using Scala, PySpark, Spark SQL, Spark Streaming, and Databricks.
  • Develop and maintain real-time data processing solutions using Kafka Streams or similar event-driven platforms.
  • Implement cloud-based solutions on Azure, leveraging services such as Azure Data Factory (ADF) and Azure Functions.
  • Build scalable microservices with Core Java (8+) and Spring Boot.
  • Collaborate on system design , including API development and event-driven architecture.
  • Contribute to front-end development (JavaScript, React) as needed.
  • Ensure application reliability through monitoring tools such as Grafana, New Relic, or similar.
  • Utilize modern CI / CD tools (Git, Jenkins, Kubernetes, ArgoCD, etc.) for deployment and version control.
  • Work cross-functionally with data engineers, software developers, and architects to deliver high-quality solutions.

Qualifications :

  • 5+ years of professional experience as a Software / Data Engineer or Full Stack Engineer.
  • Strong programming skills in Scala, Python, and Java .
  • Experience with Databricks, Spark SQL, Spark Streaming , and PySpark .
  • Hands-on experience with Azure cloud services and data engineering tools.
  • Solid knowledge of microservices development with Spring Boot.
  • Familiarity with event-driven platforms such as Kafka.
  • Experience with CI / CD pipelines and containerization / orchestration tools.
  • Strong problem-solving and communication skills.
  • Bachelor’s or master’s degree in computer science, Engineering, or a related field (preferred).
  • Nice to Have :

  • Experience with API design and event-driven architecture .
  • Frontend development experience with React and JavaScript .
  • Create a job alert for this search

    Big Data Developer • Thiruvananthapuram, IN

    Related jobs
    • Promoted
    • New!
    Big Data Engineer

    Big Data Engineer

    Alef EducationKollam, IN
    Alef Education began with a bold idea : that every learner deserves a personalised and meaningful education experience.What started in 2016 as a small pilot programme in Abu Dhabi has evolved into o...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    Chief Data Scientist

    Chief Data Scientist

    ConfidentialKollam, IN
    We are Hiring for one of the Top.Most Software Product Development.Please find the details as below -.Here's what you can expect on a typical day : . Setup, Build and Grow the Team.You will work in cl...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    Senior Big Data Engineer

    Senior Big Data Engineer

    People Prime WorldwideThiruvananthapuram, IN
    Our client is a trusted global innovator of IT and business services, present in 50+ countries.They specialize in digital & IT modernization, consulting, managed services, and industry-specific sol...Show moreLast updated: 14 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    InfogainThiruvananthapuram, IN
    Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    NOQThiruvananthapuram, IN
    Senior Data & Reporting Developer (Remote | India | Contract Role).NOQ Group is a technology-driven organization dedicated to delivering innovative data solutions for businesses in the food and bev...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer

    Data Engineer

    People Prime WorldwideKollam, IN
    Our client is a trusted global innovator of IT and business services, present in 50+ countries.They specialize in digital & IT modernization, consulting, managed services, and industry-specific sol...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    AptologicsKollam, IN
    Aptologics is a global Data & AI company that simplifies complex data, builds scalable analytics platforms, and operationalizes AI to drive measurable outcomes. We deliver tailored solutions that he...Show moreLast updated: 14 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    IGT SolutionsKollam, IN
    Interested candidate please share resume on Kalyani.Design, develop, and maintain scalable data pipelines using Python and PySpark. Work with SQL and MongoDB to manage and query large datasets.Devel...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer

    Data Engineer

    XebiaKollam, IN
    We’re Hiring : Data Engineer | Xebia.Any Xebia location (Hybrid, 3 days office per week).Immediate to 2 weeks – only apply if you can join early. Databricks, Python, SQL, and Postgres.The ideal candi...Show moreLast updated: 22 days ago
    • Promoted
    • New!
    Data Engineer - Scala

    Data Engineer - Scala

    Idyllic ServicesKollam, IN
    Code Optimization , Shell Scripting, Data Engineering & Scala.Big Data tools like Spark, Hadoop & Hive.The Senior Data Engineer will be responsible for designing, developing, and maintaining scalab...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    Big Data Engineer – Azure

    Big Data Engineer – Azure

    Innova ESIKollam, IN
    Role : Big Data Engineer – Azure.Azure Databricks, Azure Data Factory, Azure Function apps, Apache Spark, Scala, Java, Apache Kafka, event stream and Big Data. Optional Skills : Airflow, Python.Overal...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    Data Engineer (Big Data / Kafka) - Remote / Contract / NOT for freelancers / Independent Contractors

    Data Engineer (Big Data / Kafka) - Remote / Contract / NOT for freelancers / Independent Contractors

    DautomThiruvananthapuram, IN
    Remote
    Job Description : Data Engineer (Big Data / Kafka).We are seeking a highly experienced Senior Data Engineer with a deep background in Big Data technologies to join our team. This is a contract role for...Show moreLast updated: 14 hours ago
    • Promoted
    Data Engineer - BigQuery, Spark SQL, Microsoft Fabric - 10+ Years - Immediate joiners only

    Data Engineer - BigQuery, Spark SQL, Microsoft Fabric - 10+ Years - Immediate joiners only

    Blue Cloud Softech Solutions LimitedThiruvananthapuram, IN
    BigQuery, Spark SQL, Microsoft Fabric and who have worked on Big Data as this is a complex project.Data Engineer with over 10 years of experience designing and building large-scale data platforms a...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIKollam, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 24 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data SolutionsKollam, IN
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 24 days ago
    • Promoted
    Data Engineer

    Data Engineer

    KeasisKollam, IN
    We are seeking a Data Engineer with strong Apache NiFi expertise to design and implement pipelines that move and transform data from Cloudera (HDFS / Hive / Impala) into Apache Iceberg tables, with dow...Show moreLast updated: 2 days ago
    • Promoted
    • New!
    Freelance Data Engineer

    Freelance Data Engineer

    upGradKollam, IN
    We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    Lead Data Architect

    Lead Data Architect

    ACL DigitalThiruvananthapuram, IN
    Technology Skills and Project Experience : .Data Engineer / Architect with proven experience on Big Data and Data Lakes on AWS. Scripts / Programming language : SQL, Python, PROC, Windows Functions.Need to...Show moreLast updated: 14 hours ago
    • Promoted
    Big Data Developer

    Big Data Developer

    BayOne SolutionsKollam, IN
    We are seeking a highly skilled.The ideal candidate will have strong expertise in big data technologies, cloud platforms, microservices, and system design, with the ability to build scalable and ef...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Data Engineer [T500-20906]

    Data Engineer [T500-20906]

    Delta Air LinesThiruvananthapuram, IN
    Delta Air Lines (NYSE : DAL) is the U.Powered by our employees around the world, Delta has for a decade led the airline industry in operational excellence while maintaining our reputation for award-...Show moreLast updated: 14 hours ago