Talent.com
Big Data Developer

Big Data Developer

BayOne SolutionsMangalore, IN
10 days ago
Job description

Job Description :

We are seeking a highly skilled Full Stack Big Data Engineer to join our team. The ideal candidate will have strong expertise in big data technologies, cloud platforms, microservices, and system design, with the ability to build scalable and efficient data-driven applications. This role requires hands-on experience across data engineering, backend development, and cloud deployment, along with a strong foundation in modern DevOps and monitoring practices.

Key Responsibilities :

  • Design, build, and optimize big data pipelines using Scala, PySpark, Spark SQL, Spark Streaming, and Databricks.
  • Develop and maintain real-time data processing solutions using Kafka Streams or similar event-driven platforms.
  • Implement cloud-based solutions on Azure, leveraging services such as Azure Data Factory (ADF) and Azure Functions.
  • Build scalable microservices with Core Java (8+) and Spring Boot.
  • Collaborate on system design , including API development and event-driven architecture.
  • Contribute to front-end development (JavaScript, React) as needed.
  • Ensure application reliability through monitoring tools such as Grafana, New Relic, or similar.
  • Utilize modern CI / CD tools (Git, Jenkins, Kubernetes, ArgoCD, etc.) for deployment and version control.
  • Work cross-functionally with data engineers, software developers, and architects to deliver high-quality solutions.

Qualifications :

  • 5+ years of professional experience as a Software / Data Engineer or Full Stack Engineer.
  • Strong programming skills in Scala, Python, and Java .
  • Experience with Databricks, Spark SQL, Spark Streaming , and PySpark .
  • Hands-on experience with Azure cloud services and data engineering tools.
  • Solid knowledge of microservices development with Spring Boot.
  • Familiarity with event-driven platforms such as Kafka.
  • Experience with CI / CD pipelines and containerization / orchestration tools.
  • Strong problem-solving and communication skills.
  • Bachelor’s or master’s degree in computer science, Engineering, or a related field (preferred).
  • Nice to Have :

  • Experience with API design and event-driven architecture .
  • Frontend development experience with React and JavaScript .
  • Create a job alert for this search

    Big Data Developer • Mangalore, IN

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIMangalore, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Manuh TechnologiesMangalore, IN
    S3, Glue, Redshift, EMR, Lambda).Develop automation scripts and tools using.Collaborate with data analysts, data scientists, and business stakeholders to ensure data availability and reliability.Tr...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer with Snowflake Experience- Contract

    Data Engineer with Snowflake Experience- Contract

    Gravity Infosolutions, Inc.Mangalore, IN
    Data Engineer with Snowflake & Data Vault 2.The project involves setting up a new software tool to meet audit requirements and is therefore critical. Most data to be migrated is already in Snowflake...Show moreLast updated: 10 hours ago
    • Promoted
    Senior Azure Data Engineer (8+ Yrs)

    Senior Azure Data Engineer (8+ Yrs)

    Delphi Consulting Middle EastMangalore, IN
    Ready to embark on a journey where your growth is intertwined with our commitment to making a positive impact? Join the Delphi family - where Growth Meets Values. Interviews and onboarding are condu...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalMangalore, IN
    REQUIRED SKILLS AND EXPERIENCE.Years of experience as a Data Engineer.Big Query, Cloud Storage, BigTable, Airflow, Dataproc, Dataflow. Strong SQL experience (NoSQL, SQL, Postgres).Experience leading...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    VeraxionMangalore, IN
    Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 1 day ago
    • Promoted
    Big Data Developer(Hive, Pyspark)

    Big Data Developer(Hive, Pyspark)

    Tata Consultancy Servicesmangalore, karnataka, in
    Big Data Developer(Hive, Pyspark).Years of Experience : 4 to 10 yrs.Date of Interview : 25th Oct, 2025.Mode of Interview : Virtual Drive( Cisco or WebEx). Hands-on experience of Hadoop, Python, PySpark...Show moreLast updated: 3 days ago
    • Promoted
    Senior Data Engineer – Snowflake & Python (Remote, India or EU)

    Senior Data Engineer – Snowflake & Python (Remote, India or EU)

    Az-Tec TalentMangalore, IN
    Remote
    Senior Data Engineer – Snowflake & Python (Remote, India or EU).ASAP (ideally next week following interview).SQL Server to Snowflake migration project. This is a high-impact role requiring strong ha...Show moreLast updated: 20 days ago
    • Promoted
    • New!
    lead Data Engineer

    lead Data Engineer

    CozzeraMangalore, IN
    Location : Remote ( 1 week from noida office then remote).We are looking for an accomplished Lead Data Engineer with 8–10 years of experience in. Delta Lake, Spark, MLflow), and modern orchestration ...Show moreLast updated: 20 hours ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    Coffeee.ioMangalore, IN
    Lead Data Engineer – SnapLogic.Experience : 8+ years (with 3+ years in SnapLogic ETL).Lead Data Engineer – SnapLogic.The ideal candidate will have hands-on experience with.This role requires technic...Show moreLast updated: 20 hours ago
    • Promoted
    • New!
    Teradata Developer

    Teradata Developer

    AdastraMangalore, IN
    We are looking for an experienced.The ideal candidate will have strong hands-on experience in Teradata development, advanced SQL expertise, and the ability to perform independent analysis and probl...Show moreLast updated: 20 hours ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    AIQUMangalore, IN
    We are hiring for Senior Data Engineer to join one of our major clients based out of KSA.Employment Type : Contract – 12 months & extendable. The Senior Data Engineer plays a lead role in designing, ...Show moreLast updated: 20 hours ago
    • Promoted
    Senior Data Platform Engineer

    Senior Data Platform Engineer

    Black Dog LabsMangalore, IN
    Remote (collaboration across time zones), India or LATAM preferred.Proficient English communication.Data Engineering / Backend Engineering / DevOps. We’re looking for a hands-on Senior Data Platform...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer - Scala

    Data Engineer - Scala

    Idyllic ServicesMangalore, IN
    Code Optimization , Shell Scripting, Data Engineering & Scala.Big Data tools like Spark, Hadoop & Hive.The Senior Data Engineer will be responsible for designing, developing, and maintaining scalab...Show moreLast updated: 9 days ago
    • Promoted
    Freelance Data Engineer

    Freelance Data Engineer

    upGradMangalore, IN
    We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 9 days ago
    • Promoted
    Staff / Senior Data Engineer

    Staff / Senior Data Engineer

    HG Insightsmangalore, karnataka, in
    At HG Insights we provides AI-powered revenue growth intelligence and technology intelligence data to help B2B companies refine their go-to-market (GTM) strategies by analyzing market size, identif...Show moreLast updated: 21 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Saransh Incmangalore, karnataka, in
    Data Engineer (Contract-to-Hire | Remote).Full-Time / Fixed-Term Contract (12 months, extendable based on performance).We are seeking a highly skilled. The ideal candidate will be hands-on, detail-o...Show moreLast updated: 11 days ago
    • Promoted
    Data Engineer_Immediate Joiners

    Data Engineer_Immediate Joiners

    VXI Global SolutionsMangalore, IN
    VXI Global Solutions is a BPO leader in customer service, customer experience, and digital solutions.Founded in 1998, the company has 40,000 employees in more than 40 locations in North America, As...Show moreLast updated: 11 days ago