Talent.com
This job offer is not available in your country.
Big Data Developer

Big Data Developer

BayOne SolutionsPrayagraj(Allahabad), IN
4 days ago
Job description

Job Description :

We are seeking a highly skilled Full Stack Big Data Engineer to join our team. The ideal candidate will have strong expertise in big data technologies, cloud platforms, microservices, and system design, with the ability to build scalable and efficient data-driven applications. This role requires hands-on experience across data engineering, backend development, and cloud deployment, along with a strong foundation in modern DevOps and monitoring practices.

Key Responsibilities :

  • Design, build, and optimize big data pipelines using Scala, PySpark, Spark SQL, Spark Streaming, and Databricks.
  • Develop and maintain real-time data processing solutions using Kafka Streams or similar event-driven platforms.
  • Implement cloud-based solutions on Azure, leveraging services such as Azure Data Factory (ADF) and Azure Functions.
  • Build scalable microservices with Core Java (8+) and Spring Boot.
  • Collaborate on system design , including API development and event-driven architecture.
  • Contribute to front-end development (JavaScript, React) as needed.
  • Ensure application reliability through monitoring tools such as Grafana, New Relic, or similar.
  • Utilize modern CI / CD tools (Git, Jenkins, Kubernetes, ArgoCD, etc.) for deployment and version control.
  • Work cross-functionally with data engineers, software developers, and architects to deliver high-quality solutions.

Qualifications :

  • 5+ years of professional experience as a Software / Data Engineer or Full Stack Engineer.
  • Strong programming skills in Scala, Python, and Java .
  • Experience with Databricks, Spark SQL, Spark Streaming , and PySpark .
  • Hands-on experience with Azure cloud services and data engineering tools.
  • Solid knowledge of microservices development with Spring Boot.
  • Familiarity with event-driven platforms such as Kafka.
  • Experience with CI / CD pipelines and containerization / orchestration tools.
  • Strong problem-solving and communication skills.
  • Bachelor’s or master’s degree in computer science, Engineering, or a related field (preferred).
  • Nice to Have :

  • Experience with API design and event-driven architecture .
  • Frontend development experience with React and JavaScript .
  • Create a job alert for this search

    Big Data Developer • Prayagraj(Allahabad), IN

    Related jobs
    • Promoted
    Senior Data Engineer – Snowflake & Python (Remote, India or EU)

    Senior Data Engineer – Snowflake & Python (Remote, India or EU)

    Az-Tec TalentPrayagraj(Allahabad), IN
    Remote
    Senior Data Engineer – Snowflake & Python (Remote, India or EU).ASAP (ideally next week following interview).SQL Server to Snowflake migration project. This is a high-impact role requiring strong ha...Show moreLast updated: 14 days ago
    • Promoted
    Data Steward

    Data Steward

    Insight GlobalPrayagraj(Allahabad), IN
    Collibra, Informatica EDC, Atlan).Proven experience translating technical data logic into.Strong communication, facilitation, and stakeholder management skills. Bachelor's degree in Computer Science...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    PASO CoPrayagraj(Allahabad), IN
    We’re Hiring : Senior Data Engineer | Remote (Pan India) | Full-Time.One of our client l is looking for a.If you love building data systems from the ground up and have hands-on Big Data experience, ...Show moreLast updated: 5 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    InfogainPrayagraj(Allahabad), IN
    Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    KPG99 INCPrayagraj(Allahabad), IN
    Duration- 12+ months with Extensions.REQUIRED SKILLS AND EXPERIENCE.Strong hands-on experience with Databricks for data processing and pipeline development. Proficiency in SQL for data querying, tra...Show moreLast updated: 5 days ago
    • Promoted
    Data Engineer (Big Data / Kafka) - Remote / Contract / NOT for freelancers / Independent Contractors

    Data Engineer (Big Data / Kafka) - Remote / Contract / NOT for freelancers / Independent Contractors

    DautomPrayagraj(Allahabad), IN
    Remote
    Job Description : Data Engineer (Big Data / Kafka).We are seeking a highly experienced Senior Data Engineer with a deep background in Big Data technologies to join our team. This is a contract role for...Show moreLast updated: 3 days ago
    • Promoted
    Senior Data Platform Engineer

    Senior Data Platform Engineer

    Black Dog LabsPrayagraj(Allahabad), IN
    Remote (collaboration across time zones), India or LATAM preferred.Proficient English communication.Data Engineering / Backend Engineering / DevOps. We’re looking for a hands-on Senior Data Platform...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    OWOWPrayagraj(Allahabad), IN
    Data Architecture & Infrastructure (40%) .Design and implement a multi-database architecture (MongoDB, Redis, Milvus, Neo4j, BigQuery) . Build scalable data pipelines for real-time conversation proc...Show moreLast updated: 16 hours ago
    • Promoted
    Big Data Engineer

    Big Data Engineer

    Alef EducationPrayagraj(Allahabad), IN
    Alef Education began with a bold idea : that every learner deserves a personalised and meaningful education experience.What started in 2016 as a small pilot programme in Abu Dhabi has evolved into o...Show moreLast updated: 3 days ago
    • Promoted
    Python Developer

    Python Developer

    Daply | Scaling Digital PublishingPrayagraj(Allahabad), IN
    IN ORDER TO BE CONSIDERED FOR THIS ROLE, YOU MUST SUBMIT AN APPLICATION HERE : .Daply is hiring a Python Developer with deep experience in data scraping. You will architect reliable crawlers, pipeline...Show moreLast updated: 13 days ago
    • Promoted
    Data Engineer

    Data Engineer

    XebiaPrayagraj(Allahabad), IN
    We’re Hiring : Data Engineer | Xebia.Any Xebia location (Hybrid, 3 days office per week).Immediate to 2 weeks – only apply if you can join early. Databricks, Python, SQL, and Postgres.The ideal candi...Show moreLast updated: 25 days ago
    • Promoted
    SAP Data Engineer (Datasphere)

    SAP Data Engineer (Datasphere)

    KPG99 INCPrayagraj(Allahabad), IN
    Duration : 12-month contract with extensions.Candidates' Core Skillset Must Be : .SAP ABAP, HANA / AMDP / CDS, SOAP / OData / Rest API’s etc.Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer - Scala

    Data Engineer - Scala

    Idyllic ServicesPrayagraj(Allahabad), IN
    Code Optimization , Shell Scripting, Data Engineering & Scala.Big Data tools like Spark, Hadoop & Hive.The Senior Data Engineer will be responsible for designing, developing, and maintaining scalab...Show moreLast updated: 3 days ago
    • Promoted
    Data Engineer_Immediate Joiners

    Data Engineer_Immediate Joiners

    VXI Global SolutionsPrayagraj(Allahabad), IN
    VXI Global Solutions is a BPO leader in customer service, customer experience, and digital solutions.Founded in 1998, the company has 40,000 employees in more than 40 locations in North America, As...Show moreLast updated: 5 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalPrayagraj(Allahabad), IN
    REQUIRED SKILLS AND EXPERIENCE.Years of experience as a Data Engineer.Big Query, Cloud Storage, BigTable, Airflow, Dataproc, Dataflow. Strong SQL experience (NoSQL, SQL, Postgres).Experience leading...Show moreLast updated: 30+ days ago
    • Promoted
    Freelance Data Engineer

    Freelance Data Engineer

    upGradPrayagraj(Allahabad), IN
    We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 3 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Mitra AIPrayagraj(Allahabad), IN
    We are seeking a candidate who is comfortable working on B shift (3PM - 11PM IST).JOB SPECIFIC DUTIES AND RESPONSIBILITIES. Develop and maintain ETL pipelines using FiveTran, DBT Cloud, and custom f...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    KeasisPrayagraj(Allahabad), IN
    We are seeking a Data Engineer with strong Apache NiFi expertise to design and implement pipelines that move and transform data from Cloudera (HDFS / Hive / Impala) into Apache Iceberg tables, with dow...Show moreLast updated: 5 days ago