Talent.com
This job offer is not available in your country.
Big Data Developer

Big Data Developer

BayOne SolutionsBangalore, IN
19 hours ago
Job description

Job Description :

We are seeking a highly skilled Full Stack Big Data Engineer to join our team. The ideal candidate will have strong expertise in big data technologies, cloud platforms, microservices, and system design, with the ability to build scalable and efficient data-driven applications. This role requires hands-on experience across data engineering, backend development, and cloud deployment, along with a strong foundation in modern DevOps and monitoring practices.

Key Responsibilities :

  • Design, build, and optimize big data pipelines using Scala, PySpark, Spark SQL, Spark Streaming, and Databricks.
  • Develop and maintain real-time data processing solutions using Kafka Streams or similar event-driven platforms.
  • Implement cloud-based solutions on Azure, leveraging services such as Azure Data Factory (ADF) and Azure Functions.
  • Build scalable microservices with Core Java (8+) and Spring Boot.
  • Collaborate on system design , including API development and event-driven architecture.
  • Contribute to front-end development (JavaScript, React) as needed.
  • Ensure application reliability through monitoring tools such as Grafana, New Relic, or similar.
  • Utilize modern CI / CD tools (Git, Jenkins, Kubernetes, ArgoCD, etc.) for deployment and version control.
  • Work cross-functionally with data engineers, software developers, and architects to deliver high-quality solutions.

Qualifications :

  • 5+ years of professional experience as a Software / Data Engineer or Full Stack Engineer.
  • Strong programming skills in Scala, Python, and Java .
  • Experience with Databricks, Spark SQL, Spark Streaming , and PySpark .
  • Hands-on experience with Azure cloud services and data engineering tools.
  • Solid knowledge of microservices development with Spring Boot.
  • Familiarity with event-driven platforms such as Kafka.
  • Experience with CI / CD pipelines and containerization / orchestration tools.
  • Strong problem-solving and communication skills.
  • Bachelor’s or master’s degree in computer science, Engineering, or a related field (preferred).
  • Nice to Have :

  • Experience with API design and event-driven architecture .
  • Frontend development experience with React and JavaScript .
  • Create a job alert for this search

    Big Data Developer • Bangalore, IN

    Related jobs
    • Promoted
    Big Data Developer

    Big Data Developer

    Tata Consultancy ServicesBengaluru, Karnataka, India
    Chennai, Bangalore, Hyderabad, Mumbai, Kolkata, Pune, Indore, Ahmedabad, Kochi, Gurgaon.HDFS, Hive, Spark, Sqoop, Flume, Oozie, Unix Script, Autosys. Hands-on experience in Big data, Hadoop.Hands-on...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Engineer

    Big Data Engineer

    Tata Consultancy ServicesBengaluru, Karnataka, India
    Job Title : - Data Engineer - Pyspark.Good work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQL. Good Spark, Pyspark,Big Data experience.Spark UI / Optimization / debugging ...Show moreLast updated: 30+ days ago
    • Promoted
    Datastage Developer

    Datastage Developer

    Tata Consultancy ServicesGreater Bengaluru Area, India
    Bengaluru / Chennai / Hyderabad / Indore / Ahmedabad / Mumbai.Required Technical Skill Set : -.Datastage, UNIX Shellscripts, CA Autosys. Responsibility of / Expectations from the Role.Associate responsible for...Show moreLast updated: 1 day ago
    • Promoted
    Staff / Senior Data Engineer

    Staff / Senior Data Engineer

    HG Insightshosur, tamil nadu, in
    At HG Insights we provides AI-powered revenue growth intelligence and technology intelligence data to help B2B companies refine their go-to-market (GTM) strategies by analyzing market size, identif...Show moreLast updated: 11 days ago
    • Promoted
    Senior Data Engineer (AWS / Databricks)

    Senior Data Engineer (AWS / Databricks)

    Accoladehosur, tamil nadu, in
    The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 11 days ago
    • Promoted
    GCP BigData Engineer for one of the leading Tech Giant

    GCP BigData Engineer for one of the leading Tech Giant

    Acme ServicesBengaluru, Karnataka, India
    Bangalore, Pune, Mumbai, Gurgaon (Hybrid).We are looking for an experienced.The ideal candidate should have hands-on experience with. BigQuery, Dataflow, Dataproc, Pub / Sub, Cloud Storage, and relate...Show moreLast updated: 1 day ago
    • Promoted
    GCP Big Data Engineer

    GCP Big Data Engineer

    TalentmaticsBengaluru, Karnataka, India
    The ideal candidate will bring strong leadership capabilities, technical depth, and a proven track record of delivering end-to-end big data solutions in cloud environments.Lead and mentor teams in ...Show moreLast updated: 20 days ago
    • Promoted
    GCP Big Data Engineer for one of the leading IT MNC

    GCP Big Data Engineer for one of the leading IT MNC

    Acme ServicesBengaluru, Karnataka, India
    We are looking for an experienced.GCP using BigQuery, Dataflow, and Cloud Storage.Collaborate with cross-functional teams to deliver high-quality data solutions. Ensure performance, reliability, and...Show moreLast updated: 10 days ago
    • Promoted
    Bigdata + Cloudera Engineer

    Bigdata + Cloudera Engineer

    FractalBengaluru, Karnataka, India
    About the Company : Fractal is a leading AI and analytics company that helps businesses leverage data to drive growth and innovation. Our mission is to empower organizations with advanced analytics a...Show moreLast updated: 24 days ago
    • Promoted
    Data Engineer - BigQuery, Spark SQL, Microsoft Fabric - 10+ Years - Immediate joiners only

    Data Engineer - BigQuery, Spark SQL, Microsoft Fabric - 10+ Years - Immediate joiners only

    Blue Cloud Softech Solutions Limitedhosur, tamil nadu, in
    BigQuery, Spark SQL, Microsoft Fabric and who have worked on Big Data as this is a complex project.Data Engineer with over 10 years of experience designing and building large-scale data platforms a...Show moreLast updated: 1 day ago
    • Promoted
    Snowflake Developer

    Snowflake Developer

    Tata Consultancy ServicesGreater Bengaluru Area, India
    Job Title : Snowflake Developer.Required Skillset : Snowflake architecture, Snowpipe, data cloning, and time travel, SQL, Data Modeling. Deep understanding of cloud data warehousing and expertise in d...Show moreLast updated: 15 days ago
    • Promoted
    • New!
    Data Cloud Developer

    Data Cloud Developer

    People Prime Worldwidehosur, tamil nadu, in
    They balance innovation with an open, friendly culture and the backing of a long-established parent company, known for its ethical reputation. We guide customers from what’s now to what’s next by un...Show moreLast updated: 13 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Infogainhosur, tamil nadu, in
    Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    NOQhosur, tamil nadu, in
    Senior Data & Reporting Developer (Remote | India | Contract Role).NOQ Group is a technology-driven organization dedicated to delivering innovative data solutions for businesses in the food and bev...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    VAANTECHhosur, tamil nadu, in
    Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Saransh Inchosur, tamil nadu, in
    Data Engineer (Contract-to-Hire | Remote).Full-Time / Fixed-Term Contract (12 months, extendable based on performance).We are seeking a highly skilled. The ideal candidate will be hands-on, detail-o...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    Xebiahosur, tamil nadu, in
    We’re Hiring : Data Engineer | Xebia.Any Xebia location (Hybrid, 3 days office per week).Immediate to 2 weeks – only apply if you can join early. Databricks, Python, SQL, and Postgres.The ideal candi...Show moreLast updated: 21 days ago
    • Promoted
    Reporting Leader (Big Data / MES)

    Reporting Leader (Big Data / MES)

    Tata ElectronicsKolar, Karnataka, India
    Power BI, Tableau, and Grafana.Deliver multiple output format reports meeting OSAT customer needs.Develop portals for internal and external users to access reports with right level of access contro...Show moreLast updated: 23 days ago