Talent.com
This job offer is not available in your country.
Big Data Developer

Big Data Developer

BayOne SolutionsChennai, IN
3 hours ago
Job description

Job Description :

We are seeking a highly skilled Full Stack Big Data Engineer to join our team. The ideal candidate will have strong expertise in big data technologies, cloud platforms, microservices, and system design, with the ability to build scalable and efficient data-driven applications. This role requires hands-on experience across data engineering, backend development, and cloud deployment, along with a strong foundation in modern DevOps and monitoring practices.

Key Responsibilities :

  • Design, build, and optimize big data pipelines using Scala, PySpark, Spark SQL, Spark Streaming, and Databricks.
  • Develop and maintain real-time data processing solutions using Kafka Streams or similar event-driven platforms.
  • Implement cloud-based solutions on Azure, leveraging services such as Azure Data Factory (ADF) and Azure Functions.
  • Build scalable microservices with Core Java (8+) and Spring Boot.
  • Collaborate on system design , including API development and event-driven architecture.
  • Contribute to front-end development (JavaScript, React) as needed.
  • Ensure application reliability through monitoring tools such as Grafana, New Relic, or similar.
  • Utilize modern CI / CD tools (Git, Jenkins, Kubernetes, ArgoCD, etc.) for deployment and version control.
  • Work cross-functionally with data engineers, software developers, and architects to deliver high-quality solutions.

Qualifications :

  • 5+ years of professional experience as a Software / Data Engineer or Full Stack Engineer.
  • Strong programming skills in Scala, Python, and Java .
  • Experience with Databricks, Spark SQL, Spark Streaming , and PySpark .
  • Hands-on experience with Azure cloud services and data engineering tools.
  • Solid knowledge of microservices development with Spring Boot.
  • Familiarity with event-driven platforms such as Kafka.
  • Experience with CI / CD pipelines and containerization / orchestration tools.
  • Strong problem-solving and communication skills.
  • Bachelor’s or master’s degree in computer science, Engineering, or a related field (preferred).
  • Nice to Have :

  • Experience with API design and event-driven architecture .
  • Frontend development experience with React and JavaScript .
  • Create a job alert for this search

    Big Data Developer • Chennai, IN

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    TCS is hiring for GCP data engineer, please find the below JD.Experience range – 6 to 8 years.Location - Bengaluru / Chennai / Gurgaon. Skills Required - GCP BigQuery, Python.Hands-on experience in the ...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    CYGNVSChennai, India
    We’re looking for Data Engineers on our Analytics Engineering team - you’ll collaborate with teams across the globe to build pipelines and systems to deliver data insights critical to our customers...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    USEReadyChennai, Tamil Nadu, India
    Designation : Senior Data Engineer Location : India(Remote) Roles and Responsibilities : As a part of the Data Warehouse Team, implement technology improvements to Enterprise Data Warehouse environme...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    INFEC ServicesSaint Thomas Mount, Tamil Nadu, India
    Key Responsibilities Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and str...Show moreLast updated: 20 days ago
    • Promoted
    Data Engineer

    Data Engineer

    EXLChennai, Tamil Nadu, India
    Job Responsibilities - Collaborate with project stakeholders (client) to identify product and technical requirements.Develop, implement, and tune large-scale distributed systems and pipelines that...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Vriba SolutionsChennai, Tamil Nadu, India
    Role : Data Engineering Remote Looking for 5-10 years of Exp • Design, develop & maintain ETL / ELT pipelines • Ingest & transform data from APIs, DBs, files, streams • Build real-time & batch process...Show moreLast updated: 11 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Tekshiras Software Services Private LimitedSaint Thomas Mount, Tamil Nadu, India
    We’re Hiring – Senior Data Engineer (10+ Years Experience) Location : Hyderabad (Hybrid) We are looking for a seasoned professional with strong expertise in Data Engineering, Data Analysis, SQL an...Show moreLast updated: 8 days ago
    • Promoted
    Data Engineer

    Data Engineer

    LTIMindtreeChennai, Tamil Nadu, India
    We are hiring for AWS Data Engineer.Notice period - immediate to 30 days.Seeking a Specialist with 5 to 7 years of experience in AWS IoT Data Engineering and strong Python skills to design and impl...Show moreLast updated: 30+ days ago
    • Promoted
    Snowflake Data Engineer

    Snowflake Data Engineer

    DNA Technology ServicesChennai, IN
    We are looking for an experienced.The ideal candidate will have strong expertise in Snowflake, cloud platforms (AWS / Azure), and modern data engineering practices, with the ability to design and imp...Show moreLast updated: 14 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Xebiachennai, tamil nadu, in
    We’re Hiring : Data Engineer | Xebia.Any Xebia location (Hybrid, 3 days office per week).Immediate to 2 weeks – only apply if you can join early. Databricks, Python, SQL, and Postgres.The ideal candi...Show moreLast updated: 20 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Everisechennai, tamil nadu, in
    Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 21 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Eucloid Data SolutionsChennai, Tamil Nadu, India
    Eucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks pipelines using Python, Elasticsearch, SQL DB and Queu...Show moreLast updated: 22 days ago
    • Promoted
    • New!
    Senior AI / ML Engineer

    Senior AI / ML Engineer

    Beatly.AIAmbattur, Tamil Nadu, India
    We develop cutting-edge technologies that enhance decision-making and efficiency across critical domains.If you're passionate about creating meaningful AI products and thrive in a collaborative, in...Show moreLast updated: 19 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Cleantech Industry ResourcesChennai, Tamil Nadu, India
    Cleantech Industry Resources accelerates United States solar, battery storage and EV projects by providing turnkey development as a service including 100% internal systems engineering.The company d...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Straivechennai, tamil nadu, in
    The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 20 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kumaran SystemsChennai, Tamil Nadu, India
    Job Description : Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines. Exposure to Databricks data ingestion jobs along with incident managemen...Show moreLast updated: 23 days ago
    • Promoted
    Innefu - Data Analyst / Business Analyst

    Innefu - Data Analyst / Business Analyst

    Innefu Labs Pvt. Ltd.Tambaram,Tamil Nadu, India
    Department : Data Analytics.About Innefu Labs Pvt Ltd : Innefu Labs is a leading cybersecurity and data analytics company, providing innova...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    VAANTECHChennai, Tamil Nadu, India
    Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    Skills : ADB, ADF, ETL developer.Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeChennai, IN
    The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago