Talent.com
This job offer is not available in your country.
Big Data Architect - HDFS / Scala

Big Data Architect - HDFS / Scala

Talent VelocityPune
12 days ago
Job description

Job Title : Big Data Architect

Experience : 8+ Years

Location : Nagpur / Pune (Onsite 5 Days Working)

Notice Period : 0 to 30 days max

About the Role :

We are looking for a highly skilled Big Data Architect to design and deliver scalable, production-grade big data solutions integrating Hadoop ecosystems with cloud platforms. The ideal candidate will have hands-on experience in architecting, optimizing, and deploying complex data pipelines while ensuring performance, cost efficiency, and best practices in data engineering.

Key Responsibilities :

  • Deliver reference architecture for Hadoop + Cloud integration tailored to enterprise-scale environments.
  • Deploy production-grade pipelines using HDFS, Spark, and Kafka for batch and real-time data processing.
  • Set up best practices and implement CI / CD frameworks for data engineering workflows.
  • Lead data performance optimization and cost-reduction strategies across the big data stack.
  • Collaborate with cross-functional teams (data engineers, data scientists, DevOps) to ensure robust, scalable solutions.
  • Provide technical leadership and mentor junior engineers in big data technologies.

Required Skills & Qualifications :

  • 8+ years of experience in Big Data architecture and engineering.
  • Expertise in the Hadoop ecosystem : HDFS, Hive, Sqoop, Oozie, Pig, Impala.
  • Strong knowledge of real-time processing frameworks : Kafka, Spark Streaming, Flink.
  • Hands-on experience with cloud platforms (AWS, GCP, or Azure) EMR, Dataproc, .HDInsight.
  • Proficiency in Python, Scala, or Java for big data solutions.
  • Experience with orchestration tools like Airflow or Prefect.
  • Familiarity with Lakehouse technologies : Delta Lake, Apache Iceberg.
  • Strong understanding of data modeling, data security, and governance best practices.
  • Excellent problem-solving, communication, and collaboration skills.
  • Preferred Qualifications :

  • Experience in cost-optimization strategies for large-scale data platforms.
  • Knowledge of containerization and orchestration tools (e.g., Docker, Kubernetes).
  • Familiarity with CI / CD tools like Jenkins, GitLab CI / CD.
  • Prior experience mentoring and leading engineering teams.
  • (ref : hirist.tech)

    Create a job alert for this search

    Big Data Architect • Pune

    Related jobs
    • Promoted
    Big Data Engineer - Spark / Hadoop

    Big Data Engineer - Spark / Hadoop

    WorkiFicientPune
    Roles and Responsibility : - Collaborate closely with Product Management and Engineering leadership to devise and build ...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Engineer - Hadoop / Spark / Hive

    Big Data Engineer - Hadoop / Spark / Hive

    True TalentsPune
    Job Title : Big Data Engineer Location : Bangalore / Pune Employment Type : Full Time ...Show moreLast updated: 9 days ago
    • Promoted
    Data Architect

    Data Architect

    Antal InternationalPune, Maharashtra, India
    Data Architecture, Data Governance, Data Warehousing, Data Modeling, Information Security, Azure / GCP / AWS & Excellent communication skills. Principal Duties and Responsibilities : .Working closely with...Show moreLast updated: 1 day ago
    • Promoted
    Hoonar Tekwurks - Big Data Lead - Hadoop / Hive

    Hoonar Tekwurks - Big Data Lead - Hadoop / Hive

    HoonartekPune
    Hoonartek Hiring : Tech Lead Big Data Location : Kharadi, Pune.Experience : 6Yearrs to 10 Years Domain : <...Show moreLast updated: 21 days ago
    • Promoted
    Data Architect

    Data Architect

    Momentive SoftwarePune
    Job Description : Key Responsibilities : Data Modeling & Architecture : ...Show moreLast updated: 30+ days ago
    • Promoted
    Data Architect

    Data Architect

    G10XPune, IN
    Senior Data Architect (15+ Years Experience).We are looking for a seasoned Data Architect to lead and shape enterprise-wide data initiatives. This role requires a strategic leader with deep technica...Show moreLast updated: 2 days ago
    • Promoted
    Data Architect

    Data Architect

    InfoBeansPune, IN
    Data Architect – Snowflake & Matillion.Snowflake, Matillion, Data Modeling, SQL, Python / Bash, Cloud Platforms (AWS / Azure). Immediate to 15 days preferred.The ideal candidate is proactive, self-direc...Show moreLast updated: 18 days ago
    • Promoted
    Lead Data Engineer / Solution Architect

    Lead Data Engineer / Solution Architect

    Talent VelocityPune
    Data Engineer / Solution Architect Location : Pune / Nagpur (WFO) Experience Required : 8+ Years <...Show moreLast updated: 13 days ago
    • Promoted
    Zensar Technologies - Databricks Architect

    Zensar Technologies - Databricks Architect

    Zensar TechnologiesPune
    Position : Databricks Architect Experience : 1215 Years Location : Pune / Bangalore / Hyderabad &...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Architect - Spark / Hadoop

    Big Data Architect - Spark / Hadoop

    Consulting PanditsPune
    Big Data Architect - Build the Future of Data Management Are you passionate about designing and implementing scalable and resilient data architectures? Do you have a ...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Data Architect

    Azure Data Architect

    Randstad DigitalPune
    Job Title : Azure Data Architect Location : Pune Experience : 8+ years Looking for Immediate Joiners only.Role : Da...Show moreLast updated: 30+ days ago
    • Promoted
    Principal / Senior Data Architect

    Principal / Senior Data Architect

    AaysPune, Maharashtra, India
    Position : Principal / Senior Data Architect Desired experience : 10+ years Your team You will act as a key member of the consulting team helping Clients to re-invent their corporate finance function...Show moreLast updated: 16 days ago
    • Promoted
    Data Architect

    Data Architect

    Tata TechnologiesPune, Maharashtra, India
    Experience with sound knowledge on database concepts like Entity-relationship, Data modeling, DDL and DML statements etc. Snowflake in data modelling, data pipelines, data governance and performance...Show moreLast updated: 27 days ago
    • Promoted
    Big Data Cloud Architect

    Big Data Cloud Architect

    RecruinPune, Maharashtra, India
    We are seeking an experienced Big Data Cloud Architect with 8–12 years in designing and implementing scalable big data solutions on Azure and AWS. The ideal candidate will have deep hands-on experti...Show moreLast updated: 27 days ago
    • Promoted
    Data Architect

    Data Architect

    InfogainPune, Maharashtra, India
    Design, develop, and optimize scalable data pipelines and workflows using Databricks and Apache Spark on AWS.Collaborate with data scientists, analysts, and other stakeholders to transform data int...Show moreLast updated: 4 days ago
    • Promoted
    Atgeir Solutions - Big Data / Cloud Architect

    Atgeir Solutions - Big Data / Cloud Architect

    Atgeir SolutionsPune
    We are looking for a Big Data / Cloud Architect to become part of Atgeir's Advanced Data Analytics team.The desired candidate is a Professional with proven track record of working on Big Data ...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Big Data Architect - Scala / Python

    Senior Big Data Architect - Scala / Python

    LIFTU TECHNOLOGY PRIVATE LIMITEDPune
    Job Summary : We are seeking an experienced Big Data Architect to lead the design and implementation of scalable, secure...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Engineer - Spark / Scala

    Big Data Engineer - Spark / Scala

    4Bell TechnologyPune
    Job Description : Core Responsibilities : - Design, build, and maintain robust d...Show moreLast updated: 30+ days ago