Talent.com
This job offer is not available in your country.
Big Data Architect - HDFS / Scala

Big Data Architect - HDFS / Scala

Talent VelocityNagpur
10 days ago
Job description

Job Title : Big Data Architect

Experience : 8+ Years

Location : Nagpur / Pune (Onsite 5 Days Working)

Notice Period : 0 to 30 days max

About the Role :

We are looking for a highly skilled Big Data Architect to design and deliver scalable, production-grade big data solutions integrating Hadoop ecosystems with cloud platforms. The ideal candidate will have hands-on experience in architecting, optimizing, and deploying complex data pipelines while ensuring performance, cost efficiency, and best practices in data engineering.

Key Responsibilities :

  • Deliver reference architecture for Hadoop + Cloud integration tailored to enterprise-scale environments.
  • Deploy production-grade pipelines using HDFS, Spark, and Kafka for batch and real-time data processing.
  • Set up best practices and implement CI / CD frameworks for data engineering workflows.
  • Lead data performance optimization and cost-reduction strategies across the big data stack.
  • Collaborate with cross-functional teams (data engineers, data scientists, DevOps) to ensure robust, scalable solutions.
  • Provide technical leadership and mentor junior engineers in big data technologies.

Required Skills & Qualifications :

  • 8+ years of experience in Big Data architecture and engineering.
  • Expertise in the Hadoop ecosystem : HDFS, Hive, Sqoop, Oozie, Pig, Impala.
  • Strong knowledge of real-time processing frameworks : Kafka, Spark Streaming, Flink.
  • Hands-on experience with cloud platforms (AWS, GCP, or Azure) EMR, Dataproc, .HDInsight.
  • Proficiency in Python, Scala, or Java for big data solutions.
  • Experience with orchestration tools like Airflow or Prefect.
  • Familiarity with Lakehouse technologies : Delta Lake, Apache Iceberg.
  • Strong understanding of data modeling, data security, and governance best practices.
  • Excellent problem-solving, communication, and collaboration skills.
  • Preferred Qualifications :

  • Experience in cost-optimization strategies for large-scale data platforms.
  • Knowledge of containerization and orchestration tools (e.g., Docker, Kubernetes).
  • Familiarity with CI / CD tools like Jenkins, GitLab CI / CD.
  • Prior experience mentoring and leading engineering teams.
  • (ref : hirist.tech)

    Create a job alert for this search

    Big Data Architect • Nagpur

    Related jobs
    • Promoted
    Salesforce Data Cloud Architect

    Salesforce Data Cloud Architect

    RialtesNagpur, IN
    Job Description : Salesforce Data Cloud Lead.Freelance / Contract - 6 months.We are looking for an experienced.This role requires deep knowledge of. Salesforce Data Cloud (formerly Customer Data Plat...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Architect- SNOWFLAKE

    Senior Data Architect- SNOWFLAKE

    ComfNet Solutions GmbHNagpur, IN
    PM to 9 PM (with a few hours overlap in EST time zone – mandatory).A minimum of 8–10 years of experience in data engineering, encompassing the development and scaling of data warehouse and data lak...Show moreLast updated: 4 days ago
    • Promoted
    Data Architect

    Data Architect

    InfoBeansIndia, India
    Data Architect – Snowflake & Matillion.Snowflake, Matillion, Data Modeling, SQL, Python / Bash, Cloud Platforms (AWS / Azure). Immediate to 15 days preferred.The ideal candidate is proactive, self-direc...Show moreLast updated: 15 days ago
    • Promoted
    Principal / Senior Data Architect

    Principal / Senior Data Architect

    AaysNagpur, IN
    Position : Principal / Senior Data Architect.You will act as a key member of the consulting team helping Clients to re-invent their corporate finance function by leveraging advanced analytics.You wil...Show moreLast updated: 14 days ago
    • Promoted
    Data Architect

    Data Architect

    Best Infosystems Ltd.India
    Data Architect_Full-Time_Trivandrum / Bangalore / Chennai / Kochi.Trivandrum / Bangalore / Chennai / Kochi Exp : .Job Description : •Design and implement scalable, secure, and cost-effective data architectures us...Show moreLast updated: 30+ days ago
    • Promoted
    Data Architect

    Data Architect

    QuantiphiIndia
    Role : Technical Architect - Data Experience Level : 10 to 15 Years Work location : Mumbai, Bangalore, Trivandrum (Hybrid) Notice Period : Any. More than 8 years of experience in Technical, Solutioning,...Show moreLast updated: 30+ days ago
    • Promoted
    Cloud Data Architect

    Cloud Data Architect

    Bosch Global Software TechnologiesIndia
    Key Responsibilities Architecture DesignMinimum 2+ years of experience in architecting enterprise-scale Data platforms for large organizations or business units. Expertise in Designing and defining ...Show moreLast updated: 3 days ago
    • Promoted
    Big Data Cloud Architect

    Big Data Cloud Architect

    RecruinIndia
    We are seeking an experienced Big Data Cloud Architect with 8–12 years in designing and implementing scalable big data solutions on Azure and AWS. The ideal candidate will have deep hands-on experti...Show moreLast updated: 25 days ago
    • Promoted
    Lead Data Engineer / Solution Architect

    Lead Data Engineer / Solution Architect

    Talent VelocityNagpur
    Data Engineer / Solution Architect Location : Pune / Nagpur (WFO) Experience Required : 8+ Years <...Show moreLast updated: 11 days ago
    • Promoted
    Principal / Senior Data Architect

    Principal / Senior Data Architect

    Aays Advisory Pvt. Ltd.India
    Position : Principal / Senior Data Architect.Desired experience : 10+ years.Your team : You will act as a key member of the consulting team helping C...Show moreLast updated: 12 days ago
    • Promoted
    Senior Data Architect

    Senior Data Architect

    InfoCeptsIndia
    InfoCepts is a global leader of end-to-end data and analytics solutions with nearly 20 years’ experience enabling customers to derive value from a variety of data-driven capabilities.Unique among i...Show moreLast updated: 18 days ago
    • Promoted
    Senior Data Architect

    Senior Data Architect

    Tredence Inc.India
    Designation : Senior Manager (Databricks Architect).Bengaluru, Chennai, Kolkata, Gurugram, Pune and Hyderabad.Profile Summary : We are seeking an experienced professional who apart from the required...Show moreLast updated: 30+ days ago
    • Promoted
    Data Architect

    Data Architect

    Tata TechnologiesIndia
    Job Description for Profile : Location-Pune Must Have Technical Skills 10-13 Years Overall experience Experience with sound knowledge on database concepts like Entity-relationship, Data modeling, DD...Show moreLast updated: 25 days ago
    • Promoted
    Senior Architect - Data

    Senior Architect - Data

    QuantiphiIndia
    Role : Senior Architect - Data & Cloud Experience in Years.Work location : Mumbai / Bangalore (hybrid) Cloud : Any.More than 15 years of experience in Technical, Solutioning, and Analytical roles.Data ...Show moreLast updated: 24 days ago
    • Promoted
    Data Architect

    Data Architect

    ScaleneWorks People Solutions LLPIndia
    If you have strong expertise in.Key Skills & Experience : System Architect.SAFe Train, Data Engineering & BI (Power BI) Data & Reporting Platform (Power BI, DAX, SQL – AHDRP) Cloud Technologies.Micr...Show moreLast updated: 30+ days ago
    • Promoted
    Data Architect

    Data Architect

    Infogainnagpur, maharashtra, in
    Design, develop, and optimize scalable data pipelines and workflows using Databricks and Apache Spark on AWS.Collaborate with data scientists, analysts, and other stakeholders to transform data int...Show moreLast updated: 3 days ago
    • Promoted
    Architect - Big data and Cloud

    Architect - Big data and Cloud

    Societe Generale Global Solution CentreIndia
    Role : Cloud and Big data Architect.Role Description We are looking for skilled and passionate Azure Cloud experts with a strong focus on Big Data management and data quality skills to join our team...Show moreLast updated: 19 days ago
    • Promoted
    Data Architect

    Data Architect

    R SystemsIndia
    Job Title : Data Engineering Architect Experience : 10-16 Years Location : Pune & Noida Work Mode : Hybrid - Full time.Data Migration & Modernization • Lead the migration of data pipelines, models,...Show moreLast updated: 30+ days ago