Talent.com
This job offer is not available in your country.
Senior Big Data Architect - Scala / Python

Senior Big Data Architect - Scala / Python

LIFTU TECHNOLOGY PRIVATE LIMITEDPune
30+ days ago
Job description

Job Summary :

We are seeking an experienced Big Data Architect to lead the design and implementation of scalable, secure, and high-performing big data solutions. The ideal candidate will possess a deep understanding of big data technologies, data modeling, and cloud-based data services. You will collaborate with cross-functional teams including data scientists, engineers, and business stakeholders to transform business requirements into effective technical solutions. This is a hands-on, leadership role that includes architecture design, technology evaluation, mentorship, and client-facing responsibilities during pre- and post-sales & Responsibilities : Responsibilities :

  • Data Architecture Design : Design and implement scalable and fault-tolerant data architecture for batch and streaming systems.
  • Data Modeling : Develop efficient data models and database structures to support analytics

and business processes.

  • Data Integration : Integrate data from various structured and unstructured sources, including legacy systems.
  • Performance Optimization : Monitor and fine-tune data infrastructure for optimal performance.
  • Data Security & Governance : Ensure data security, compliance, and governance across platforms.
  • Collaboration : Work closely with data scientists, engineers, and business teams to gather requirements and deliver solutions.
  • Technology Evaluation : Research, evaluate, and recommend emerging data technologies and tools.
  • Mentorship : Mentor junior team members and promote best practices in data engineering and architecture.
  • Problem Solving : Diagnose complex data challenges and provide robust solutions.
  • Pre / Post Sales Support : Engage in client interactions to support technical sales, solutioning, and Required :
  • Total Experience : 10 - 12 years in IT, with at least 2+ years as a Big Data Architect.
  • Big Data Technologies : Hands-on experience with Hadoop, Spark, Hive, HBase, Kafka, etc.
  • Programming : Proficient in Python, Java, Scala, and Spark.
  • Cloud Platforms : Experience with AWS, Azure, or GCP-based data services (e.g., EMR,
  • Databricks, BigQuery).

  • Database Expertise : Strong knowledge of SQL and NoSQL databases (MongoDB, Cassandra,
  • etc.).

  • ETL Pipelines : Proven experience designing and implementing scalable ETL workflows.
  • Security & Authentication : Understanding of LDAP, Kerberos, Active Directory, SAML
  • configuration in distributed Skills :

  • API Design : Experience in building and integrating APIs for data exchange.
  • Data Visualization : Familiarity with visualization tools (Tableau, Power BI, or similar).
  • DevOps & Automation : Experience with CI / CD, containerization (Docker / Kubernetes), and automation tools.
  • Soft Skills : Strong communication, collaboration, and stakeholder management abilities.
  • Compliance & Governance : Knowledge of data privacy laws and regulatory requirements
  • (GDPR, HIPAA, etc.).

    (ref : hirist.tech)

    Create a job alert for this search

    Senior Data Architect • Pune

    Related jobs
    • Promoted
    AI Architect / Senior Data Scientist

    AI Architect / Senior Data Scientist

    CirrusLabspune, maharashtra, in
    Mandatory skills : Python, Gen AI, traditional ML, core Data scientist, ML Ops, Agentic AI.We are seeking an experienced AI Architect to join our dynamic team. This role combines deep technical exper...Show moreLast updated: 8 days ago
    • Promoted
    Data Architect

    Data Architect

    G10XPune, IN
    Senior Data Architect (15+ Years Experience).We are looking for a seasoned Data Architect to lead and shape enterprise-wide data initiatives. This role requires a strategic leader with deep technica...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DeltacubesPune, IN
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 16 days ago
    • Promoted
    Azure Data Architect

    Azure Data Architect

    Programmers.iopune, maharashtra, in
    Job Title : Azure Data Architect.Location : Hyderabad, pune (hybrid).Experience required : 12+ years.We are seeking a highly experienced S. The ideal candidate should bring strong expertise in SQL, ETL...Show moreLast updated: 8 days ago
    • Promoted
    • New!
    Data Architect

    Data Architect

    Antal Internationalpune, maharashtra, in
    Data Architecture, Data Governance, Data Warehousing, Data Modeling, Information Security, Azure / GCP / AWS & Excellent communication skills. Principal Duties and Responsibilities : .Working closely with...Show moreLast updated: 20 hours ago
    • Promoted
    Lead Data Architect

    Lead Data Architect

    Artefactpune, maharashtra, in
    Artefact is a global data and AI consulting services company that helps organizations transform data into tangible business results. We're looking for an experienced and dynamic.In this key role, yo...Show moreLast updated: 24 days ago
    • Promoted
    Data Architect

    Data Architect

    InfoBeansPune, IN
    Data Architect – Snowflake & Matillion.Snowflake, Matillion, Data Modeling, SQL, Python / Bash, Cloud Platforms (AWS / Azure). Immediate to 15 days preferred.The ideal candidate is proactive, self-direc...Show moreLast updated: 17 days ago
    • Promoted
    Senior Data Architect- SNOWFLAKE

    Senior Data Architect- SNOWFLAKE

    ComfNet Solutions GmbHPune, IN
    PM to 9 PM (with a few hours overlap in EST time zone – mandatory).A minimum of 8–10 years of experience in data engineering, encompassing the development and scaling of data warehouse and data lak...Show moreLast updated: 6 days ago
    • Promoted
    Big Data Architect - HDFS / Scala

    Big Data Architect - HDFS / Scala

    Talent VelocityPune
    Job Title : Big Data Architect Experience : 8+ Years Location : Nagpur / Pune (Onsite 5 Days Working) Notice Period : 0 to ...Show moreLast updated: 11 days ago
    • Promoted
    • New!
    Data Solutions Architect

    Data Solutions Architect

    Bristleconepune, maharashtra, in
    We are seeking an accomplished Data Solutions Architect with deep experience in designing, implementing, and optimizing modern cloud data platforms. The ideal candidate will expertly leverage Snowfl...Show moreLast updated: 20 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    ACL Digitalpune, maharashtra, in
    Python - Must have hands-on in Coding.SQL- Must have experience in writing queries.Must have experience in Data Lake / Lakehouse and open formats such as Iceberg, Hudi, Delta Lake" (remove Parquet).M...Show moreLast updated: 30+ days ago
    • Promoted
    Principal / Senior Data Architect

    Principal / Senior Data Architect

    AaysPune, IN
    Position : Principal / Senior Data Architect.You will act as a key member of the consulting team helping Clients to re-invent their corporate finance function by leveraging advanced analytics.You wil...Show moreLast updated: 15 days ago
    • Promoted
    Senior Big Data Engineer

    Senior Big Data Engineer

    VeltrisPune, IN
    Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries. We specialize in delivering next-gene...Show moreLast updated: 15 days ago
    • Promoted
    Data Architect

    Data Architect

    Bits In Glasspune, maharashtra, in
    Practice : Data Engineering & AI.Location : Office (Pune / Mohali / Hyderabad).Design, develop, and maintain scalable data pipelines and ETL processes to support downstream analytics and AI applicati...Show moreLast updated: 21 days ago
    • Promoted
    Big Data Cloud Architect

    Big Data Cloud Architect

    RecruinPune, India
    We are seeking an experienced Big Data Cloud Architect with 8–12 years in designing and implementing scalable big data solutions on Azure and AWS. The ideal candidate will have deep hands-on experti...Show moreLast updated: 6 days ago
    • Promoted
    Big Data Architect - Spark / Hadoop

    Big Data Architect - Spark / Hadoop

    Consulting PanditsPune
    Big Data Architect - Build the Future of Data Management Are you passionate about designing and implementing scalable and resilient data architectures? Do you have a ...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Sr. Data Architect - Snowflake (Urgent Hire)

    Sr. Data Architect - Snowflake (Urgent Hire)

    Reflections Info Systemspune, maharashtra, in
    We are looking for 10+ years experienced Sr.Working hours - 8 hours , with a few hours of overlap during EST Time zone.This overlap hours is mandatory as meetings happen during this overlap hours.W...Show moreLast updated: 20 hours ago
    • Promoted
    Data Architect

    Data Architect

    Infogainpune, maharashtra, in
    Design, develop, and optimize scalable data pipelines and workflows using Databricks and Apache Spark on AWS.Collaborate with data scientists, analysts, and other stakeholders to transform data int...Show moreLast updated: 5 days ago