Talent.com
This job offer is not available in your country.
Sprouts.ai - Senior Data Architect - ETL / PySpark

Sprouts.ai - Senior Data Architect - ETL / PySpark

Sprouts.aiChandigarh
30+ days ago
Job description

Job Title : Senior Data Architect

Location : Bangalore / Chandigarh

Job Type : Full-time

Experience : 10+ years

Job Summary are looking for an experienced Data Architect to lead the design, development, and optimization of our modern data infrastructure. The ideal candidate will have deep expertise in big data platforms, data lakes, lakehouse architectures, and hands-on experience with modern tools such as Spark clusters, PySpark, Apache Iceberg, the Nessie catalog, and Apache Airflow.

This role will be pivotal in evolving our data platform, including database migrations, scalable data pipelines, and governance-ready architectures for both analytical and operational use cases.

Key Responsibilities :

  • Design and implement scalable and reliable data architectures for real-time and batch processing systems
  • Evaluate and recommend data tools, frameworks, and infrastructure aligned with company goals
  • Develop and optimize complex ETL / ELT pipelines using PySpark and Apache Airflow
  • Architect and manage data lakes using Spark on Apache Iceberg and Nessie catalog for

versioned and governed data workflows

  • Perform data analysis, data profiling, data quality improvements, and data modeling
  • Lead database migration efforts, including planning, execution, and optimization
  • Define and enforce data engineering best practices, data governance standards, and schema
  • evolution strategies

  • Collaborate cross-functionally with data scientists, analysts, platform engineers, and business Skills & Qualifications :
  • 10+ years of experience in data architecture, data engineering, data security, data
  • governance, and big data platforms

  • Deep understanding of trade-offs between managed services and open-source data stack
  • tools, including cost, scalability, operational overhead, flexibility, and vendor lock-in

  • Strong hands-on experience with PySpark for writing data pipelines and distributed data processing
  • Proven expertise with Apache Iceberg, Apache Hudi, and the Nessie catalog for modern table formats and versioned data catalogs
  • Experience in scaling and managing Elasticsearch and PostgreSQL clusters
  • Strong experience with Apache Airflow for workflow orchestration (or equivalent tools)
  • Demonstrated success in database migration projects across multiple cloud providers
  • Ability to perform deep data analysis and compare datasets between systems
  • Experience handling 100s of terabytes of data or more
  • Proficiency in SQL, data modeling, and performance tuning
  • Excellent communication and presentation skills, with the ability to lead technical
  • conversations

    Nice to Have :

  • Experience in Sales, Marketing, and CRM domains, especially with Accounts and Contacts data
  • Knowledge in AI and vector databases.
  • Exposure to streaming data frameworks (Kafka, Flink, etc.)
  • Ability to support analytics and reporting initiatives
  • Why Join Us :

  • Work on cutting-edge data architectures using modern open-source technologies
  • Be part of a team transforming data operations and analytics at scale
  • Opportunity to architect high-impact systems from the ground up
  • Join a collaborative, innovation-driven culture
  • (ref : hirist.tech)

    Create a job alert for this search

    Senior Data Architect • Chandigarh

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Deltacubesbaddi, himachal pradesh, in
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 14 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Otomeyt AIpanchkula, haryana, in
    We are seeking a highly skilled 7+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 17 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EXLpanchkula, haryana, in
    We are seeking a highly skilled.You will work closely with cross-functional teams to provide thought leadership deliver robust, secure, and high-performance data solutions that empower analytics an...Show moreLast updated: 25 days ago
    • Promoted
    SAP Cloud Advisory Architect

    SAP Cloud Advisory Architect

    HCLTechpanchkula, haryana, in
    This is a customer-facing role where you will support the sales teams during the entire cycle of a RISE with SAP S / 4HANA Cloud Private Edition. Since it is a customer facing role, there will not be ...Show moreLast updated: 18 days ago
    • Promoted
    Emerson - Senior Data Engineer - ETL / SQL

    Emerson - Senior Data Engineer - ETL / SQL

    Emerson (Emerson)(2252)Chandigarh
    Job Summary - If you are looking for an opportunity in Technology Solutions and Development, Emerson has this exciting role for you! - The candid...Show moreLast updated: 30+ days ago
    • Promoted
    ETL LEAD with IBM DataStage experienced

    ETL LEAD with IBM DataStage experienced

    IntraEdgepanchkula, haryana, in
    ETL Developer – DataStage, AWS, Snowflake.We are looking for a talented and motivated ETL Developer / Senior Developer.You will work on building scalable and efficient data pipelines using.IBM Data...Show moreLast updated: 30+ days ago
    • Promoted
    SAP Data Architect

    SAP Data Architect

    RED Globalpanchkula, haryana, in
    Title : SAP Data Architect Consultant.Type : 12 month initial contract with extensions.We have a current opportunity for a SAP Data Architect on a contract basis. The position will be based in India.Y...Show moreLast updated: 7 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Dexianpanchkula, haryana, in
    We seek a Senior Data Engineer colleague to join our world-class client, one of the.Employment / Contract Type : Contract. Duration : 1 year (with potential to be extended).Hours per Week : 40 (Full-time...Show moreLast updated: 25 days ago
    • Promoted
    Data Architect

    Data Architect

    Infogainpanchkula, haryana, in
    Design, develop, and optimize scalable data pipelines and workflows using Databricks and Apache Spark on AWS.Collaborate with data scientists, analysts, and other stakeholders to transform data int...Show moreLast updated: 4 days ago
    • Promoted
    Principal / Senior Data Architect

    Principal / Senior Data Architect

    Aaysbaddi, himachal pradesh, in
    Position : Principal / Senior Data Architect.You will act as a key member of the consulting team helping Clients to re-invent their corporate finance function by leveraging advanced analytics.You wil...Show moreLast updated: 14 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Straivepanchkula, haryana, in
    The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 4 days ago
    • Promoted
    Data Migration Architect(AWS / Azure) (10+ yrs exp only)

    Data Migration Architect(AWS / Azure) (10+ yrs exp only)

    Tata Consultancy Servicesbaddi, himachal pradesh, in
    Join The Virtual Drive At TCS on 19 Sep 2025 for Skill Data Migration Architect (AWS / Azure).Proven experience delivering 2–3 full-cycle Data Migration projects on both AWS and Azure platforms.Deep ...Show moreLast updated: 7 days ago
    • Promoted
    Senior Big Data Engineer

    Senior Big Data Engineer

    Veltrispanchkula, haryana, in
    Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries. We specialize in delivering next-gene...Show moreLast updated: 13 days ago
    • Promoted
    Senior Data Architect- SNOWFLAKE

    Senior Data Architect- SNOWFLAKE

    ComfNet Solutions GmbHpanchkula, haryana, in
    PM to 9 PM (with a few hours overlap in EST time zone – mandatory).A minimum of 8–10 years of experience in data engineering, encompassing the development and scaling of data warehouse and data lak...Show moreLast updated: 4 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Tredence Inc.panchkula, haryana, in
    Design, build, and maintain scalable data pipelines using DBT and Airflow.Develop and optimize SQL queries and data models in Snowflake. Implement ETL / ELT workflows, ensuring data quality, performan...Show moreLast updated: 30+ days ago
    • Promoted
    ETL Developer

    ETL Developer

    Pinnacle Group, Inc.panchkula, haryana, in
    PTR Global is a leader in providing innovative workforce solutions, dedicated to optimizing talent acquisition and management processes. Our commitment to excellence has earned us the trust of busin...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Prudent Technologies and Consulting, Inc.baddi, himachal pradesh, in
    Snowflake Instance Management : Set up, configure, and manage between three to four new Snowflake data warehouse instances per quarter, tailored to support emerging products and analytics requiremen...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Saras Analyticspanchkula, haryana, in
    We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value. Our suite of work spans extraction, transformatio...Show moreLast updated: 23 days ago