Talent.com
This job offer is not available in your country.
ArcOne - Team Lead - Advanced Data Systems

ArcOne - Team Lead - Advanced Data Systems

ArcOne AIPune
30+ days ago
Job description

Position Overview :

The Team Lead for Advanced Data Systems Delivery will lead a team responsible for delivering high-performance, scalable data solutions, with a focus on designing and optimizing data architectures for mission-critical Tier 1 systems.

This role requires deep expertise in deploying real-time and batch processing systems, utilizing the ArcOne AI platform to architect scalable topologies, tune critical components, and ensure compliance with NFRs and SLAs, while maintaining a strong foundation in data architecture principles.

Key Responsibilities :

Project Leadership & Delivery :

  • Lead the end-to-end delivery of advanced data systems for mission-critical Tier 1 applications, focusing on revenue management and other high-impact use cases.
  • Ensure solutions meet NFRs (e.g., scalability, performance, availability, security) and SLAs, delivering on time, within scope, and budget.
  • Utilize the ArcOne AI platform to design, scale, and tune system topologies to support complex real-time and batch workloads.

Data Architecture Leadership :

  • Architect and oversee the implementation of robust, scalable, and secure data architectures to support mission-critical applications.
  • Design data models, schemas, and storage solutions (e.g., data lakes, data warehouses, NoSQL databases) optimized for performance, scalability, and accessibility.
  • Implement and optimize ETL / ELT pipelines, ensuring efficient data ingestion, transformation, and integration across distributed systems.
  • Ensure data governance, integrity, and security standards are maintained across all data architectures.
  • Team Management :

  • Manage, mentor, and inspire a team of data engineers, architects, and performance engineers, fostering a culture of technical excellence and collaboration.
  • Provide technical guidance on data architecture, advanced data systems, and system optimization, ensuring alignment with industry best practices.
  • Conduct performance reviews, set team goals, and support career development for team members.
  • Technical Expertise :

  • Oversee the deployment of high-scale, mission-critical systems handling real-time (e.g., streaming, event-driven) and batch processing workloads.
  • Leverage the ArcOne AI platform to design and scale system topologies, tuning components (e.g., compute, storage, network) to meet performance and scalability requirements.
  • Optimize data processing frameworks (e.g., Apache Kafka, Spark, Hadoop, Flink) and databases (e.g., SQL, NoSQL) for low latency, high throughput, and reliability.
  • Lead investigations into performance regressions, scalability issues, or system failures, ensuring rapid resolution and root cause analysis.
  • Stakeholder Collaboration :

  • Act as the primary point of contact for stakeholders, translating business requirements into technical solutions with a focus on robust data architectures.
  • Collaborate with infrastructure, platform, AI, and product teams to align on system design, performance, and data architecture goals.
  • Communicate project progress, risks, and performance metrics to senior leadership and clients.
  • System Design & Optimization :

  • Design and implement data architectures that support scalability, fault tolerance, and high availability for Tier 1 applications.
  • Optimize real-time (e.g., Apache Kafka, Flink) and batch processing (e.g., Spark, Hadoop) workloads for high-scale environments.
  • Ensure data pipelines are optimized for performance, leveraging the ArcOne AI platform to automate and enhance topology scaling and component tuning.
  • Advocate for simplicity and rigor in system and data architecture design to address complex performance and scalability challenges.
  • Process & Standards :

  • Define and enforce best practices for advanced data systems delivery, data architecture, CI / CD pipelines, and performance testing strategies.
  • Develop and monitor SLAs / SLOs for latency, throughput, data availability, and system reliability, ensuring compliance with mission-critical standards.
  • Stay updated on industry trends in advanced data systems, data architecture, and AI technologies to drive innovation within the team.
  • Qualifications :

    Education : Bachelors or Masters degree in Computer Science, or a related field.

    Experience :

  • 7+ years of experience in delivering advanced data systems or similar solutions, with at least 3 years in a leadership or team lead role.
  • Proven track record of deploying high-scale, mission-critical Tier 1 systems with real-time and batch workloads.
  • Extensive experience in designing and implementing data architectures for large-scale, distributed systems, including data modeling, ETL / ELT pipelines, and storage solutions (e.g., data lakes, data warehouses).
  • Hands-on expertise with the ArcOne AI platform or similar AI-driven tools to design, scale, and tune system topologies.
  • Deep knowledge of performance tuning for data processing frameworks (e.g., Apache Kafka, Spark, Hadoop, Flink) and databases (e.g., SQL, NoSQL, data lakes).
  • Strong understanding of NFRs (e.g., scalability, availability, performance, security) and SLAs for Tier 1 systems.
  • Experience in revenue management or similar domains (e.g., pricing, forecasting, optimization) is a plus.
  • Technical Skills :

  • Proficiency in programming languages such as Python, Java, or Scala.
  • Expertise in data processing technologies (e.g., Apache Kafka, Spark, Hadoop, Flink) and cloud platforms (e.g., AWS, Azure, GCP).
  • Strong experience with data architecture tools and platforms, including data modeling (e.g., ERD, dimensional modeling), data lakes (e.g., Delta Lake, Iceberg), and data warehouses (e.g., Databricks, Dremio, DuckDB, Trino).
  • Proficiency with performance profiling tools (e.g., perf, eBPF) and observability systems (e.g., Prometheus, Grafana, OpenTelemetry).
  • Deep understanding of OS internals, networking, storage, and compute optimization (e.g., GPU utilization, memory management).
  • Experience with containerization (e.g., Docker, Kubernetes) and data orchestration tools (e.g., Airflow, Dagster).
  • Knowledge of AI / ML frameworks (e.g., TensorFlow, PyTorch) for optimizing data-driven solutions is a plus.
  • Soft Skills :

  • Exceptional leadership, communication, and stakeholder management skills.
  • Strong problem-solving abilities with a focus on simplicity, rigor, and collaboration.
  • Ability to navigate ambiguity and drive alignment across cross-functional teams.
  • Preferred :

  • Experience with the ArcOne AI platform for system design and optimization.
  • Familiarity with agile methodologies and tools like Jira or Trello.
  • Certification in cloud platforms (e.g., AWS Certified Solutions Architect), data engineering, or data architecture (e.g., TOGAF, DAMA-DMBOK)
  • (ref : hirist.tech)

    Create a job alert for this search

    Team Lead • Pune

    Related jobs
    • Promoted
    • New!
    Sr. Tech Lead - Microsoft Fabric Job

    Sr. Tech Lead - Microsoft Fabric Job

    YASH Technologiespune, India
    Data Engineering for analytical projects.Proven expertise in designing, developing, and deploying high-volume, end-to-end ETL pipelines for complex models, including batch, and real-time data integ...Show moreLast updated: less than 1 hour ago
    • Promoted
    • New!
    Lead Data Engineer –Azure

    Lead Data Engineer –Azure

    Admin Lookspune, India
    Urgently looking for highly experienced Lead Data Engineer with a proven track record in Azure data technologies and team leadership. The ideal candidate will have 12+ years of experience, including...Show moreLast updated: less than 1 hour ago
    • Promoted
    Lead Aws Data Engineer

    Lead Aws Data Engineer

    ACL Digitalpune, maharashtra, in
    Multi-year work experience as a Platform Lead, Delivery Leader or similar role.Good working knowledge of Aws Services, Python, Pyspark, data modelling. Knowledge of columnar and NoSQL databases, pre...Show moreLast updated: 18 days ago
    • Promoted
    • New!
    Tech Lead - Azure Databricks Job

    Tech Lead - Azure Databricks Job

    YASH Technologiespune, India
    YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences,...Show moreLast updated: less than 1 hour ago
    • Promoted
    • New!
    Tech Lead - Databricks Job

    Tech Lead - Databricks Job

    YASH Technologiespune, India
    Platform Design & Architecture.Lead the design and deployment of large-scale data solutions on Databricks.Establish best practices for notebook development, job orchestration, and cluster managemen...Show moreLast updated: less than 1 hour ago
    • Promoted
    • New!
    Technical Lead

    Technical Lead

    dentsubaner, India
    The purpose of this role is to provide technical guidance and suggest improvements in development processes.Develop required software features, achieving timely delivery in compliance with the perf...Show moreLast updated: less than 1 hour ago
    • Promoted
    Lead Azure Data Engineer

    Lead Azure Data Engineer

    RandomTreesPune, IN
    We’re a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologies. If you're passionate about building r...Show moreLast updated: 26 days ago
    • Promoted
    • New!
    Tech Lead - Microsoft Fabric Job

    Tech Lead - Microsoft Fabric Job

    YASH Technologiespune, India
    Data Engineering for analytical projects.Proven expertise in designing, developing, and deploying high-volume, end-to-end ETL pipelines for complex models, including batch, and real-time data integ...Show moreLast updated: less than 1 hour ago
    • Promoted
    Technical Lead

    Technical Lead

    Circanapune, maharashtra, in
    Let’s be unstoppable together!.At Circana, we are fueled by our passion for continuous learning and growth, we seek and share feedback freely, and we celebrate victories both big and small in an en...Show moreLast updated: 8 days ago
    • Promoted
    Technical Lead

    Technical Lead

    HCLTechpune, maharashtra, in
    Informatica EDC CAI / CDI Developer.Informatica CAI (Cloud Application Integration) - Integration Platform.API Development (REST / SOAP, Swagger / WSDL) - Web Services & APIs. Workflow Orchestration (Even...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Lead Data Engineer - Vice President

    Lead Data Engineer - Vice President

    Citipune, India
    The Applications Development Senior Manager is a senior management level position responsible for accomplishing results through the management of a team or department in an effort to establish and ...Show moreLast updated: less than 1 hour ago
    • Promoted
    • New!
    PaaS Extensions Lead

    PaaS Extensions Lead

    Oraclepune, India
    An experienced consulting professional who has an understanding of solutions, industry best practices, multiple business processes or technology designs within a product / technology family.Operates ...Show moreLast updated: less than 1 hour ago
    • Promoted
    • New!
    Tech Lead - AWS Data Engineer Job

    Tech Lead - AWS Data Engineer Job

    YASH Technologiespune, India
    Understanding the current business functionalities of the ETL processes and identifying areas for improvement.Designing and building AWS Glue workflows to replace existing ETL processes.Standardizi...Show moreLast updated: less than 1 hour ago
    • Promoted
    • New!
    SwiftIn-Azure Databricks Lead

    SwiftIn-Azure Databricks Lead

    Nexthirepune, India
    The ideal candidate will have a deep understanding of cloud-based data platforms, strong leadership skills, and a proven track record of managing complex data projects. Lead the architecture, design...Show moreLast updated: less than 1 hour ago
    • Promoted
    Data Engineer Team Lead

    Data Engineer Team Lead

    SGIpune, maharashtra, in
    To be discussed based on your skills and experience.Strong hands-on data engineering experience with a proven ability to design, build, and optimize scalable data pipelines in .Deep technical exper...Show moreLast updated: 6 days ago
    • Promoted
    • New!
    Lead Data Engineer

    Lead Data Engineer

    Lumiqpune, India
    LUMIQ is the leading Data and Analytics company in the Financial Services and Insurance (FSI) industry.We are trusted by the world's largest FSIs, including insurers, banks, AMCs, and NBFCs, to add...Show moreLast updated: less than 1 hour ago
    • Promoted
    Team Lead

    Team Lead

    Veca Consulting Pvt Ltdpune, maharashtra, in
    I need your support in sourcing candidates urgently.The candidate must have experience in.GIS analytics, spatial statistics, satellite or aerial imagery analysis, land use / land cover mapping, and c...Show moreLast updated: 8 days ago
    • Promoted
    • New!
    Lead Architect AWS

    Lead Architect AWS

    Fractalpune, India
    It's fun to work in a company where people truly BELIEVE in what they are doing!.AWS Practice Responsibilities : .Consult, Design, build and operationalize large scale enterprise data solutions using...Show moreLast updated: less than 1 hour ago