Data Architect
AccentureBengaluru, INProject Role : Data Architect Project Role Description : Define the data requirements and structure for the application.Model and design the application data structure, storage and integration.Must... Show more
Azure Data ArchitectAptean • Bengaluru / Bangalore
Azure Data Architect
Aptean • Bengaluru / Bangalore
3 days ago
Job description
Skills Required
fabric , Apache Spark, Azure Databricks, data engineering , cloud platform , Data Pipeline
We are looking for a seasoned Data Architect with deep expertise in Spark to lead the design and implementation of modern data processing solutions. The ideal candidate will have extensive experience in distributed data processing, large-scale data pipelines, and cloud-native data platforms.
This is a strategic role focused on building scalable, fault-tolerant, and high-performance data systems.
Key Responsibilities:
- Architect, design, and implement large-scale data pipelines using Spark (batch and streaming).
- Optimize Spark jobs for performance, cost-efficiency, and scalability.
- Define and implement enterprise data architecture standards and best practices.
- Guide the transition from traditional ETL platforms to Spark-based solutions.
- Lead the integration of Spark-based pipelines into cloud platforms (Azure Fabric/Spark pools).
- Establish and enforce data architecture standards, including governance, lineage, and quality.
- Mentor data engineering teams on best practices with Spark (e.g., partitioning, caching, join strategies).
- Implement and manage CI/CD pipelines for Spark workloads using tools like GIT or DevOps.
- Ensure robust monitoring, alerting, and logging for Spark applications.
Required Skills & Qualifications:
- 10+ years of experience in data engineering, with 7+ years of hands-on experience with Apache Spark (PySpark/Scala).
- Proficiency in Spark optimization techniques, Monitoring, Caching, advanced SQL, and distributed data design.
- Experience with Spark on Databricks and Azure Fabric.
- Solid understanding of Delta Lake, Spark Structured Streaming, and data pipelines.
- Strong experience in cloud platforms ( Azure).
- Proven ability to handle large-scale datasets (terabytes to petabytes).
- Familiarity with data lakehouse architectures, schema evolution, and data governance.
- Candidate to be experienced in Power BI, with at least 3+ years of experience.
Preferred Qualifications:
- Experience implementing real-time analytics using Spark Streaming or Structured Streaming.
- Certifications in Databricks, Fabric or Spark would be a plus.
Skills Required
fabric , Apache Spark, Azure Databricks, data engineering , cloud platform , Data Pipeline
Create a job alert for this search
Azure Data Architect • Bengaluru / Bangalore
Similar jobs
Data Architecture Specialist
AccentureBengaluru, INSkill required: Data Management - React.Designation: Data Architecture Specialist Qualifications:BE/BTech Years of Experience:7 to 11 years About Accenture Accenture is a global professional servic... Show more
RIS AI&Data Solution Architect Manager
AccentureBengaluru, INSummary: As a Solution Architect, you will engage in a dynamic and collaborative environment where your primary focus will be on translating client requirements into innovative and effective solu... Show more
- UAM Process Solution and Data Architect
ABBBangalore, Karnātaka, INAt ABB, we help industries run leaner and cleaner—and every person here makes that happen.You’ll be empowered to lead, supported to grow, and proud of the impact we create together.Join us and help... Show more
Process solution and Data Architect - Treasury
ABBBangalore, Karnātaka, INAt ABB, we help industries run leaner and cleaner—and every person here makes that happen.You’ll be empowered to lead, supported to grow, and proud of the impact we create together.Join us and help... Show more
Data Platform Architect
AccentureBengaluru, INProject Role : Data Platform Architect Project Role Description : Architects the data platform blueprint and implements the design, encompassing the relevant data platform components.Collaborates w... Show more
Senior Data Architect
JobtedBangalore, INChoosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues... Show more
Data Architecture Associate Manager
AccentureBengaluru, INSkill required: Data Management - Google Cloud SQL Designation: Data Architecture Associate Manager Qualifications:BE/BTech Years of Experience:10 to 14 years About Accenture Accenture is a global ... Show more
Cloud Architect
JobtedBangalore, INYour Role - At least 12 years of hands on experience building scalable enterprise solutions / products on AWS/Azure/GCP - An understanding of scalable and distributed SaaS based platform architect... Show more
Principal Data and Agentic Architect, Professional Services
AmazonBengaluru, KA, INAWS Sales, Marketing, and Global Services (SMGS) is responsible for driving revenue, adoption, and growth from the largest and fastest growing small- and mid-market accounts to enterprise-level cus... Show more
Process solution and Data Architect P2P
ABBBangalore, Karnātaka, INAt ABB, we help industries run leaner and cleaner—and every person here makes that happen.You’ll be empowered to lead, supported to grow, and proud of the impact we create together.Join us and help... Show more
Data Engineer Architect
JobtedBangalore, INYour Role - Data Architect – Data Governance, Data Modelling & Databricks - Define and implement enterprise data architecture, governance frameworks, and target-state data platforms leveraging the... Show more
RIS Solution Architect Manager (AMBG Data Platform)
AccentureBengaluru, INSummary: Looking for a person who can translate client requirements into differentiated and deliverable solutions Microsoft platform (Azure) Data and AI Solution architect.Experience on Microsoft D... Show more
Analytics Specialist Solution Architect
AmazonBengaluru, KA, INAre you passionate about helping customers unlock the full potential of their data? Amazon Web Services (AWS) is seeking an experienced Analytics Specialist Solution Architect to join our India WWS... Show more