Netsmart - Data Architect - Spark/Big Data

Job Description:

We are seeking a highly experienced Data Architect to design, build, and govern scalable, secure, and high-performance data platforms on AWS. The ideal candidate will have deep expertise in modern data architectures, big data processing (Spark), strong hands-on programming skills (Python, SQL), and the ability to translate business requirements into robust data solutions.

Role & Responsibilities:

- Design and define enterprise-level data architecture aligned with business and technology strategy.

- Architect and implement cloud-native data platforms on AWS (data lakes, data warehouses, lakehouse architectures).

- Lead design and optimization of batch and real-time data pipelines using Spark and related frameworks.

- Establish data modeling standards (conceptual, logical, physical) for analytical and operational use cases.

- Ensure data quality, governance, security, and compliance across platforms.

- Provide architectural guidance for ETL/ELT frameworks, metadata management, and lineage.

- Collaborate with data engineering, analytics, DevOps, and business stakeholders.

- Evaluate and recommend tools, frameworks, and best practices for data stack modernization.

- Mentor senior data engineers and review solution designs and code.

- Support performance tuning, cost optimization, and scalability of AWS data services.

Preferred Candidate Profile:

- 13-17 years of overall IT experience with 8+ years in data architecture / big data roles.

- Strong hands-on expertise with:

1. Apache Spark (batch and streaming)

2. Python (data processing, orchestration, automation)

3. Advanced SQL (complex queries, performance tuning)

- Extensive experience with AWS data stack, including:

1. S3, Redshift, Glue, Athena, EMR

2. Kinesis / MSK (streaming)

3. Lambda, Step Functions

4. IAM, CloudWatch, encryption, security best practices

- Strong knowledge of data warehousing, data lakes, and lakehouse architectures.

- Experience with ETL/ELT tools and frameworks.

- Solid understanding of data governance, metadata, cataloging, and data quality frameworks.

- Proven ability to work with large-scale, high-volume, high-velocity data systems.

- Willingness to work Monday to Thursday from Bangalore office.

Good to Have:

- Experience with Iceberg / Delta Lake / Hudi.

- Exposure to Snowflake, Databricks, or other modern analytics platforms.

- Knowledge of CI/CD for data pipelines and Infrastructure as Code (Terraform/CloudFormation).

- Experience in domain-driven data architecture (banking, retail, healthcare, etc.).

- AWS Certifications (Data Analytics / Solutions Architect).

Soft Skills:

- Strong communication and stakeholder management skills.

- Ability to influence architectural decisions across teams.

- Strategic thinking with hands-on execution mindset.

- Leadership and mentoring Requires a bachelors degree in computer information systems or computer science or equivalent combination of experience and education.

(ref:hirist.tech)