Data Architect

Role : Architect - Data Experience Level : 8 Years and above

Work location : Bangalore, Mumbai OR Trivandrum (Hybrid)

What you’ll do : You will be working as a Data architect designing and delivering big data pipelines for structured and unstructured data that are running across multiple geographies, helping organizations achieve their business goals with use of data ingestion technologies, cloud services & DevOps. You will be working with Architects from other specialties such as Cloud engineering, Software engineering, ML engineering to create platforms, solutions and applications that cater to latest trends

Role & Responsibilities :

Work with cloud engineers and customers to solve big data problems by developing utilities for migration, storage and processing on Azure Cloud.

Design and build a cloud migration strategy for cloud and on-premise applications.

Diagnose and troubleshoot complex distributed systems problems and develop solutions with a significant impact at massive scale.

Build tools to ingest and jobs to process several terabytes or petabytes per day.

Design and develop next-gen storage and compute solutions for several large customers.

Define Data Architecture for the Data Science teams and participate in review and walk-through sessions for model fit and model productionisation

Provide thought leadership on data integrity & quality for data science workloads.

Be involved in proposals, RFPs and provide effort estimates, solution design etc.

Communicate with a wide set of teams, including Infrastructure, Network, Engineering, DevOps, SiteOps teams, and cloud customers.

Build advanced tooling for automation, testing, monitoring, administration, and data operations across multiple cloud clusters.

Better understanding of Data modelling and governance.

Skills expectation (Must Have Skills) :

8+ years’ experience of Hands-on in data structures, distributed systems, Hadoop and spark, SQL and NoSQL Databases.

Strong software development skills in at least one of : Python / R / Java or Scala, SQL commands.

Experience building and deploying cloud-based solutions at scale preferably in Azure.

Experience in developing Big Data solutions (migration, storage, processing).

Experience building and supporting large-scale systems in a production environment.

Designing and development of ETL pipeline.

Modern Azure data warehouse design skills.

Define data mapping and transformation rules between source and data warehouse and data lake Requirement gathering and understanding of the problem statement.

End-to-end ownership of the entire delivery of the project.

Designing and documentation of the solution.

Knowledge of RDBMS & NoSQL databases.

Any of Kafka, Kinesis, Cloud pub-sub, service bus.

Cloud Platforms – Azure (GCP & AWS Good to have)

Reporting tool exposure (at least one of Power BI, Tableau, Looker) o Enable best practices w.R.T data handling.

Expert knowledge of Master Data design and implementation Leadership qualities.

Provide thought leadership to the team and bring industry best practices to the project.

Ability to lead technology teams and provide them mentorship / support to accelerate performance.

Ability to handle conflicts effectively by managing internal and external stakeholders\

Experience in leading multiple large projects as well as a deep understanding of Agile developments

Effective communication with all the stakeholders involved.

Communicate clearly about complex subjects and technical plans with technical and non technical audiences.