Etl Architect

Position- ETL Architect

Location- Bengaluru, chennai

Experience- 8 to 11 Years

Notice period- 0 to 6 o Days or Serving NP

Job Description

• 6+ years of experience Developing, deploying, and monitoring end to end data integration pipelines with extensive knowledge of evaluation metrics and best practices.
• 6+ years Data Warehouse / Data Lake Architecture and Development.
• 5+ years Data Modeling & Architecture with strong programming program
• 3+ years’ experience on Cloud-Native Solutions (In AWS, Azure GCP)
• ETL / ELT, data Pipelines, Data Quality, blueprints development.
• Data Streaming framework (Kafka, AWS kinesis, AWS SQS or similar)
• Non-Relational Database experience (Document DB, Graph DB, etc.)
• Cloud-Native data integration & analytics services (AWS Glue, S3, Lambda, EMR, Azure Synapse, Azure Data Factory, Azure Data lake, Databricks etc..)
• AI / ML experience is a great advantage (Jupiter& / Python / Apache Spark)
• Data API, Embedded Analytics, Event-Driven Microservices architecture exp.
• Experience in SQL, Apache Spark, Python, Java / Scala.
• Data Integration (AWS Glue), Data Streaming (Kafka), and transformation
• A strong DataOps, DevOps, MLOps, Data & Analytics background
• Understanding of data structures, data modeling and data architecture
• Cloud-Native databases (SQL / NoSQL), RDS, DynamoDB, Snowflake. Redshift, BigQuery
• Strong communication skills and ability to work with ambiguity.
• Able to provide direction / support to data engineering team members.
• Strong architectural knowledge for data integration patterns and their pros and cons.
• Strong knowledge of data quality, metadata management, security frameworks / tools implemented for data on cloud architecture
• Skillful resource to understand customer needs and provide target solutions, which is scalable, reliable, and highly available.