AIA - Data Engineering - Director

AIA Data Engineering - Director

Location : Hyderabad

Summary : with 20+ years of experience, specializing in Spark, Java, AWS, and other cloud technologies, typically holds a leadership role focused on strategic data architecture, platform development, and team management.

Key Responsibilities

• Strategic Leadership & Architecture :

Define and execute the organization's data strategy and roadmap. Design and implement scalable, robust, and secure data architectures, leveraging cloud platforms (AWS, Azure, GCP) and big data technologies (Spark, Hadoop).

Oversee the design, development, and maintenance of enterprise-level data platforms, including data lakes, data warehouses, and real-time streaming solutions. Optimize data pipelines, ETL processes, and data storage for performance and cost-efficiency.

Provide deep technical expertise in distributed data processing (Spark), programming languages (Java, Scala, Python), and cloud services (AWS Glue, Kinesis, Redshift, S3, Lambda). Evaluate and integrate emerging data technologies and best practices.

Lead and mentor a team of data engineers, fostering a culture of technical excellence, collaboration, and continuous learning. Drive talent development, performance management, and resource allocation within the data engineering function.

Partner with executive leadership, product teams, data scientists, and other stakeholders to understand business requirements, translate them into technical solutions, and ensure successful delivery of data initiatives.

Establish and enforce data governance policies, security protocols, and compliance standards across all data platforms and pipelines.

Manage budgets, resources, and vendor relationships related to data engineering initiatives and cloud infrastructure.

Qualifications

Skills Required

Java, S3, Hadoop, Scala, AWS Glue, Redshift, Lambda, Gcp, Kinesis, Spark, Azure, Python, Aws