Big Data Lead - ETL / Data Warehousing

About the Role :

We are seeking a highly experienced Big Data Lead with deep technical expertise in Informatica Intelligent Cloud Services (IICS) and Snowflake Cloud Data Platform. The ideal candidate will have a strong background in data engineering, solution architecture, and system integration with proven experience in retail and supply chain domain.

You will be responsible for designing, implementing, and optimizing large-scale data integration and analytics solutions that support business intelligence, reporting, and advanced analytics initiatives across the organization.

Key Responsibilities :

• Design and implement end-to-end data integration and analytics solutions using IICS and Snowflake.
• Develop scalable, secure, and high-performance data pipelines for ingesting, transforming, and loading data from multiple sources (structured, semi-structured, and unstructured).
• Define data modeling standards, data governance practices, and naming conventions within Snowflake.
• Architect data warehouse / lakehouse solutions optimized for performance, scalability, and cost efficiency.
• Collaborate with enterprise architects to align solutions with organizational data strategies.
• Develop and maintain ETL / ELT workflows using Informatica IICS, leveraging advanced transformations like Aggregator, Lookup, Joiner, Expression, and Router.
• Create and optimize Snowflake SQL scripts, stored procedures, UDFs, and task automation for performance tuning and parallel processing.
• Manage data ingestion from diverse sources Oracle, flat files, APIs, cloud storage (e.g., AWS S3, Azure Blob), etc.
• Migrate legacy Oracle PL / SQL and Informatica PowerCenter workflows to modern IICS and Snowflake environments.
• Implement data quality checks, error handling, and reconciliation mechanisms in ETL processes.
• Develop and manage IICS integrations between Snowflake and other enterprise applications (ERP, CRM, Supply Chain systems).
• Work with cloud platforms (AWS, Azure, GCP) to design secure and scalable data architectures.
• Integrate Snowflake with BI and analytics tools (Power BI, Tableau, Qlik, etc.) for reporting and visualization.
• Optimize cloud resources and pipelines for cost efficiency and performance improvements.
• Manage IICS tasks, schedules, runtime environments, and monitoring for operational excellence.
• Leverage domain experience in Retail and Supply Chain to understand business processes like inventory management, sales forecasting, demand planning, logistics, and order fulfillment.
• Work closely with business users to translate domain-specific requirements into robust data models and analytics solutions.
• Ensure data structures are designed to support key retail KPIs such as sales performance, customer segmentation, and supply chain efficiency.
• Enforce data governance, security, and compliance policies across all data assets.
• Implement role-based access controls (RBAC) and data masking in Snowflake.
• Monitor data usage, lineage, and quality using IICS data profiling and governance capabilities.
• Ensure all solutions adhere to data protection regulations (GDPR, CCPA, etc.) and organizational policies.
• Lead and mentor a team of data engineers and developers, providing technical direction and best practice guidance.
• Collaborate with business stakeholders, architects, project managers, and QA teams to deliver high-quality solutions on time.
• Conduct code reviews, enforce development standards, and promote a DevOps mindset for continuous integration and delivery.
• Stay abreast of emerging technologies in data integration, cloud data platforms, and analytics ecosystems.

Required Skills & Experience :

(ref : hirist.tech)