Factspan - Senior Data Engineer - Snowflake Cortex AI

Job Description :

We are looking for an experienced Senior Data Engineer - Snowflake Cortex AI to design and build next-generation cloud-native data platforms powered by Snowflake and AI capabilities. The ideal candidate will have strong expertise in Python, SQL, Snowflake, Snowpark, dbt, and AWS, with hands-on experience in leveraging Snowflake Cortex AI to build intelligent data applications, automate analytics workflows, and develop scalable AI-enabled solutions.

This role requires collaboration with data scientists, ML engineers, analytics teams, and business stakeholders to create secure, high-performance data pipelines and AI-powered data products.

Key Responsibilities :

- Design, develop, and optimize scalable data pipelines using Snowflake, Python, SQL, and dbt.

- Build enterprise-grade ELT/ETL workflows for structured and semi-structured datasets.

- Develop AI-powered applications using Snowflake Cortex AI capabilities.

- Implement data transformations using Snowpark for advanced processing within Snowflake.

- Build and deploy AI/ML models integrated with Snowflake data platforms.

- Develop interactive applications using Snowflake Streamlit.

- Optimize Snowflake warehouse performance, query execution, clustering, and storage management.

- Create reusable data engineering frameworks and automation utilities.

- Design secure and governed data models supporting analytics and AI workloads.

- Integrate Snowflake with AWS services for ingestion, orchestration, and storage.

- Build APIs and services to expose AI-powered data insights to downstream applications.

- Collaborate with data scientists for feature engineering and model deployment.

- Monitor pipeline health, troubleshoot production issues, and ensure data quality.

- Implement CI/CD pipelines for data engineering projects.

- Document architecture, technical designs, and engineering best practices.

- Mentor junior engineers and drive engineering excellence across the team.

Required Skills :

- Strong programming experience in Python.

- Advanced SQL development and query optimization.

- Hands-on experience with Snowflake Data Cloud.

- Expertise in Snowpark for data processing.

- Experience working with Snowflake Cortex AI.

- Strong knowledge of dbt (Data Build Tool).

- Experience developing applications using Snowflake Streamlit.

- Good understanding of AI/ML model development and deployment.

- Experience building ETL/ELT pipelines.

- Strong knowledge of AWS cloud services.

- Experience with data modeling and dimensional modeling.

- Knowledge of data warehousing concepts.

- Experience with Git and version control.

- Understanding of CI/CD practices.

- Strong debugging and performance tuning skills.

Preferred Qualifications :

- Experience with Generative AI and Large Language Models (LLMs).

- Knowledge of Retrieval-Augmented Generation (RAG) architectures.

- Experience integrating vector search within Snowflake.

- Familiarity with REST APIs and microservices.

- Understanding of MLOps concepts and model lifecycle management.

- Exposure to Apache Airflow or similar workflow orchestration tools.

- Experience working in Agile/Scrum environments.

Key Competencies :

- Analytical and problem-solving mindset.

- Strong communication and stakeholder management skills.

- Ability to design scalable cloud-native data solutions.

- Ownership and accountability for end-to-end delivery.

- Ability to work independently in fast-paced environments.

- Continuous learning mindset for emerging AI technologies.

(ref:hirist.tech)