Talent.com
This job offer is not available in your country.
Snowflake Developer - Python / Spark

Snowflake Developer - Python / Spark

First merdianChennai
7 days ago
Job description

Description :

We are seeking a highly skilled and experienced Snowflake Lead responsible for leading the design, development, and implementation of Snowflake-based data warehousing solutions. You will leverage your deep understanding of ETL and Data Warehousing concepts to build robust and scalable data pipelines. A key aspect of this role involves direct interaction with business users to gather and clarify requirements, ensuring that the delivered solutions meet their analytical needs.

Responsibilities :

Leadership & Delivery :

  • Lead a module or a team of developers in the design, development, and deployment of Snowflake solutions.
  • Take ownership of the end-to-end delivery of Snowflake modules, ensuring adherence to timelines and quality standards.
  • Provide technical guidance and mentorship to team members, fostering a collaborative and high-performing environment.
  • Contribute to project planning, estimation, and risk management activities.

Snowflake Expertise :

  • Utilize in-depth knowledge of Snowflake architecture, features, and best practices to design efficient and scalable data models and ETL / ELT processes.
  • Develop and optimize complex SQL queries and Snowflake scripting for data manipulation and transformation.
  • Implement Snowflake utilities such as SnowSQL, Snowpipe, Tasks, Streams, Time Travel, and Cloning as needed.
  • Ensure data security and implement appropriate access controls within the Snowflake environment.
  • Monitor and optimize the performance of Snowflake queries and data pipelines.
  • Integrate PySpark with Snowflake for data ingestion and processing.
  • Understand and apply PySpark best practices and performance tuning techniques.
  • Experience with Spark architecture and its components (e.g., Spark Core, Spark SQL, DataFrames).

    • ETL & Data Warehousing :

  • Apply strong understanding of ETL / ELT concepts, data warehousing principles (including dimensional modeling, star / snowflake schemas), and data integration techniques.
  • Design and develop data pipelines to extract data from various source systems, transform it according to business rules, and load it into Snowflake.
  • Work with both structured and semi-structured data, including JSON and XML.
  • Experience with ETL tools (e.g., Informatica, Talend, pyspark) is a plus, particularly in the context of integrating with Snowflake.

    • Requirements Gathering & Clarification :

  • Actively participate in requirement gathering sessions with business users and stakeholders.
  • Translate business requirements into clear and concise technical specifications and design documents.
  • Collaborate with business analysts and users to clarify ambiguities and ensure a thorough understanding of data and reporting needs.
  • Validate proposed solutions with users to ensure they meet expectations.

    • Collaboration & Communication :

  • Work closely with other development teams, data engineers, and business intelligence analysts to ensure seamless integration of Snowflake solutions with other systems.
  • Communicate effectively with both technical and non-technical stakeholders.
  • Provide regular updates on progress and any potential roadblocks.

    • Best Practices & Continuous Improvement :

  • Adhere to and promote best practices in Snowflake development, data warehousing, and ETL processes.
  • Stay up-to-date with the latest Snowflake features and industry trends.
  • Identify opportunities for process improvement and optimization.

    • Qualifications :

  • Bachelor's degree in Computer Science, Information Technology, or a related field.
  • Minimum of 5 years of relevant experience in data warehousing and ETL development, with a significant focus on Snowflake.
  • Strong proficiency in SQL and experience working with large datasets.
  • Solid understanding of data modeling concepts (dimensional modeling, star / snowflake schemas).
  • Experience in designing and developing ETL or ELT pipelines.
  • Proven ability to gather and document business and technical requirements.
  • Excellent communication, interpersonal, and problem-solving skills.
  • Snowflake certifications (e.g., SnowPro Core) are a plus.

    • (ref : hirist.tech)

    Create a job alert for this search

    Snowflake Developer • Chennai