Talent.com
This job offer is not available in your country.
Capco - Senior Data Engineer - Python / Snowflake DB

Capco - Senior Data Engineer - Python / Snowflake DB

Capco Technologies Pvt LtdPune
21 days ago
Job description

Position : Senior Data Engineer with Python and Snowflake

Experience : 9+ Years

Location : Hinjewadi, Pune

Shift Timings : 12 : 30 PM - 9 : 30 PM (IST)

Work Model : Hybrid (3 days WFO : Tuesday, Wednesday, Thursday)

Job Summary :

We are seeking a highly skilled and experienced Senior Data Engineer with 9+ years of experience. The ideal candidate will have extensive hands-on expertise in Python and Snowflake, with a proven track record of developing data engineering and data science projects on AWS. You must have a deep understanding of implementing object-oriented programming in Python and hands-on experience in building Snowflake applications using its AI / Cortex platform. This role requires a professional who can handle the entire data lifecycle, from building scalable pipelines and managing data governance to leveraging cutting-edge AI features to create innovative solutions.

Key Responsibilities :

Data Engineering & Development :

  • Design and develop data engineering and data science projects on Snowflake / AI Cloud platform on AWS.
  • Write and maintain clean, scalable, and object-oriented code in Python, utilizing data structures like Pandas and data frames.
  • Build and deploy Python applications like Lambda on AWS, and deploy web applications using Docker containers or Kubernetes with CI / CD pipelines.
  • Develop applications using Snowpipe and Snowpark to move and handle unstructured data from cloud sources like AWS S3 and data lakes.

Snowflake & AI / Cortex Development :

  • Build applications using the Snowflake AI / Cortex platform, specifically with Cortex Agents, Cortex Search, and Cortex LLMs.
  • Implement context enrichment using prompts or Retrieval-Augmented-Generation (RAG) methods.
  • Design and implement applications for relevance search and custom interactions with LLMs.
  • Data Governance & Architecture :

  • Implement Snowflake's Account hierarchy model and define robust account-role-permission strategies.
  • Handle data sharing using Internal Data Marketplace and Data Exchanges.
  • Apply data governance and security concepts, including dynamic row / column-level data masking using Snowflake Tags.
  • Problem-Solving & Collaboration :

  • Continuously improve functionality through experimentation, performance tuning, and incorporating customer feedback.
  • Use Agile and SCRUM methodologies with Jira for project management.
  • Required Skills & Qualifications :

    Core Experience :

  • 9+ years of experience in data engineering and data science.
  • 7+ years of hands-on Python development experience.
  • Mandatory Technical Skills :

  • Proven experience with Snowflake and AWS cloud platform.
  • 1+ years of experience with Snowflake AI / Cortex platform.
  • Deep understanding of Object-Oriented Programming (OOP) in Python, data structures, and multi-threading concepts.
  • Experience with version control using Git or Bitbucket.
  • Proficiency in Snowpipe, Snowpark, and developing applications for unstructured data.
  • Strong knowledge of Snowflake's data governance and security features.
  • Experience with containerization using Docker or Kubernetes.
  • Professional Attributes :

  • Excellent analytical and problem-solving skills.
  • The ability to communicate complex technical concepts clearly.
  • Preferred Skills :

  • Experience with different data modeling techniques.
  • Experience in building Snowflake native applications using Streamlit.
  • Knowledge of application cache implementation within Python web applications.
  • Experience with duckdb and Apache Arrow.
  • Experience implementing CI / CD pipelines for Snowflake applications.
  • (ref : hirist.tech)

    Create a job alert for this search

    Senior Data Engineer • Pune

    Related jobs
    • Promoted
    Senior Data Engineer - Snowflake DB

    Senior Data Engineer - Snowflake DB

    SYNTURE OrganisationPune
    Job Description : - Should hold 10 + years of experience with strong skills with core understanding of cloud data ware...Show moreLast updated: 22 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DeltacubesPune, IN
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 15 days ago
    • Promoted
    Evolent Health - Senior Data Engineer - Python / SQL

    Evolent Health - Senior Data Engineer - Python / SQL

    Evolent HealthPune
    Responsibilities : - Lead the design, development, and deployment of complex data solutions, ensuring scalability and maintainability.Arch...Show moreLast updated: 22 days ago
    • Promoted
    Senior Cloud Engineer AWS

    Senior Cloud Engineer AWS

    Matrix USAPune, IN
    We are seeking an experienced AWS Developer proficient in Python and PySpark to design, develop, and maintain scalable, serverless data processing and workflow automation solutions on AWS.The ideal...Show moreLast updated: 4 days ago
    • Promoted
    Senior Data Engineer - Snowflake DB

    Senior Data Engineer - Snowflake DB

    HyrEzy Talent SolutionsPune
    Role : Senior Data Engineer (Snowflake) Location : Pune / Hyderabad Experience : 3 - 6 Years &...Show moreLast updated: 30+ days ago
    • Promoted
    Capgemini - Azure Purview Data Engineer - Python Frameworks

    Capgemini - Azure Purview Data Engineer - Python Frameworks

    capgeminiPune
    You Role - Architect, configure, and optimize Purview for data cataloging, classification, lineage, and compliance <...Show moreLast updated: 13 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    ACL DigitalPune, Maharashtra, India
    Years of Exp : 5 to 8 years Notice Period : Immediate Location : Pune Skills : - Data Engineer Python - Must have hands-on in Coding Pyspark / Spark-Must have Data modelling Must have AWS- Must have SQL-...Show moreLast updated: 30+ days ago
    • Promoted
    Intellias - Senior Data Engineer - Python Programming

    Intellias - Senior Data Engineer - Python Programming

    IntelliasPune
    Why Work at Intellias ? At Intellias, we are more than just a technology company - we are a trusted partner to some of the worlds most prestigious organizations.With ...Show moreLast updated: 21 days ago
    • Promoted
    ETL Senior Engineer

    ETL Senior Engineer

    TESTQ Technologies LimitedPune
    About the Role : We are looking for a highly skilled ETL Senior Engineer with AWS expertise to design, build, and optimize robust data pip...Show moreLast updated: 17 days ago
    • Promoted
    Senior Data Engineer - Azure Databricks

    Senior Data Engineer - Azure Databricks

    Arting DigitalPune
    Data Engineer (Databricks) Experience : 5+ Years Location : Pune / Ahmedabad Show moreLast updated: 19 days ago
    • Promoted
    Senior Data Engineer - DBT / Snowflake DB

    Senior Data Engineer - DBT / Snowflake DB

    BlueCloudPune
    We are looking for a Senior Data Engineer to join their team and contribute to the design and implementation of data engineering solutions. This role requires strong hands-on experience with Show moreLast updated: 6 days ago
    • Promoted
    Senior Data Engineer - Snowflake

    Senior Data Engineer - Snowflake

    YO HR ConsultancyPune
    Senior Data Engineer (Snowflake) Location- Pune / Hyderabad Experience- 3 to 6 years Must have : ...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer - Python

    Senior Data Engineer - Python

    Globner Consulting LLPPune
    Responsibilities : - Design, develop, and maintain scalable data pipelines using Python and modern data engineering tools. Understanding of banking data models, finan...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer - Python

    Senior Data Engineer - Python

    People Prime World WidePune
    About Client : Our client is a French multinational information technology (IT) services and consulting company, headquartered in Paris, France.Founded in 1967, It h...Show moreLast updated: 30+ days ago
    • Promoted
    Zywave - Senior Data Platform Engineer - Python / Tableau

    Zywave - Senior Data Platform Engineer - Python / Tableau

    ZywavePune
    About the job : Job Title : Senior Data Platform Engineer Location : Pune, India Work Mode : Wor...Show moreLast updated: 26 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIPune, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 7 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Prudent Technologies and Consulting, Inc.pune, maharashtra, in
    Snowflake Instance Management : Set up, configure, and manage between three to four new Snowflake data warehouse instances per quarter, tailored to support emerging products and analytics requiremen...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer - Snowflake DB

    Senior Data Engineer - Snowflake DB

    CNR EdTechPune
    Job Title : Senior Data Engineer (Snowflake) Location : Pune / Gurgaon (Hybrid / Onsite) Experience : 57 ye...Show moreLast updated: 10 days ago