This job offer is not available in your country.

Senior Data Engineer (ADB + Snowflake)

Persistent SystemsKollam, IN

11 hours ago

Job description

About Position :

We are looking for a highly skilled and innovative Senior Data Engineer with strong expertise in Azure Databricks, PySpark, and Snowflake, along with hands-on experience integrating AI tools such as ChatGPT, Copilot, or Databricks AI Functions. The ideal candidate will architect and build scalable data pipelines, enable intelligent data processing, and drive AI-powered analytics across enterprise datasets.

Role : Senior Data Engineer (ADB + Snowflake)
Location : Pune, Hyderabad, Bangalore
Experience : 6 to 12 Years
Job Type : Full Time Employment

What You'll Do :

Design and develop scalable data pipelines using Azure Databricks, PySpark, and Delta Lake.

Implement and optimize data warehousing solutions using Snowflake.

Integrate AI capabilities into data workflows using tools like ChatGPT, Copilot, Databricks AI Functions, or Snowflake Copilot. [learn.microsoft.com], [docs.snowflake.com]

Collaborate with data scientists and analysts to enable AI-powered insights, including summarization, classification, and sentiment analysis.

Build and maintain ETL / ELT workflows, ensuring data quality, performance, and governance.

Use LangChain, pyspark-ai, or similar libraries to embed LLMs into PySpark workloads. [justinmatters.co.uk]

Work with stakeholders to understand business requirements and translate them into technical solutions.

Ensure security, compliance, and performance optimization across cloud data platforms.

Document architecture, workflows, and best practices for AI-enhanced data engineering.

Expertise You'll Bring :

6–12 years of experience in data engineering, with strong hands-on expertise in Azure Databricks, PySpark, and Snowflake.

Deep understanding of Lakehouse architecture, Delta Lake, and data warehousing principles.

Proficiency in Python, SQL, and Spark for building scalable data pipelines and transformation workflows.

Experience integrating AI tools such as ChatGPT, Copilot, or Databricks AI Functions into data workflows for intelligent automation and enhanced analytics.

Familiarity with LangChain, pyspark-ai, or similar frameworks for embedding LLMs into data engineering tasks.

Knowledge of Snowflake Copilot, Snowpark, and AI-powered query generation.

Strong grasp of data governance, security, and metadata management using tools like Unity Catalog.

Experience with CI / CD pipelines, DevOps practices, and infrastructure-as-code tools (e.g., Terraform, GitHub Actions).

Ability to collaborate with data scientists, analysts, and business stakeholders to deliver AI-enhanced insights.

Excellent problem-solving, communication, and documentation skills.

Benefits :

Competitive salary and benefits package

Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications

Opportunity to work with cutting-edge technologies

Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards

Annual health check-ups

Insurance coverage : group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment :

Persistent Ltd. is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

We support hybrid work and flexible hours to fit diverse lifestyles.

Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.

If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

Let’s unleash your full potential at Persistent - persistent.com / careers

“Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.”

Create a job alert for this search

Data Engineer Snowflake • Kollam, IN

Related jobs

Promoted

Senior Data Engineer

HealthyMe AIAlappuzha, IN

We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 11 days ago

Promoted

Senior Data Engineer

Mitra AIThiruvananthapuram, IN

We are seeking a candidate who is comfortable working on B shift (3PM - 11PM IST).JOB SPECIFIC DUTIES AND RESPONSIBILITIES. Develop and maintain ETL pipelines using FiveTran, DBT Cloud, and custom f...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

USEReadyKollam, IN

Designation : Senior Data Engineer.As a part of the Data Warehouse Team, implement technology improvements to Enterprise Data Warehouse environment. In this role, you will be a key contributor to the...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

TalogyThiruvananthapuram, IN

This opportunity is ideal for a determined and proactive individual who has a wide range of skills in a variety of database administration, reporting and dashboarding disciplines.This role requires...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Vriba SolutionsThiruvananthapuram, IN

Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions. Data validation, quality & cleansing.Translate busin...Show moreLast updated: 13 days ago

Promoted

Enterprise Data & Analytics Architect

Nexora Tech SolutionsKollam, IN

Join Nexora Tech as a Strategic Partner – Enterprise Data & Analytics Architect.Former CIO – SBI, HSBC, and leadership positions at HDFC Bank, Capgemini, Oracle and Citi), is a.AI / ML strategy, IT m...Show moreLast updated: 3 days ago

Promoted

Senior Cloud Engineer

CareerXperts ConsultingThiruvananthapuram, IN

You’ll work closely with development, operations, and security teams to ensure optimal cloud performance and drive adoption of best practices across the organization. Design, deploy, and manage clou...Show moreLast updated: 30+ days ago

Promoted
New!

SAP Data Engineer (Datasphere)

KPG99 INCThiruvananthapuram, IN

Duration : 12-month contract with extensions.Candidates' Core Skillset Must Be : .SAP ABAP, HANA / AMDP / CDS, SOAP / OData / Rest API’s etc.Show moreLast updated: 11 hours ago

Promoted
New!

SAP Data Engineer (DataSphere / BW / HANA / Data Modeling)

KPG99 INCThiruvananthapuram, IN

Role : SAP Data Engineer (DataSphere / BW / HANA / Data Modeling).Duration : 12-month contract with extensions.Provide state-of-the-art technical support for the SAP Datasphere, BW4 Systems maintenance and...Show moreLast updated: 11 hours ago

Promoted

Senior Data Engineer

InfogainThiruvananthapuram, IN

Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago

Promoted

Senior Data Platform Engineer

Black Dog LabsThiruvananthapuram, IN

Remote (collaboration across time zones), India or LATAM preferred.Proficient English communication.Data Engineering / Backend Engineering / DevOps. We’re looking for a hands-on Senior Data Platform...Show moreLast updated: 30+ days ago

Promoted

Lead Data Engineer

ATOM Systems Private LimitedThiruvananthapuram, IN

We are seeking a highly skilled and driven Data Engineering Lead to lead our data engineering team.The ideal candidate combines strong leadership and technical expertise with the ability to deliver...Show moreLast updated: 3 days ago

Promoted

Senior Data Engineer

SAIVA AIKollam, IN

We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 25 days ago

Promoted

Senior AWS Data Engineer

CYAN360Alappuzha, IN

Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

KeasisThiruvananthapuram, IN

We are seeking a Data Engineer with strong Apache NiFi expertise to design and implement pipelines that move and transform data from Cloudera (HDFS / Hive / Impala) into Apache Iceberg tables, with dow...Show moreLast updated: 3 days ago

Promoted

Data Engineer

Kumaran SystemsThiruvananthapuram, IN

Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 25 days ago

Promoted

Lead Data Engineer

Eucloid Data SolutionsKollam, IN

Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 25 days ago

Promoted

Lead Data Engineer

Searce IncThiruvananthapuram, IN

Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 13 days ago

Promoted

Senior Data Engineer

PASO CoThiruvananthapuram, IN

We’re Hiring : Senior Data Engineer | Remote (Pan India) | Full-Time.One of our client l is looking for a.If you love building data systems from the ground up and have hands-on Big Data experience, ...Show moreLast updated: 3 days ago

Promoted

Senior Data Integration Engineer

IndsafriKollam, IN

Senior Data Integration Engineer.We are seeking a highly experienced and strategic Senior Data Integration Engineer to architect, build, and manage the data pipelines that power our customer intell...Show moreLast updated: 2 days ago