Talent.com
Data Engineer
Data EngineerLakshya Software Technologies Pvt. Ltd. • tamil nadu, tamil nadu, in
Data Engineer

Data Engineer

Lakshya Software Technologies Pvt. Ltd. • tamil nadu, tamil nadu, in
6 hours ago
Job description

Snowflake DBT Engineer total years of experience- 7+ years

Location- Pune / Mumbai / Chennai / Bangalore

Mandatory Skills : Snowflake- 6 years

DBT-6 years

Python-3 years

Airflow : 2 years

Azure cloud exp is good to have

5+ years of working experience in Snowflake, Databricks, DBT and Python on Azure / GCP / AWS in production environments and hands-on experience in developing moderate to complex ETL / ELT data pipelines

Strong in Apache Spark and Delta Lake, strong SQL and Python abilities, experience with data engineering and ETL pipelines

Advanced SQL in Snowflake (CTEs, Views, UDFs, Materialized Views) & DBT

Partitioning, clustering, and performance tuning in Snowflake

Streams, Tasks, and Snowpipe for real-time and incremental data pipelines

Cost and query optimization (e.g., using result cache, pruning, compute credits control)

DBT-Data Modeling, SQL Mastery,Jinja Templating, Workflow Optimization & Configuration, Data Loading and Cleaning

Hands on Python

3+ years of hands-on experience with Cloud Composer (Airflow) developing DAGs

3+ years of hands-on experience with Databricks and the ability to resolve complex SQL query performance issues

4+ years of ETL Python development experience; experience parallelizing pipelines a plus

Demonstrated ability to troubleshoot complex query, pipeline, and data quality issues

Develop, test, and deploy robust ETL pipelines on Snowflake on MS Azure / AWS / GCP Platform using, but not limited to, Snowflake / dbt / Databricks, Cloud Composer, and Cloud Run to ingest structured / unstructured data from on-prem SQL Server instances into Snowflake Models / Database / Schema

Implement data validation checks, error handling, and logging to ensure pipeline reliability

Automate deployment workflows using CI / CD pipelines (GitHub Actions, etc.) and infrastructure-as-code (IaC) tools

Monitor pipelines via Cloud Logging and Cloud Monitoring, implementing alerting for data latency or quality issues

Create a job alert for this search

Data Engineer • tamil nadu, tamil nadu, in

Related jobs
Azure Data Engineer – Databricks, DBT

Azure Data Engineer – Databricks, DBT

Tata Consultancy Services • Tamil Nadu, India, India
Role • •Azure Data Engineer – Databricks, DBT.Required Technical Skill Set • •Data Lake architecture, Azure Services – ADLS, ADF, Azure Databricks, Synapse. Build the solution for optimal extraction, tr...Show more
Last updated: 10 days ago • Promoted
Generative AI Engineer

Generative AI Engineer

LTIMindtree • Tamil Nadu, India, India
This role demands deep expertise in.Architect end-to-end GenAI solutions for R&D use cases such as.Evaluate multiple solution approaches (e. Document architectural decisions with.Word, Excel, PDF, d...Show more
Last updated: 14 days ago • Promoted
AI Engineer

AI Engineer

Prayag.ai • tamil nadu, tamil nadu, in
AI-native startup with a projected turnover of ₹5 crore, founded by visionary technologists and first-principle thinkers committed to transforming intelligence into real-world impact.Though only si...Show more
Last updated: 1 day ago • Promoted
Lead Data Engineer

Lead Data Engineer

VXI Global Solutions • Tamil Nadu, India, India
We are seeking talented and motivated Data Engineers to join our dynamic team and contribute to our mission of harnessing the power of data to drive growth and success. As a Data Engineer at VXI Glo...Show more
Last updated: 30+ days ago • Promoted
Data Engineer

Data Engineer

MRF • Tamil Nadu, India
Azure / SQL / Application - Data Engineer.Responsible to maintain the data required for managed application like Advanced Planning System, Dealer Management System, etc. Responsible for user access mana...Show more
Last updated: 2 days ago • Promoted
Lead Data Engineer

Lead Data Engineer

JMAN Group • Tamil Nadu, India
JMAN Group is a fast-growing data engineering & data science consultancy.We work primarily with Private Equity Funds and their Portfolio Companies to create commercial value using Data & Artificial...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer - Scala, Spark

Senior Data Engineer - Scala, Spark

NielsenIQ • tamil nadu, tamil nadu, in
Our NielsenIQ Technology teams are working on revamping multiple platform, a unified, global, open data ecosystem powered by Microsoft Azure. Our clients around the world rely on NielsenIQ’s data an...Show more
Last updated: 6 hours ago • Promoted • New!
Data Engineer

Data Engineer

Raretech • Tamil Nadu, India
RareTech is a leading IT Products and Services company catering to the needs of clients in Bahrain and the GCC region.The company focuses on providing tailored solutions, leveraging its expertise i...Show more
Last updated: 2 days ago • Promoted
Enterprise Data Architect

Enterprise Data Architect

CitiusTech • tamil nadu, tamil nadu, in
CitiusTech - Shaping Healthcare Possibilities.CitiusTech is a global IT services, consulting, and business solutions enterprise 100% focused on the healthcare and life sciences industry.We enable 1...Show more
Last updated: 2 hours ago • Promoted • New!
Data Engineer

Data Engineer

Tata Consultancy Services • tamil nadu, tamil nadu, in
Big Data / Hadoop Experience particularly in ingesting data and implementing Data ingestion pipelines, SQOOP, HADOOP, HDFS, HIVE, IMPALA, Java, Scala, Spark. Data Engineer with below responsibilities : ...Show more
Last updated: 30+ days ago • Promoted
AI Data Engineer

AI Data Engineer

Turing • tamil nadu, tamil nadu, in
We’re looking for experienced AI data engineers skilled in Python to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improve how AI models ...Show more
Last updated: 1 day ago • Promoted
Walk In Drive - Machine Learning Engineer

Walk In Drive - Machine Learning Engineer

GoML • tamil nadu, tamil nadu, in
Walk-In Drive — Machine Learning Engineers (Bangalore).Machine Learning Engineers / Gen AI Engineers to join our growing team! If you love solving real-world problems with AI, this is your chance to...Show more
Last updated: 6 hours ago • Promoted • New!
Senior Data Engineer

Senior Data Engineer

AppXcess Technologies • tamil nadu, tamil nadu, in
Enterprise AI Operational Platform.The role involves integrating data from.Sage 300, Paperless, WorkMax, Procore, Kojo, CRM platforms. You will architect scalable systems, build automated ETL / ELT wo...Show more
Last updated: 2 hours ago • Promoted • New!
Data Engineer (Airflow, Azure)

Data Engineer (Airflow, Azure)

Luxoft • Tamil Nadu, India
This project is part of a strategic initiative to migrate legacy on-premises data systems to a modern, scalable cloud-based data platform using Snowflake on Azure. The goal is to enhance data access...Show more
Last updated: 3 days ago • Promoted
AI Engineer

AI Engineer

V-Accel • tamil nadu, tamil nadu, in
Hiring : AI / ML Engineer – GenAI Specialist.Company : V-Accel AI Dynamics Pvt Ltd.Location : Chennai – TIDEL Park.Job Type : Full-time (Work from Office). V-Accel AI Dynamics is building an AI-first ecos...Show more
Last updated: 18 hours ago • Promoted • New!
GCP Data Engineer

GCP Data Engineer

Intellistaff Services Pvt. Ltd • tamil nadu, tamil nadu, in
Data Engineer with Python and GCP.Airflow / Astronomer / Cloud Composer (2+ Year).Tekton pipeline / CI-CD Pipeline.Strong all-round communication skills (written / presentation, one-to-one / group) & Exc...Show more
Last updated: 1 day ago • Promoted
Cloud Engineer

Cloud Engineer

Impetus • tamil nadu, tamil nadu, in
Impetus Technologies is a digital engineering company focused on delivering expert services and products to help enterprises achieve their transformation goals. We solve the analytics, AI, and cloud...Show more
Last updated: 1 day ago • Promoted
Backend Python Engineer

Backend Python Engineer

Turing • tamil nadu, tamil nadu, in
We’re looking for experienced Python engineers to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improve how AI models think, reason, and ...Show more
Last updated: 1 day ago • Promoted