Talent.com
digikey global capability center
Data Engineerdigikey global capability center • Bengaluru / Bangalore, India
Data Engineer

Data Engineer

digikey global capability center • Bengaluru / Bangalore, India
23 days ago
Job description

About the Role

We are seeking a highly experienced Data Engineer for the development and optimization of our modern cloud data platform infrastructure. This role is ideal for someone who thrives in a fast-paced environment, is passionate about data architecture, and has a deep understanding of data transformation, modeling, and orchestration using modern tools like dbt-core, Snowflake, and Python.

Key Responsibilities

  • Develop and implement scalable data pipelines using dbt-core, Python, and SQL to support analytics, reporting, and data science initiatives.
  • Optimize data models in Snowflake to support efficient querying and storage.
  • Development and maintenance of our data warehouse, ensuring data quality, governance, and performance.
  • Collaborate with cross-functional teams including data analysts, data architects, data scientists, and business stakeholders to understand data needs and deliver robust solutions.
  • Develop and support the best practices SOP for version control (Git), CI/CD pipelines, and data pipeline monitoring.
  • Task Ownership and Self driven, work in a culture of technical excellence and continuous improvement.
  • Independently execute POC to recommend new tools and technologies to enhance the data platform.
  • Provide on-going support for the existing ELT/ETL processes and procedures.
  • Other duties as assigned including but not limited to possible reallocation of efforts to other organizations per business need and management request.

Required Qualifications

  • Bachelor's degree in computer science or related field (16 years of formal education related to engineering)
  • Minimum 3 years of experience in data engineering with minimum of 1+ years of experience in Snowflake and Python.
  • Expert-level proficiency in SQL for data transformation and automation.
  • Experience with dbt-core for data modeling and transformation.
  • Strong hands-on experience in cloud platforms (Microsoft Azure) and cloud data platforms (Snowflake).
  • Proficiency with Git and collaborative development workflows. Familiarity with Microsoft VSCode or similar IDEs. Knowledge of Azure DevOps or Gitlab development operations and job scheduling tools.
  • Solid understanding of modern data warehousing architecture, dimensional modeling, ELT/ETL frameworks.
  • Excellent communication skills and the ability to translate complex technical concepts to non-technical stakeholders.
  • Proven expertise in designing and implementing batch and streaming data pipelines to support near real-time and large-scale data processing needs.

Preferred Qualifications

  • Experience working in a cloud-native environment (AWS, Azure, or GCP).
  • Familiarity with data governance, security, and compliance standards.
  • Prior experience with Apache Kafka (Confluent), DataOps.Live, Atlan.
  • Hands-on experience with orchestration tools (e.g., Active Batch, Airflow, Prefect) is a plus.


Skills Required
snowflake , Git, Microsoft Azure, Apache Kafka, Gitlab, Sql, Airflow, Azure Devops, Python
Create a job alert for this search

Data Engineer • Bengaluru / Bangalore, India

Similar jobs

Lead data engineer

CoffeeBeansbengaluru, karnataka, India

Founded in the year 2017, Coffee Beans specialises in offering high end consulting services in technology, product, and processes.We help our clients attain significant improvement in quality of de... Show more

 • Promoted

Data Engineer

Apex Systemsbengaluru, assam, in

The Data Engineer will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent t... Show more

 • Promoted

Data Engineer

Innodata India Private Limitedbangalore, karnataka, in

Design and implement data-driven solutions on GCP including BigQuery, Cloud Storage, Dataflow, Pub/Sub, and Looker/BI.Build ETL scripts using SQL and Python to extract, clean, and transform structu... Show more

 • Promoted

Data Engineer

Otomeyt AIbangalore, karnataka, in

Design, develop and maintain data solutions for data generation, collection, and processing.Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to ... Show more

 • Promoted

Data Engineer

BayOne Solutionsbangalore district, karnataka, in

Hiring Alert | Data Engineer (3–4 Years Experience).If you have strong expertise in.Design, develop, and optimize ETL pipelines and data workflows.Build interactive dashboards and reports using Pow... Show more

 • Promoted

Data Engineer

Azoca Technologiesbangalore district, karnataka, in

We are seeking a highly experienced.The ideal candidate will have strong expertise in building and managing scalable data lakes, designing robust ETL/ELT pipelines, and leading client-facing data i... Show more

 • Promoted

Databricks - Data Engineer

Tredence Inc.bengaluru, karnataka, India

We are looking for a highly skilled and hands-on Senior Databricks Engineer to join our team.This is a client-facing role requiring strong technical expertise, ownership mindset, proactive communic... Show more

 • Promoted

Data Engineer

Digilebangalore district, karnataka, in

As a key member of the QTC, you will play a pivotal role in migrating data from diverse sources and applications, developing solutions, validating systems, and addressing various challenges in ente... Show more

 • Promoted

Palantir Data Engineer

Capgemini Inventbengaluru, assam, in

Optimally between 4 – 16 years of experience as data engineer manipulating large data sets, creating data lakes and help building machine learning models using Palantir.Palantir with Python or PySp... Show more

 • Promoted

Data Engineer

Karixbangalore, karnataka, in

We are looking for a highly skilled Data Engineer with strong experience in building scalable ETL/ELT pipelines, distributed data systems, and modern lakehouse architectures.The ideal candidate wil... Show more

 • Promoted

Lead Data Engineer

CoffeeBeansbengaluru, assam, in

Founded in the year 2017, CoffeeBeans specialises in offering high end consulting services in technology, product, and processes.We help our clients attain significant improvement in quality of del... Show more

 • Promoted

Data Engineer

Experion Technologiesbangalore, karnataka, in

We are seeking a highly skilled Senior Data Engineer (Contractor) to design, build, and optimize scalable data platforms and pipelines.This role will play a critical part in developing modern data ... Show more

 • Promoted

Data Engineer

PropStreambangalore, India

We are looking for a hands-on, senior Databricks Architect to design, build, and govern our Lakehouse data platform from the ground up.You will own the end-to-end architecture of our data infrastru... Show more

 • Promoted

Data Engineer - Palantir Foundry

NP Groupbangalore district, karnataka, in

Data Engineer - Palantir Foundry, Workshop, AI Analytics, Pyspark & Typescript.Fully Remote - Long Term (initially 6-9 months) full time contract.We have an immediate requirement for an experienced... Show more

 • Promoted

Data Engineer

Wissen Technologybengaluru, assam, in

Key Responsibilities • Translate business requirement into queries against a set of relational tables and produce reporting based on the requirements.Design and build ETL pipeline from different da... Show more

 • Promoted

Data Engineer (Palantir Foundry)

edaribangalore, India

Data Engineer- Palantir Foundry.United Arab Emirates, which is one of the largest companies in the region.This position is a contract role with an initial duration of.We are looking for a passionat... Show more

 • Promoted

Senior Data Engineer (Lakehouse)

USTBengaluru, Republic Of India, IN

Process large-scale datasets using.Ingest data from multiple sources (APIs, databases, streaming platforms) into data lakes.Collaborate with data scientists, analysts, and business teams.GCP) for d... Show more

 • Promoted

Data Engineer

TEKsystems Global Services in Indiabengaluru, assam, in

Assess and modernize on-prem data platforms and ETL workflows to Microsoft Fabric.Design and implement scalable Lakehouse architectures using OneLake and Medallion framework.Develop Fabric Pipeline... Show more

 • Promoted

Data Engineer

Alegeusbangalore, karnataka, in

We are looking for an Expert Software Engineer to design, build, and scale our next-generation Data Platform and Data-Driven APIs.This role combines distributed data processing (Apache Spark) with ... Show more

 • Promoted

Databricks Data Engineer

Onebridgebangalore district, India

Onebridge, a Marlabs Company, is a global AI and Data Analytics Consulting Firm that empowers organizations worldwide to drive better outcomes through data and technology.Since 2005, we have partne... Show more