Talent.com
No longer accepting applications
Data Engineer

Data Engineer

KeasisJodhpur, Rajasthan, India
7 days ago
Job description

We are seeking a Data Engineer with strong Apache NiFi expertise to design and implement pipelines that move and transform data from Cloudera (HDFS / Hive / Impala) into Apache Iceberg tables, with downstream integration into Snowflake and Databricks. The ideal candidate will have hands-on experience with modern data lakehouse architectures and will play a critical role in enabling scalable, governed, and high-performance data platforms.

Key Responsibilities

Data Ingestion & Pipeline Development=

Design, configure, and maintain NiFi data flows to extract, transform, and load data from Cloudera into Iceberg tables.

Implement streaming and batch ingestion pipelines with NiFi processors and custom scripting where needed.

Optimize NiFi workflows for scalability, reliability, and monitoring.

Data Lakehouse Enablement

Build and manage Apache Iceberg-based datasets for structured, semi-structured, and unstructured data.

Ensure schema evolution, partitioning, and metadata management in Iceberg.

Develop integration flows from Iceberg to Snowflake and Databricks for analytics, ML, and reporting use cases.

Integration & Orchestration

Work with Snowflake to ingest curated data from Iceberg for enterprise reporting and commercial insights.

Collaborate with Databricks teams to enable advanced analytics and machine learning use cases.

Integrate NiFi pipelines with orchestration tools (Airflow, Oozie, or AWS / Azure / GCP schedulers).

Performance, Security & Governance

Tune NiFi flows and Snowflake / Databricks ingestion for performance and cost optimization.

Implement role-based security and ensure compliance (HIPAA, GDPR, SOX if applicable).

Work with governance teams to enable lineage, metadata tracking, and auditability.

Qualifications

Bachelor’s degree in Computer Science, Information Systems, or related field.

5+ years of data engineering experience, with at least 2+ years working with Apache NiFi.

Strong experience with Cloudera ecosystem (HDFS, Hive, Impala, Spark).

Hands-on expertise with Apache Iceberg (schema evolution, time travel, partitioning, compaction).

Working knowledge of Snowflake and Databricks integration patterns.

Proficiency in SQL and one programming language (Python, Java, or Scala).

Understanding of data lakehouse architectures and ETL / ELT best practices.

Create a job alert for this search

Data Engineer • Jodhpur, Rajasthan, India

Related jobs
  • Promoted
Data Engineer

Data Engineer

TalogyJodhpur, IN
This opportunity is ideal for a determined and proactive individual who has a wide range of skills in a variety of database administration, reporting and dashboarding disciplines.This role requires...Show moreLast updated: 30+ days ago
  • Promoted
Data Engineer

Data Engineer

INFEC Servicesajit, rajasthan, in
Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms.Imple...Show moreLast updated: 27 days ago
  • Promoted
Data Engineer

Data Engineer

VAANTECHajit, rajasthan, in
Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 30+ days ago
  • Promoted
Data Engineer

Data Engineer

Manuh Technologiesjodhpur, India
S3, Glue, Redshift, EMR, Lambda).Develop automation scripts and tools using.Collaborate with data analysts, data scientists, and business stakeholders to ensure data availability and reliability.Tr...Show moreLast updated: 1 day ago
  • Promoted
Lead Data Engineer

Lead Data Engineer

Searce IncJodhpur, IN
Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 18 days ago
  • Promoted
Lead Data Engineer

Lead Data Engineer

ITQube LTDjodhpur, rajasthan, in
Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the A...Show moreLast updated: 18 days ago
  • Promoted
Senior Data Engineer (AWS / Databricks)

Senior Data Engineer (AWS / Databricks)

Accoladeajit, rajasthan, in
The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 18 days ago
  • Promoted
Data Engineer

Data Engineer

V2Softajit, rajasthan, in
Experience to deal with large stream volumes.Implementation experience ( atleast couple of projects ) in MSK / Flink / Spark / Scala. Very good knowledge on atleast 3 out of the 4 technologies.Desirable e...Show moreLast updated: 7 days ago
  • Promoted
Data Engineer

Data Engineer

AAA GlobalJodhpur, IN
Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team. In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 8 days ago
  • Promoted
Data Engineer

Data Engineer

Response Informaticsjodhpur, rajasthan, in
AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture. CICD - Terraform or CloudFo...Show moreLast updated: 18 days ago
  • Promoted
Data Engineer

Data Engineer

XebiaJodhpur, IN
We’re Hiring : Data Engineer | Xebia.Any Xebia location (Hybrid, 3 days office per week).Immediate to 2 weeks – only apply if you can join early. Databricks, Python, SQL, and Postgres.The ideal candi...Show moreLast updated: 28 days ago
  • Promoted
Data Engineer

Data Engineer

IntraEdgeJodhpur, IN
The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago
  • Promoted
Data Engineer

Data Engineer

Bahwan CyberTekajit, rajasthan, in
We are seeking a skilled and motivated Data Engineer with 5–8 years of experience in building scalable data pipelines using Python, PySpark, and AWS services. The ideal candidate will have hands-on ...Show moreLast updated: 30+ days ago
  • Promoted
Snowflake Data Engineer

Snowflake Data Engineer

Impactron Globaljodhpur, rajasthan, in
We’re seeking a Snowflake Data Engineer / Sr Data Engineer passionate about building scalable, cloud-native data solutions using Snowflake, dbt, and modern ETL frameworks.You will design, implement...Show moreLast updated: 7 days ago
  • Promoted
Data Engineer

Data Engineer

Mastekajit, rajasthan, in
Job Title : Databricks SQL Engineer (with Pharma / Life Sciences background).We are seeking a highly skilled Databricks SQL Engineer with Pharma background to join our Data Engineering team.The ideal ...Show moreLast updated: 7 days ago
  • Promoted
  • New!
Data Engineer

Data Engineer

GEMRAJ TECHNOLOGIES LIMITEDJodhpur, IN
We are currently seeking a Data Engineer to join our technology team.In this role, you will work on building data-driven products that sit atop cloud-based data infrastructure.The ideal candidate i...Show moreLast updated: less than 1 hour ago
  • Promoted
Data Engineer

Data Engineer

Randstad EnterpriseJodhpur, IN
Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show moreLast updated: 30+ days ago
  • Promoted
  • New!
Data / ML Engineer

Data / ML Engineer

LiloJodhpur, IN
Lilo is revolutionizing procurement for Commercial Real Estate (CRE) businesses by providing a single platform to automate and optimize procurement processes using AI. From hotels to gyms, schools, ...Show moreLast updated: 20 hours ago
  • Promoted
Senior Data Engineer

Senior Data Engineer

USEReadyajit, rajasthan, in
Job Title : Senior Databricks Engineer.As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakeho...Show moreLast updated: 18 days ago
  • Promoted
Data Engineer

Data Engineer

Everisejodhpur, India
Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 1 day ago