No longer accepting applications

Senior Data Engineer

KOGTA FINANCIAL (INDIA) LIMITEDBikaner, IN

6 days ago

Job description

Job Summary

Kogta Financial Ltd. is seeking an experienced and highly skilled ETL & Data Warehouse Developer with strong expertise in AWS data services . As a key member of our data engineering team, you will be responsible for designing, developing, and optimizing ETL pipelines and scalable data warehouse solutions on the AWS platform. The ideal candidate will have a solid background in data modeling, SQL performance tuning, and AWS-based data architectures .

Key Responsibilities

1. ETL Development

Design, develop, and implement robust ETL processes using AWS EMR, AWS Data Pipeline, or custom scripts .
Ensure efficient extraction, transformation, and loading of data from multiple sources into the data warehouse.

2. Data Warehousing

Design and maintain scalable, high-performance data warehouse solutions on AWS.

Implement optimized data models and structures for AWS Redshift or equivalent environments.

3. AWS Service Utilization

Leverage AWS services such as S3, Lambda, Redshift , EMR , Step Functions and others to build end-to-end data solutions.

Stay updated with AWS advancements and recommend new tools or services to enhance data infrastructure.

4. SQL Expertise

Develop and optimize complex SQL queries, stored procedures, and views for analytics and reporting.

Troubleshoot and fine-tune SQL performance to ensure efficient data retrieval.

5. Pyspark Expertise

Design, Develop and optimize ETL pipelines using Pyspark .

Leverage optimization and data modelling capabilities to design data pipelines.

6. Performance Optimization

Continuously monitor and enhance ETL and query performance.

Identify and resolve processing bottlenecks across data pipelines and warehouse layers.

7. Data Integration & Collaboration

Collaborate with cross-functional teams to integrate data from multiple systems.

Partner with business stakeholders to understand and deliver on data requirements.

8. Security & Compliance

Implement strong data security and governance measures.

Ensure compliance with relevant industry standards and organizational policies.

9. Documentation

Maintain detailed documentation for ETL processes, data models, and configurations .

Ensure proper handover and knowledge transfer within the team.

Qualifications & Skills

Bachelor’s degree in Computer Science, Information Technology , or a related field.

Experience with Spark Streaming will be an advantage.

Proven experience as an ETL / Data Warehouse Developer with expertise in AWS and SQL.

Strong proficiency in SQL , including complex queries and performance tuning.

Hands on experience with developing and maintaining ETL pipeline using Pyspark .

Excellent understanding of Spark architecture.

Hands-on experience with AWS services such as S3, EMR, Redshift, Lambda, and Step Functions.

Solid understanding of data modeling , data integration, and warehousing principles.

Familiarity with data security, compliance, and governance best practices.

Strong analytical, problem-solving, and communication skills.

AWS Certification or equivalent credentials preferred.

Create a job alert for this search

Senior Data Engineer • Bikaner, IN

Related jobs

Promoted

Data Engineer

IntraEdgeBikaner, IN

We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

Intellify SolutionsBikaner, IN

Total years of experience : 10+ years.Required : Bachelor’s degree or relevant experience.Required : Prior experience as a software engineer or data engineer in a. Required : Cloud Data Warehouse experi...Show moreLast updated: 7 days ago

Promoted

Senior Data Engineer (Snowflake+ DBT)

Anblicksbikaner, rajasthan, in

Senior Data Engineer (Snowflake + dbt).Hyderabad / Ahmedabad (Hybrid).Great Place to Work® Certified | Snowflake Elite Partner. We are looking for a highly skilled.ELT pipelines and analytical data ...Show moreLast updated: 2 days ago

Promoted

Senior Data Engineer

IntelliasBikaner, IN

Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 16 days ago

Promoted

Senior Data Engineer - Data Acquisition

InfoBeansBikaner, IN

We are seeking a highly skilled.Senior Data Engineer – Data Acquisition (ODS).The ideal candidate will have extensive hands-on experience in building and optimizing data ingestion and transformatio...Show moreLast updated: 8 days ago

Promoted

(Senior) Azure Data Engineer - Full remote - contractor in USD

All European CareersBikaner, IN

Remote

For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show moreLast updated: 1 day ago

Promoted

Data Engineer

AceolutionBikaner, IN

Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

Mastekbikaner, India

We are looking for a Senior Data Engineer with good exposure to Cloud Services in AWS(IAM, RDS, Lambda, DMS) along with Snowflake / Postgresql, ETL and Streaming Services like Kafka.Show moreLast updated: 13 days ago

Promoted

Senior Data Engineer

SAIVA AIBikaner, IN

We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

RecroBikaner, IN

Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

HealthyMe AIBikaner, IN

We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 30+ days ago

Promoted

Senior Oracle Data Engineer

Strattek Consultingbikaner, India

This role centers on architecting robust data pipelines across on-prem and cloud Oracle ecosystems, automating ingestion from varied sources including APIs. Exposure to Oracle FDI (Fusion Data Intel...Show moreLast updated: 1 day ago

Promoted

Senior Data Engineer

AnblicksBīkaner, Republic Of India, IN

Promoted

Data Engineer

Insight GlobalBikaner, IN

GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago

Promoted

Senior AWS Data Engineer

CYAN360Bikaner, IN

Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Randstad EnterpriseBikaner, IN

Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

Donyatibikaner, rajasthan, in

We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show moreLast updated: 1 day ago

Promoted

Data Engineer

DigitalzoneBikaner, IN

As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 16 days ago