Senior Data EngineerKOGTA FINANCIAL (INDIA) LIMITED • indore, madhya pradesh, in

No longer accepting applications

Senior Data Engineer

KOGTA FINANCIAL (INDIA) LIMITED • indore, madhya pradesh, in

4 days ago

Job description

Job Summary

Kogta Financial Ltd. is seeking an experienced and highly skilled ETL & Data Warehouse Developer with strong expertise in AWS data services . As a key member of our data engineering team, you will be responsible for designing, developing, and optimizing ETL pipelines and scalable data warehouse solutions on the AWS platform. The ideal candidate will have a solid background in data modeling, SQL performance tuning, and AWS-based data architectures .

Key Responsibilities

1. ETL Development

Design, develop, and implement robust ETL processes using AWS EMR, AWS Data Pipeline, or custom scripts .
Ensure efficient extraction, transformation, and loading of data from multiple sources into the data warehouse.

2. Data Warehousing

Design and maintain scalable, high-performance data warehouse solutions on AWS.

Implement optimized data models and structures for AWS Redshift or equivalent environments.

3. AWS Service Utilization

Leverage AWS services such as S3, Lambda, Redshift , EMR , Step Functions and others to build end-to-end data solutions.

Stay updated with AWS advancements and recommend new tools or services to enhance data infrastructure.

4. SQL Expertise

Develop and optimize complex SQL queries, stored procedures, and views for analytics and reporting.

Troubleshoot and fine-tune SQL performance to ensure efficient data retrieval.

5. Pyspark Expertise

Design, Develop and optimize ETL pipelines using Pyspark .

Leverage optimization and data modelling capabilities to design data pipelines.

6. Performance Optimization

Continuously monitor and enhance ETL and query performance.

Identify and resolve processing bottlenecks across data pipelines and warehouse layers.

7. Data Integration & Collaboration

Collaborate with cross-functional teams to integrate data from multiple systems.

Partner with business stakeholders to understand and deliver on data requirements.

8. Security & Compliance

Implement strong data security and governance measures.

Ensure compliance with relevant industry standards and organizational policies.

9. Documentation

Maintain detailed documentation for ETL processes, data models, and configurations .

Ensure proper handover and knowledge transfer within the team.

Qualifications & Skills

Bachelor’s degree in Computer Science, Information Technology , or a related field.

Experience with Spark Streaming will be an advantage.

Proven experience as an ETL / Data Warehouse Developer with expertise in AWS and SQL.

Strong proficiency in SQL , including complex queries and performance tuning.

Hands on experience with developing and maintaining ETL pipeline using Pyspark .

Excellent understanding of Spark architecture.

Hands-on experience with AWS services such as S3, EMR, Redshift, Lambda, and Step Functions.

Solid understanding of data modeling , data integration, and warehousing principles.

Familiarity with data security, compliance, and governance best practices.

Strong analytical, problem-solving, and communication skills.

AWS Certification or equivalent credentials preferred.

Create a job alert for this search

Senior Data Engineer • indore, madhya pradesh, in

Related jobs

Senior Data Engineer - AWS Glue - Full Remote - Contractor in USD

All European Careers • indore, madhya pradesh, in

Remote

For an international organization in Geneva, Switzerland, we are urgently looking for a Full Remote Senior Data Engineer. The Senior Data Engineer is responsible for the implementation of the set of...Show more

Last updated: 13 days ago • Promoted

Senior Python Data Engineer

iVoyant • indore, madhya pradesh, in

Join a dynamic engineering team working on a high-impact tax reporting platform for the 2025 fiscal season.The core goal is to modernize and significantly accelerate the generation of Excel-based r...Show more

Last updated: 14 hours ago • Promoted • New!

Senior AWS Data Engineer

CYAN360 • indore, madhya pradesh, in

Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show more

Last updated: 30+ days ago • Promoted

Senior AWS Data Engineer_Exp : 5+ Years

Atyeti Inc • indore, madhya pradesh, in

Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.Python; strong SQL and clo...Show more

Last updated: 13 days ago • Promoted

Data Engineer

Digitalzone • indore, madhya pradesh, in

As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show more

Last updated: 13 days ago • Promoted

Senior Data Engineer (Snowflake+ DBT)

Anblicks • indore, madhya pradesh, in

Senior Data Engineer (Snowflake + dbt).Hyderabad / Ahmedabad (Hybrid).Great Place to Work® Certified | Snowflake Elite Partner. We are looking for a highly skilled.ELT pipelines and analytical data ...Show more

Last updated: 14 hours ago • Promoted • New!

GCP Data Engineer

Xsell Resources • indore, madhya pradesh, in

Seeking a GCP Certified Data Engineer to work remotely from India for our Fortune 5 healthcare client in the US.No notice periods more than 15 days. GCP Google Cloud Professional Data Engineer Certi...Show more

Last updated: 12 days ago • Promoted

Azure Data Engineer

Tata Consultancy Services • indore, madhya pradesh, in

TCS is Hiring for Azure Data Engineer.Primary : Azure Data Factory (ADF), Azure Databricks (ADB).Secondary : SSIS (SQL Server Integration Services). Strong expertise in Azure Data Engineering & ETL Co...Show more

Last updated: 30+ days ago • Promoted

GCP Data Engineer

Adastra • indore, madhya pradesh, in

We are looking for a proactive and solution-oriented GCP Data Engineer to join our team.This role requires hands-on experience in Google Cloud Platform (GCP), especially with BigQuery and Airflow, ...Show more

Last updated: 14 hours ago • Promoted • New!

AI Data Engineer

Peak Trust Global Real Estate • indore, madhya pradesh, in

This role requires strong technical skills across Python, automation, ML tooling, and analytical reporting.Key Responsibilities (Technical). Build automated data collection workflows using tools suc...Show more

Last updated: 14 hours ago • Promoted • New!

AI Engineer (Data Pipelines & RAG)

BeGig • indore, madhya pradesh, in

Job Role- AI Engineer (Data Pipelines & RAG).Work Mode- Remote(6 days working).We are looking for a hands-on AI / Data Engineer (4–7 years) to build and scale data pipelines powering GenAI and agenti...Show more

Last updated: 14 hours ago • Promoted • New!

Sr Data Engineer - DBT Tech Lead

Ascendion • indore, madhya pradesh, in

We are seeking an experienced Senior DBT Technical lead to be part of our upcoming data 2025-2026 data initiatives.This role requires deep expertise in dbt, cloud data platforms, and complex ETL / EL...Show more

Last updated: 11 days ago • Promoted

Azure Data Engineer

SystemBender • indore, madhya pradesh, in

Responsible for designing and maintaining scalable data pipelines on Microsoft Fabric and Azure.Focus includes ingesting structured, semi-structured, and unstructured data, managing OneLake / Delta L...Show more

Last updated: 7 days ago • Promoted

Lead Data Engineer

NexGen Tech Solutions • indore, madhya pradesh, in

Lead Data Engineer– Wealth Management.Must Have : Wealth Management Domain.We are seeking a highly skilled.Experience in building end-to-end Data Lake and Modern Data Platform programs covering the ...Show more

Last updated: 14 hours ago • Promoted • New!

Data Engineer

Tata Consultancy Services • indore, madhya pradesh, in

TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

NeerInfo Solutions • Indore, Madhya Pradesh, India

Professional & Technical Skills : .Must To Have Skills : Proficiency in Databricks Unified Data Analytics Platform.Good To Have Skills : Experience with Apache Spark and data warehousing solutions.Stro...Show more

Last updated: 15 hours ago • Promoted • New!

Senior Data Engineer (Microsoft Fabric)

Delphi Consulting Middle East • indore, madhya pradesh, in

Ready to embark on a journey where your growth is intertwined with our commitment to making a positive impact? Join the Delphi family - where Growth Meets Values. Interviews and onboarding are condu...Show more

Last updated: 14 hours ago • Promoted • New!

Azure data engineer

Stratus • indore, madhya pradesh, in

Lead a team of data engineers to develop data analytic solutions such as data warehouse and data marts on Azure Databricks. Experience with Agile development methodologies and tools, such as Jira, t...Show more

Last updated: 7 days ago • Promoted