Senior Data EngineerKOGTA FINANCIAL (INDIA) LIMITED • Pune, IN

No longer accepting applications

Senior Data Engineer

KOGTA FINANCIAL (INDIA) LIMITED • Pune, IN

1 day ago

Job description

Job Summary

Kogta Financial Ltd. is seeking an experienced and highly skilled ETL & Data Warehouse Developer with strong expertise in AWS data services . As a key member of our data engineering team, you will be responsible for designing, developing, and optimizing ETL pipelines and scalable data warehouse solutions on the AWS platform. The ideal candidate will have a solid background in data modeling, SQL performance tuning, and AWS-based data architectures .

Key Responsibilities

1. ETL Development

Design, develop, and implement robust ETL processes using AWS EMR, AWS Data Pipeline, or custom scripts .
Ensure efficient extraction, transformation, and loading of data from multiple sources into the data warehouse.

2. Data Warehousing

Design and maintain scalable, high-performance data warehouse solutions on AWS.

Implement optimized data models and structures for AWS Redshift or equivalent environments.

3. AWS Service Utilization

Leverage AWS services such as S3, Lambda, Redshift , EMR , Step Functions and others to build end-to-end data solutions.

Stay updated with AWS advancements and recommend new tools or services to enhance data infrastructure.

4. SQL Expertise

Develop and optimize complex SQL queries, stored procedures, and views for analytics and reporting.

Troubleshoot and fine-tune SQL performance to ensure efficient data retrieval.

5. Pyspark Expertise

Design, Develop and optimize ETL pipelines using Pyspark .

Leverage optimization and data modelling capabilities to design data pipelines.

6. Performance Optimization

Continuously monitor and enhance ETL and query performance.

Identify and resolve processing bottlenecks across data pipelines and warehouse layers.

7. Data Integration & Collaboration

Collaborate with cross-functional teams to integrate data from multiple systems.

Partner with business stakeholders to understand and deliver on data requirements.

8. Security & Compliance

Implement strong data security and governance measures.

Ensure compliance with relevant industry standards and organizational policies.

9. Documentation

Maintain detailed documentation for ETL processes, data models, and configurations .

Ensure proper handover and knowledge transfer within the team.

Qualifications & Skills

Bachelor’s degree in Computer Science, Information Technology , or a related field.

Experience with Spark Streaming will be an advantage.

Proven experience as an ETL / Data Warehouse Developer with expertise in AWS and SQL.

Strong proficiency in SQL , including complex queries and performance tuning.

Hands on experience with developing and maintaining ETL pipeline using Pyspark .

Excellent understanding of Spark architecture.

Hands-on experience with AWS services such as S3, EMR, Redshift, Lambda, and Step Functions.

Solid understanding of data modeling , data integration, and warehousing principles.

Familiarity with data security, compliance, and governance best practices.

Strong analytical, problem-solving, and communication skills.

AWS Certification or equivalent credentials preferred.

Create a job alert for this search

Senior Data Engineer • Pune, IN

Related jobs

Senior Data Engineer

RapidBrains • Pune, IN

Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer with deep expertise in Azure Data Engineering to design, build, and optimize large-scale data pipelines.The ideal candidate...Show more

Last updated: 1 day ago • Promoted

Senior Data Engineer

Futran Solutions • Pune, Maharashtra, India

We are seeking a highly skilled and experienced Senior Data Engineer with a strong background in Microsoft Azure data platforms. The ideal candidate will have a proven track record of designing, imp...Show more

Last updated: 30+ days ago • Promoted

Senior Data Engineer

Insight Global • pune, maharashtra, in

The Senior Data Engineer is responsible for building and optimizing ETL / ELT pipelines that process terabytes of data daily across 186 data assets, implementing BigQuery datasets with enterprise-sca...Show more

Last updated: 2 days ago • Promoted

Senior Data Engineer

Dexian India • Pune, IN

Minimum 8+ years of hands-on experience designing, building, deploying, testing, maintaining, monitoring, and owning scalable, resilient, and distributed data pipelines. High proficiency in Python, ...Show more

Last updated: 2 days ago • Promoted

Senior Data Engineer

Mastek • pune, maharashtra, in

We are looking for a Senior Data Engineer with good exposure to Cloud Services in AWS(IAM, RDS, Lambda, DMS) along with Snowflake / Postgresql, ETL and Streaming Services like Kafka.Show more

Last updated: 30+ days ago • Promoted

Senior Data Engineer

Persistent Systems • Pune, Maharashtra, India

A highly skilled Data Engineering professional with 6 to 8 years of experience in designing, developing, and maintaining robust data solutions. Proven ability to work across the full software develo...Show more

Last updated: 30+ days ago • Promoted

Senior Data Engineer

Innova Solutions • pune, maharashtra, in

We're Hiring : Lead Data Consultant / Senior Data Engineer.Industry : Financial Services & Insurance (FSI).Are you passionate about building scalable, cloud-native data platforms? Join our team to le...Show more

Last updated: 10 days ago • Promoted

Senior Data Engineer

TekIT Software Solutions Pvt. Ltd. (India & USA) • Pune, Maharashtra, India

The ideal candidate will have expertise in.Design, develop, and maintain scalable.Collaborate with data analysts, data scientists, and business stakeholders to deliver high-quality datasets and ins...Show more

Last updated: 1 day ago • Promoted

Senior Data Engineer

Saras Analytics • pune, maharashtra, in

We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value. Our suite of work spans extraction, transformatio...Show more

Last updated: 30+ days ago • Promoted

Senior Data Engineer

SGS & Co • pune, maharashtra, in

Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in. The ideal candidate will play a ke...Show more

Last updated: 10 days ago • Promoted

Senior Data Engineer

SAIVA AI • Pune, IN

We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more

Last updated: 30+ days ago • Promoted

Senior Data Engineer ( Palantir)

Lear Corporation • Pune, Maharashtra, India

Lear, a global automotive technology leader in Seating and E-Systems, is Making every drive better by delivering intelligent in-vehicle experiences for customers around the world.With over 100 year...Show more

Last updated: 7 days ago • Promoted

Senior Data Engineer

EXL • Pune, Maharashtra, India

We are seeking a Senior Data Engineer to build and optimize data systems that power batch processing, real-time streaming, pipeline orchestration, data lake management, and data cataloging.You will...Show more

Last updated: 10 days ago • Promoted

Senior Data Engineer- AWS

InfoCepts • Pune, Maharashtra, India

Key Result Areas and Activities : .Study existing technology landscape and understand current data integration frameworks and do impact assessment for the requirements. Should be able to design comple...Show more

Last updated: 30+ days ago • Promoted

Senior Data Engineer

eClerx • Pune, Maharashtra, India

We are looking for an experienced Senior Data Engineer of hands-on experience in designing, building, and managing complex data architectures and BI solutions. The ideal candidate will have deep exp...Show more

Last updated: 1 day ago • Promoted

Senior Data Engineer

Straive • pune, maharashtra, in

The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show more

Last updated: 30+ days ago • Promoted

Senior Data Engineer

HealthyMe AI • Pune, IN

We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show more

Last updated: 30+ days ago • Promoted

Senior Data Engineer

Coditas • Pune, Maharashtra, India

Understand Business requirements and implement scalable solutions.Translate complex technical and functional requirements into detailed designs. Develop a highly scalable, reliable, and high-perform...Show more

Last updated: 30+ days ago • Promoted