No longer accepting applications

Senior Data Engineer

KOGTA FINANCIAL (INDIA) LIMITEDDindigul, IN

7 days ago

Job description

Job Summary

Kogta Financial Ltd. is seeking an experienced and highly skilled ETL & Data Warehouse Developer with strong expertise in AWS data services . As a key member of our data engineering team, you will be responsible for designing, developing, and optimizing ETL pipelines and scalable data warehouse solutions on the AWS platform. The ideal candidate will have a solid background in data modeling, SQL performance tuning, and AWS-based data architectures .

Key Responsibilities

1. ETL Development

Design, develop, and implement robust ETL processes using AWS EMR, AWS Data Pipeline, or custom scripts .
Ensure efficient extraction, transformation, and loading of data from multiple sources into the data warehouse.

2. Data Warehousing

Design and maintain scalable, high-performance data warehouse solutions on AWS.

Implement optimized data models and structures for AWS Redshift or equivalent environments.

3. AWS Service Utilization

Leverage AWS services such as S3, Lambda, Redshift , EMR , Step Functions and others to build end-to-end data solutions.

Stay updated with AWS advancements and recommend new tools or services to enhance data infrastructure.

4. SQL Expertise

Develop and optimize complex SQL queries, stored procedures, and views for analytics and reporting.

Troubleshoot and fine-tune SQL performance to ensure efficient data retrieval.

5. Pyspark Expertise

Design, Develop and optimize ETL pipelines using Pyspark .

Leverage optimization and data modelling capabilities to design data pipelines.

6. Performance Optimization

Continuously monitor and enhance ETL and query performance.

Identify and resolve processing bottlenecks across data pipelines and warehouse layers.

7. Data Integration & Collaboration

Collaborate with cross-functional teams to integrate data from multiple systems.

Partner with business stakeholders to understand and deliver on data requirements.

8. Security & Compliance

Implement strong data security and governance measures.

Ensure compliance with relevant industry standards and organizational policies.

9. Documentation

Maintain detailed documentation for ETL processes, data models, and configurations .

Ensure proper handover and knowledge transfer within the team.

Qualifications & Skills

Bachelor’s degree in Computer Science, Information Technology , or a related field.

Experience with Spark Streaming will be an advantage.

Proven experience as an ETL / Data Warehouse Developer with expertise in AWS and SQL.

Strong proficiency in SQL , including complex queries and performance tuning.

Hands on experience with developing and maintaining ETL pipeline using Pyspark .

Excellent understanding of Spark architecture.

Hands-on experience with AWS services such as S3, EMR, Redshift, Lambda, and Step Functions.

Solid understanding of data modeling , data integration, and warehousing principles.

Familiarity with data security, compliance, and governance best practices.

Strong analytical, problem-solving, and communication skills.

AWS Certification or equivalent credentials preferred.

Create a job alert for this search

Senior Data Engineer • Dindigul, IN

Related jobs

Promoted
New!

Senior Data Engineer

TEKsystems Global Services in IndiaDindigul, IN

Develop and manage data pipelines using ADF and Azure data bricks.Expert knowledge in data warehousing, data modeling and ETL. Good to have datastage exposure.Expertise in on-prem to azure cloud mig...Show moreLast updated: 15 hours ago

Promoted

Senior AWS Data Engineer

CYAN360Dindigul, IN

Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Insight GlobalMadurai, IN

GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

American InferenceMadurai, IN

Please apply directly through for this position.We kindly request that candidates refrain from contacting company officials via email or messages regarding this role. We are an AI and Data Consulti...Show moreLast updated: 14 days ago

Promoted
New!

Senior Data Engineer

FornaxMadurai, IN

If solving business challenges drives you.Fornax is a team of cross-functional individuals who solve critial business challenges using core concept of analytics, critical thinking.We are seeking a ...Show moreLast updated: 14 hours ago

Promoted
New!

Senior Data Engineer / Architect - Snowflake

Aezion, IncDindigul, IN

We are seeking a highly skilled Snowflake Data Engineer with expertise in DBT, Airbyte, and Airflow, combined with strong experience in Kimball dimensional modeling. The ideal candidate will design ...Show moreLast updated: 15 hours ago

Promoted

Senior Data Engineer

SGS & Comadurai, tamil nadu, in

Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in. The ideal candidate will play a ke...Show moreLast updated: 16 days ago

Promoted
New!

Senior DataOps Engineer (AWS)

MSBC GroupDindigul, IN

Join us as a Senior DataOps Engineer (AWS)—Drive High-Performance Data Systems for Financial Services.Lead the E-Comms data pipeline within Compass’s Application Simplification workstream : design, ...Show moreLast updated: 16 hours ago

Promoted
New!

Data Engineer

MyData Insights Pvt LtdMadurai, IN

The ideal candidate has a strong background in building scalable data solutions on.CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices.Design, bu...Show moreLast updated: 15 hours ago

Promoted

(Senior) Azure Data Engineer - Full remote - contractor in USD

All European CareersMadurai, IN

Remote

For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show moreLast updated: 2 days ago

Promoted

Senior Data Engineer

DonyatiDindigul, IN

We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show moreLast updated: 2 days ago

Promoted

Senior Data Engineer - Data Acquisition

InfoBeansMadurai, IN

We are seeking a highly skilled.Senior Data Engineer – Data Acquisition (ODS).The ideal candidate will have extensive hands-on experience in building and optimizing data ingestion and transformatio...Show moreLast updated: 9 days ago

Promoted
New!

Azure Data Engineer

Capgemini InventMadurai, IN

At Capgemini Invent, we believe difference drives change.As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to...Show moreLast updated: 15 hours ago

Promoted
New!

Sr Data Engineer

Futran SolutionsMadurai, IN

Job Title : Senior Data Engineer / Data Engineer Lead.We are seeking a highly skilled and experienced Senior Data Engineer with a strong background in Microsoft Azure data platforms.The ideal candida...Show moreLast updated: 15 hours ago

Promoted
New!

Senior Data Engineer

MindlanceDindigul, IN

We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show moreLast updated: 15 hours ago

Promoted

Data Engineer

DigitalzoneMadurai, IN

As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 16 days ago

Promoted
New!

Senior Data Engineer

Adaptive Technology InsightsDindigul, IN

We are looking for an experienced.You will be responsible for designing, building, and optimizing data pipelines and architecture to support analytics, reporting, and data-driven decision-making ac...Show moreLast updated: 15 hours ago

Promoted

Senior Data Engineer

IntelliasDindigul, IN

Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 16 days ago