%20LIMITED){kind=logo}
Principal Data EngineerKOGTA FINANCIAL (INDIA) LIMITED • Haryāna, Republic Of India, IN
Principal Data Engineer
KOGTA FINANCIAL (INDIA) LIMITED • Haryāna, Republic Of India, IN
1 day ago
Job descriptionDesign and maintain scalable, high-performance data warehouse solutions on AWS. Implement optimized data models and structures for AWS Redshift or equivalent environments. Leverage AWS services such as S3, Lambda, Redshift , EMR , Step Functions and others to build end-to-end data solutions. Stay updated with AWS advancements and recommend new tools or services to enhance data infrastructure. Develop and optimize complex SQL queries, stored procedures, and views for analytics and reporting. Troubleshoot and fine-tune SQL performance to ensure efficient data retrieval. Design, Develop and optimize ETL pipelines using Pyspark . Leverage optimization and data modelling capabilities to design data pipelines. Continuously monitor and enhance ETL and query performance. Identify and resolve processing bottlenecks across data pipelines and warehouse layers. Collaborate with cross-functional teams to integrate data from multiple systems. Partner with business stakeholders to understand and deliver on data requirements. Implement strong data security and governance measures. Ensure compliance with relevant industry standards and organizational policies. Maintain detailed documentation for ETL processes, data models, and configurations . Ensure proper handover and knowledge transfer within the team. Bachelor’s degree in Computer Science, Information Technology , or a related field. Experience with Spark Streaming will be an advantage. Proven experience as an ETL / Data Warehouse Developer with expertise in AWS and SQL. Strong proficiency in SQL , including complex queries and performance tuning. Hands on experience with developing and maintaining ETL pipeline using Pyspark . Excellent understanding of Spark architecture. Hands-on experience with AWS services such as S3, EMR, Redshift, Lambda, and Step Functions. Solid understanding of data modeling , data integration, and warehousing principles. Familiarity with data security, compliance, and governance best practices. Strong analytical, problem-solving, and communication skills. AWS Certification or equivalent credentials preferred.
Job Summary
Kogta Financial Ltd. is seeking an experienced and highly skilled ETL & Data Warehouse Developer with strong expertise in AWS data services . As a key member of our data engineering team, you will be responsible for designing, developing, and optimizing ETL pipelines and scalable data warehouse solutions on the AWS platform. The ideal candidate will have a solid background in data modeling, SQL performance tuning, and AWS-based data architectures .
Key Responsibilities
1. ETL Development
- Design, develop, and implement robust ETL processes using AWS EMR, AWS Data Pipeline, or custom scripts .
- Ensure efficient extraction, transformation, and loading of data from multiple sources into the data warehouse.
2. Data Warehousing
3. AWS Service Utilization
4. SQL Expertise
5. Pyspark Expertise
6. Performance Optimization
7. Data Integration & Collaboration
8. Security & Compliance
9. Documentation
Qualifications & Skills
Create a job alert for this search
Principal Data Engineer • Haryāna, Republic Of India, IN
Related jobs
Data Engineer
KKR • haryana, haryana, in
KKR aims to generate attractive investment returns by following a patient and disciplined investment approach, employing world-class people, and supporting growth in its portfolio companies and com...Show more
Last updated: 1 day ago • Promoted
Principal Gen AI Engineer
Alkami Technology • haryana, haryana, in
We're looking for a highly skilled and experienced.Principal GenAI / AI Engineer and Architect.The ideal candidate has over a decade of hands-on experience in the AI / GenAI space, with a strong focus ...Show more
Last updated: 1 day ago • Promoted
Lead GCP Data Engineer
Impetus • haryana, haryana, in
Lead Data Engineer – GCP (BigQuery • Composer • Python • PySpark).You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform.You will manage a team of ...Show more
Last updated: 1 day ago • Promoted
Data Engineer
EXL • haryana, haryana, in
We are looking for a Python & PySpark developer and data engineer who can design and build solutions for one of our Fortune 500 Client programs in the realm of Financial Master & Reference Data Man...Show more
Last updated: 1 day ago • Promoted
Data Engineer
Azilen Technologies • haryana, haryana, in
Manage and create design schema, SQL query tuning, and code review.Min 4+ years of professional experience in the field of data engineering with knowledge of the data platform and DWH development.D...Show more
Last updated: 1 day ago • Promoted
GCP Data Engineer
Impetus • haryana, haryana, in
Design, build, and maintain large-scale data pipelines on BigQuery and other Google Cloud Platform (GCP) services.Use Python and PySpark / Spark to transform, clean, aggregate and prepare data for an...Show more
Last updated: 1 day ago • Promoted
Lead Data Engineer
MakeMyTrip • haryana, haryana, in
At MakeMyTrip (MMT), technology is at the heart of everything we do.As a leading player in the travel industry, we leverage cutting-edge solutions like AI, machine learning, and cloud infrastructur...Show more
Last updated: 1 day ago • Promoted
Data Engineer
GMG • haryana, haryana, in
GMG is a global well-being company retailing, distributing and manufacturing a portfolio of leading international and home-grown brands across sport, food and health sectors.Its vision is to inspir...Show more
Last updated: 1 day ago • Promoted
Senior Principal Data Engineer
MakeMyTrip • haryana, haryana, in
Senior Principal Data Engineer.We are looking for experienced Data engineers with excellent problem-solving skills to develop machine-learning powered Data Products design to enhance customer exper...Show more
Last updated: 1 day ago • Promoted
Data Engineer
IGT Solutions • haryana, haryana, in
We are seeking a highly skilled.Databricks, PySpark, ETL development, and SQL.The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines and analytics...Show more
Last updated: 1 day ago • Promoted
Principal Data Engineer
ManpowerGroup India • Haryāna, Republic Of India, IN
ADF, ETL and SSIS, Python and SQL including data warehousing concepts and data warehousing principles.Proficiency in ETL tools and SQL for data extraction, transformation, and loading.Experience pe...Show more
Last updated: 1 day ago • Promoted
Senior Data Engineer
GSPANN Technologies, Inc • haryana, haryana, in
Headquartered in California, U.GSPANN provides consulting and IT services to global clients.We help clients transform how they deliver business value by helping them optimize their IT capabilities,...Show more
Last updated: 1 day ago • Promoted
Data Engineer
Movate • haryana, haryana, in
Develop data mapping specifications and transformation rules.Perform data cleansing, validation, and reconciliation activities.
Create and execute data conversion scripts and processes.Document data...Show more
Last updated: 1 day ago • Promoted
Data Engineer
Terra Technology Circle Consulting Private Limited • haryana, haryana, in
We are seeking a highly skilled and motivated.In this role, you will design, build, and optimize scalable data pipelines and architectures to support analytics, machine learning, and business intel...Show more
Last updated: 1 day ago • Promoted
Senior Data Engineer
Pacific Data Integrators • haryana, haryana, in
Shift time : Open to work in EST shift (5PM to 2AM IST).Lead the design, development, and implementation of complex data integration solutions using Informatica Intelligent Data Management Cloud (ID...Show more
Last updated: 19 hours ago • Promoted • New!
Data Engineer
NAB • haryana, haryana, in
Proficient in executing ETL processes between data environments.Proficient at coding in SQL (additional knowledge in Python and R is highly regarded).
Proficient at creating analytics related docume...Show more
Last updated: 1 day ago • Promoted
Principal Data Engineer
GSPANN Technologies, Inc • Haryāna, Republic Of India, IN
Headquartered in California, U.GSPANN provides consulting and IT services to global clients.We help clients transform how they deliver business value by helping them optimize their IT capabilities,...Show more
Last updated: 1 day ago • Promoted
Principal Data Engineer
MakeMyTrip • haryana, haryana, in
We are looking for experienced Data engineers with excellent problem-solving skills to develop machine-learning powered Data Products design to enhance customer experiences.Nurtured from the seed o...Show more
Last updated: 1 day ago • Promoted