%20LIMITED){kind=logo}
Senior Data EngineerKOGTA FINANCIAL (INDIA) LIMITED • Gurgaon, Gurgaon (district)
Senior Data Engineer
KOGTA FINANCIAL (INDIA) LIMITED • Gurgaon, Gurgaon (district)
5 days ago
Job descriptionDesign and maintain scalable, high-performance data warehouse solutions on AWS. Implement optimized data models and structures for AWS Redshift or equivalent environments. Leverage AWS services such as S3, Lambda, Redshift , EMR , Step Functions and others to build end-to-end data solutions. Stay updated with AWS advancements and recommend new tools or services to enhance data infrastructure. Develop and optimize complex SQL queries, stored procedures, and views for analytics and reporting. Troubleshoot and fine-tune SQL performance to ensure efficient data retrieval. Design, Develop and optimize ETL pipelines using Pyspark . Leverage optimization and data modelling capabilities to design data pipelines. Continuously monitor and enhance ETL and query performance. Identify and resolve processing bottlenecks across data pipelines and warehouse layers. Collaborate with cross-functional teams to integrate data from multiple systems. Partner with business stakeholders to understand and deliver on data requirements. Implement strong data security and governance measures. Ensure compliance with relevant industry standards and organizational policies. Maintain detailed documentation for ETL processes, data models, and configurations . Ensure proper handover and knowledge transfer within the team. Bachelor’s degree in Computer Science, Information Technology , or a related field. Experience with Spark Streaming will be an advantage. Proven experience as an ETL / Data Warehouse Developer with expertise in AWS and SQL. Strong proficiency in SQL , including complex queries and performance tuning. Hands on experience with developing and maintaining ETL pipeline using Pyspark . Excellent understanding of Spark architecture. Hands-on experience with AWS services such as S3, EMR, Redshift, Lambda, and Step Functions. Solid understanding of data modeling , data integration, and warehousing principles. Familiarity with data security, compliance, and governance best practices. Strong analytical, problem-solving, and communication skills. AWS Certification or equivalent credentials preferred.
Job Summary
Kogta Financial Ltd. is seeking an experienced and highly skilled ETL & Data Warehouse Developer with strong expertise in AWS data services . As a key member of our data engineering team, you will be responsible for designing, developing, and optimizing ETL pipelines and scalable data warehouse solutions on the AWS platform. The ideal candidate will have a solid background in data modeling, SQL performance tuning, and AWS-based data architectures .
Key Responsibilities
1. ETL Development
- Design, develop, and implement robust ETL processes using AWS EMR, AWS Data Pipeline, or custom scripts .
- Ensure efficient extraction, transformation, and loading of data from multiple sources into the data warehouse.
2. Data Warehousing
3. AWS Service Utilization
4. SQL Expertise
5. Pyspark Expertise
6. Performance Optimization
7. Data Integration & Collaboration
8. Security & Compliance
9. Documentation
Qualifications & Skills
Create a job alert for this search
Senior Data Engineer • Gurgaon, Gurgaon (district)
Related jobs
Executive Search firm, with more than 600+ consultants and 69 offices in 41 countries spanning Europe, the Americas, Asia Pacific, the Middle East and Africa.
Our clients range from the largest corp...Show more
Position : Senior Data Engineer / Data Engineer Desired Experience : 3-8 years Salary : Best-in-industry You will act as a key member of the Data consulting team, working directly with the partners an...Show more![Senior Lead Engineer - Data [T500-20749]](https://cdn-logos.talent.com/v1/logo/image?feedcode=jobtraffic-in&company_name=REA%20Cyber%20City)
%20LIMITED)
Senior Data Engineer
dunnhumby • Gurugram, Haryana, India
Retail Media is transforming how advertisers connect with consumers through personalized and targeted campaigns across retailers' digital and physical touchpoints.
Retail Media Measurement plays a p...Show more
Last updated: 2 days ago • Promoted
Senior data engineer
Dunnhumby • Gurgaon, Haryana, India
Retail Media is transforming how advertisers connect with consumers through personalized and targeted campaigns across retailers' digital and physical touchpoints.
Retail Media Measurement plays a p...Show more
Last updated: 5 hours ago • Promoted • New!
Senior Data Engineer
Egon Zehnder • Gurugram, HR, IN
Quick Apply
Last updated: 30+ days ago
Senior data engineer
Talentmatics • Gurgaon, Haryana, India
Looking for a Senior GCP Big Data Engineer with strong expertise in building scalable data pipelines, ETL workflows, and big data processing on Google Cloud.
This role includes technical leadership,...Show more
Last updated: 5 hours ago • Promoted • New!
Data Engineer
IGT Solutions • Gurgaon, India
Job Title : Senior Data Engineer.We are seeking a highly skilled Senior Data Engineer with hands-on experience in Databricks, PySpark, ETL development, and SQL.
The ideal candidate will be responsibl...Show more
Last updated: 4 days ago • Promoted
Data Engineer
GMG • Gurgaon, India
GMG is a global well-being company retailing, distributing and manufacturing a portfolio of leading international and home-grown brands across sport, food and health sectors.Its vision is to inspir...Show more
Last updated: 4 days ago • Promoted
Senior Data Engineer
automotiveMastermind • Gurgaon, Haryana, India
Grade Level (for internal use) : .Our proprietary software-as-a-service helps automotive dealerships and sales teams better understand and predict exactly which customers are ready to buy the reasons...Show more
Last updated: 1 day ago • Promoted
Senior Data Engineer
S&P Global • Gurgaon, Haryana, India
Grade Level (for internal use) : .Our proprietary software-as-a-service helps automotive dealerships and sales teams better understand and predict exactly which customers are ready to buy the reasons...Show more
Last updated: 1 day ago • Promoted
Senior Data Engineer - Databricks
Srijan Technologies • Gurugram, Haryana, India
Senior Data Engineer Databricks.Python who will be instrumental in building and optimising scalable data pipelines and solutions across the Azure ecosystem.
This role requires hands-on development ...Show more
Last updated: 19 days ago • Promoted
Senior Snowflake Data Engineer
Luxoft • gurgaon, haryana, in
We are seeking a highly skilled Snowflake Data Engineer with 7 years of IT experience to design, build, and optimize scalable data pipelines and cloud-based solutions across AWS, Azure, and GCP.The...Show more
Last updated: 2 days ago • Promoted
Senior Data Engineer
Pacific Data Integrators • Gurgaon, Republic Of India, IN
Shift time : Open to work in EST shift (5PM to 2AM IST).Lead the design, development, and implementation of complex data integration solutions using Informatica Intelligent Data Management Cloud (ID...Show more
Last updated: 8 days ago • Promoted
Senior Data Engineer
Talentmatics • Gurgaon, India
Looking for a Senior GCP Big Data Engineer with strong expertise in building scalable data pipelines, ETL workflows, and big data processing on Google Cloud.
This role includes technical leadership,...Show more
Last updated: 1 day ago • Promoted
Senior Data Engineer
Confidential • Gurgaon / Gurugram, Chennai
If you are an extraordinary developer and who loves to push the boundaries to solve.Data Engineer -Azure, you will work in the Technology team that helps deliver our Data.Engineering offerings at l...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
OSTTRA • Gurgaon, Haryana, India
Grade Level (for internal use) : .Our proprietary software-as-a-service helps automotive dealerships and sales teams better understand and predict exactly which customers are ready to buy the reasons...Show more
Last updated: 21 hours ago • Promoted • New!
Senior Data Engineer
Invokhr • Gurgaon, Haryana, India
Quick Apply
Last updated: 30+ days ago
Senior Lead Engineer - Data [T500-20749]
REA Cyber City • Gurugram, Haryana, India
In 1995 in a garage in Melbourne, Australia, REA Group was born from a simple question : "Can we change the way the world experiences property?” Could we? Yes.
Fast forward 30 years, REA Group is a m...Show more
Last updated: 4 days ago • Promoted
Senior Data Engineer
KOGTA FINANCIAL (INDIA) LIMITED • Gurugram, Haryana, India
ETL & Data Warehouse Developer.As a key member of our data engineering team, you will be responsible for designing, developing, and optimizing ETL pipelines and scalable data warehouse solutions on...Show more
Last updated: 5 days ago • Promoted
Senior data engineer
KOGTA FINANCIAL • Gurgaon, Haryana, India
ETL & Data Warehouse Developer with strong expertise in AWS data services.As a key member of our data engineering team, you will be responsible for designing, developing, and optimizing ETL pipelin...Show more
Last updated: 5 hours ago • Promoted • New!