%20LIMITED){kind=logo}
Senior Data Engineer
KOGTA FINANCIAL (INDIA) LIMITEDharyana, haryana, in20 hours ago
Job descriptionDesign and maintain scalable, high-performance data warehouse solutions on AWS. Implement optimized data models and structures for AWS Redshift or equivalent environments. Leverage AWS services such as S3, Lambda, Redshift , EMR , Step Functions and others to build end-to-end data solutions. Stay updated with AWS advancements and recommend new tools or services to enhance data infrastructure. Develop and optimize complex SQL queries, stored procedures, and views for analytics and reporting. Troubleshoot and fine-tune SQL performance to ensure efficient data retrieval. Design, Develop and optimize ETL pipelines using Pyspark . Leverage optimization and data modelling capabilities to design data pipelines. Continuously monitor and enhance ETL and query performance. Identify and resolve processing bottlenecks across data pipelines and warehouse layers. Collaborate with cross-functional teams to integrate data from multiple systems. Partner with business stakeholders to understand and deliver on data requirements. Implement strong data security and governance measures. Ensure compliance with relevant industry standards and organizational policies. Maintain detailed documentation for ETL processes, data models, and configurations . Ensure proper handover and knowledge transfer within the team. Bachelor’s degree in Computer Science, Information Technology , or a related field. Experience with Spark Streaming will be an advantage. Proven experience as an ETL / Data Warehouse Developer with expertise in AWS and SQL. Strong proficiency in SQL , including complex queries and performance tuning. Hands on experience with developing and maintaining ETL pipeline using Pyspark . Excellent understanding of Spark architecture. Hands-on experience with AWS services such as S3, EMR, Redshift, Lambda, and Step Functions. Solid understanding of data modeling , data integration, and warehousing principles. Familiarity with data security, compliance, and governance best practices. Strong analytical, problem-solving, and communication skills. AWS Certification or equivalent credentials preferred.
Job Summary
Kogta Financial Ltd. is seeking an experienced and highly skilled ETL & Data Warehouse Developer with strong expertise in AWS data services . As a key member of our data engineering team, you will be responsible for designing, developing, and optimizing ETL pipelines and scalable data warehouse solutions on the AWS platform. The ideal candidate will have a solid background in data modeling, SQL performance tuning, and AWS-based data architectures .
Key Responsibilities
1. ETL Development
- Design, develop, and implement robust ETL processes using AWS EMR, AWS Data Pipeline, or custom scripts .
- Ensure efficient extraction, transformation, and loading of data from multiple sources into the data warehouse.
2. Data Warehousing
3. AWS Service Utilization
4. SQL Expertise
5. Pyspark Expertise
6. Performance Optimization
7. Data Integration & Collaboration
8. Security & Compliance
9. Documentation
Qualifications & Skills
Create a job alert for this search
Senior Data Engineer • haryana, haryana, in
Related jobs
![Senior Lead Engineer - Data [T500-20748]](https://cdn-logos.talent.com/v1/logo/image?feedcode=jobrapido-pms&company_name=REA%20Cyber%20City)
- Promoted
- New!
Data Engineer
KKRharyana, haryana, in KKR aims to generate attractive investment returns by following a patient and disciplined investment approach, employing world-class people, and supporting growth in its portfolio companies and com...Show moreLast updated: 12 hours ago
- Promoted
- New!
Data Engineer
EXLharyana, haryana, in We are looking for a Python & PySpark developer and data engineer who can design and build solutions for one of our Fortune 500 Client programs in the realm of Financial Master & Reference Data Man...Show moreLast updated: 20 hours ago
- Promoted
- New!
Lead GCP Data Engineer
Impetusharyana, haryana, in Lead Data Engineer – GCP (BigQuery • Composer • Python • PySpark).You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform.You will manage a team of ...Show moreLast updated: 20 hours ago
- Promoted
- New!
GCP + Bigdata Engineer
Tata Consultancy Servicesharyana, haryana, in TATA Consultancy Services is looking for Big Data Developer with Hands on experience with GCP.Required experience range : 6 to 8 years.
Job locations : Chennai, Gurgaon.Demonstrated leadership in desi...Show moreLast updated: 20 hours ago
- Promoted
- New!
Senior Lead Engineer - Data [T500-20748]
REA Cyber Cityharyana, haryana, in In 1995 in a garage in Melbourne, Australia, REA Group was born from a simple question : Can we change the way the world experiences property?” Could we? Yes.
Fast forward 30 years, REA Group is a ma...Show moreLast updated: 20 hours ago
- Promoted
- New!
Lead Data Engineer
MakeMyTripharyana, haryana, in At MakeMyTrip (MMT), technology is at the heart of everything we do.As a leading player in the travel industry, we leverage cutting-edge solutions like AI, machine learning, and cloud infrastructur...Show moreLast updated: 12 hours ago
- Promoted
- New!
Senior Data Engineer
ManpowerGroup Indiaharyana, haryana, in ADF, ETL and SSIS, Python and SQL including data warehousing concepts and data warehousing principles.Proficiency in ETL tools and SQL for data extraction, transformation, and loading.Experience pe...Show moreLast updated: 8 hours ago
- Promoted
- New!
Senior Data Engineer
Atomic Northharyana, haryana, in Azure Databricks, PySpark, Python, SQL, Azure Data Factory, Data Modelling, Data Migration, Data Warehousing.India (Remote / Hybrid options available).
Azure Data Factory, Azure Databricks, and Data...Show moreLast updated: 20 hours ago
- Promoted
- New!
Data Engineer
GMGharyana, haryana, in GMG is a global well-being company retailing, distributing and manufacturing a portfolio of leading international and home-grown brands across sport, food and health sectors.Its vision is to inspir...Show moreLast updated: 20 hours ago
- Promoted
- New!
Senior Data Engineer
GSPANN Technologies, Incharyana, haryana, in Headquartered in California, U.GSPANN provides consulting and IT services to global clients.We help clients transform how they deliver business value by helping them optimize their IT capabilities,...Show moreLast updated: 20 hours ago
- Promoted
- New!
Data Engineer
IGT Solutionsharyana, haryana, in We are seeking a highly skilled.Databricks, PySpark, ETL development, and SQL.The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines and analytics...Show moreLast updated: 20 hours ago
- Promoted
- New!
Senior Principal Data Engineer
MakeMyTripharyana, haryana, in Senior Principal Data Engineer.We are looking for experienced Data engineers with excellent problem-solving skills to develop machine-learning powered Data Products design to enhance customer exper...Show moreLast updated: 20 hours ago
- Promoted
- New!
Data Engineer
Movateharyana, haryana, in Develop data mapping specifications and transformation rules.Perform data cleansing, validation, and reconciliation activities.
Create and execute data conversion scripts and processes.Document data...Show moreLast updated: 20 hours ago
- Promoted
- New!
Senior Data Engineer
Pacific Data Integratorsharyana, haryana, in Shift time : Open to work in EST shift (5PM to 2AM IST).Lead the design, development, and implementation of complex data integration solutions using Informatica Intelligent Data Management Cloud (ID...Show moreLast updated: 4 hours ago
- Promoted
- New!
Senior Lead Engineer - Data [T500-20749]
REA Cyber Cityharyana, haryana, in In 1995 in a garage in Melbourne, Australia, REA Group was born from a simple question : "Can we change the way the world experiences property?” Could we? Yes.
Fast forward 30 years, REA Group is a m...Show moreLast updated: 8 hours ago
- Promoted
- New!
Data Engineer
Terra Technology Circle Consulting Private Limitedharyana, haryana, in We are seeking a highly skilled and motivated.In this role, you will design, build, and optimize scalable data pipelines and architectures to support analytics, machine learning, and business intel...Show moreLast updated: 20 hours ago
- Promoted
- New!
Data Engineer
NABharyana, haryana, in Proficient in executing ETL processes between data environments.Proficient at coding in SQL (additional knowledge in Python and R is highly regarded).
Proficient at creating analytics related docume...Show moreLast updated: 20 hours ago
- Promoted
- New!
Sr. Data Engineer II
Antal Internationalharyana, haryana, in Udaipur 3 months then Gurugram, India.You’ll lead the development of high-performance data pipelines, ensure data integrity, and guide the engineering team with best practices and cutting-edge tech...Show moreLast updated: 20 hours ago