No longer accepting applications
%20LIMITED){kind=logo}
Senior Data Engineer
KOGTA FINANCIAL (INDIA) LIMITEDludhiana, punjab, in6 days ago
Job descriptionDesign and maintain scalable, high-performance data warehouse solutions on AWS. Implement optimized data models and structures for AWS Redshift or equivalent environments. Leverage AWS services such as S3, Lambda, Redshift , EMR , Step Functions and others to build end-to-end data solutions. Stay updated with AWS advancements and recommend new tools or services to enhance data infrastructure. Develop and optimize complex SQL queries, stored procedures, and views for analytics and reporting. Troubleshoot and fine-tune SQL performance to ensure efficient data retrieval. Design, Develop and optimize ETL pipelines using Pyspark . Leverage optimization and data modelling capabilities to design data pipelines. Continuously monitor and enhance ETL and query performance. Identify and resolve processing bottlenecks across data pipelines and warehouse layers. Collaborate with cross-functional teams to integrate data from multiple systems. Partner with business stakeholders to understand and deliver on data requirements. Implement strong data security and governance measures. Ensure compliance with relevant industry standards and organizational policies. Maintain detailed documentation for ETL processes, data models, and configurations . Ensure proper handover and knowledge transfer within the team. Bachelor’s degree in Computer Science, Information Technology , or a related field. Experience with Spark Streaming will be an advantage. Proven experience as an ETL / Data Warehouse Developer with expertise in AWS and SQL. Strong proficiency in SQL , including complex queries and performance tuning. Hands on experience with developing and maintaining ETL pipeline using Pyspark . Excellent understanding of Spark architecture. Hands-on experience with AWS services such as S3, EMR, Redshift, Lambda, and Step Functions. Solid understanding of data modeling , data integration, and warehousing principles. Familiarity with data security, compliance, and governance best practices. Strong analytical, problem-solving, and communication skills. AWS Certification or equivalent credentials preferred.
Job Summary
Kogta Financial Ltd. is seeking an experienced and highly skilled ETL & Data Warehouse Developer with strong expertise in AWS data services . As a key member of our data engineering team, you will be responsible for designing, developing, and optimizing ETL pipelines and scalable data warehouse solutions on the AWS platform. The ideal candidate will have a solid background in data modeling, SQL performance tuning, and AWS-based data architectures .
Key Responsibilities
1. ETL Development
- Design, develop, and implement robust ETL processes using AWS EMR, AWS Data Pipeline, or custom scripts .
- Ensure efficient extraction, transformation, and loading of data from multiple sources into the data warehouse.
2. Data Warehousing
3. AWS Service Utilization
4. SQL Expertise
5. Pyspark Expertise
6. Performance Optimization
7. Data Integration & Collaboration
8. Security & Compliance
9. Documentation
Qualifications & Skills
Create a job alert for this search
Senior Data Engineer • ludhiana, punjab, in
Related jobs
For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show moreLast updated: 1 day ago
- Promoted
Senior AWS Data Engineer_Exp : 5+ Years
Atyeti Includhiana, punjab, in Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.Python; strong SQL and clo...Show moreLast updated: 15 days ago
- Promoted
Senior Data Engineer
Intelliasludhiana, punjab, in Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines.
Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 15 days ago
- Promoted
Senior Oracle Data Engineer
Strattek Consultingludhiana, punjab, in This role centers on architecting robust data pipelines across on-prem and cloud Oracle ecosystems, automating ingestion from varied sources including APIs.
Exposure to Oracle FDI (Fusion Data Intel...Show moreLast updated: 1 day ago
- Promoted
Data Engineer
BayOne Solutionsludhiana, punjab, in We are seeking a highly experienced Data Engineer to join our MarTech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engine...Show moreLast updated: 1 day ago
- Promoted
- New!
Data Engineer
LanceSoft, Inc.ludhiana, punjab, in This team is looking to hire a motivated Sr.Data Engineer who will be working closely with team of highly motivated data engineers to build a state-of-the-art marketing data platform to solve vario...Show moreLast updated: 10 hours ago
- Promoted
GCP Data Engineer
Xsell Resourcesludhiana, punjab, in Seeking a GCP Certified Data Engineer to work remotely from India for our Fortune 5 healthcare client in the US.No notice periods more than 15 days.
GCP Google Cloud Professional Data Engineer Certi...Show moreLast updated: 14 days ago
- Promoted
AWS Data Engineer
Tata Consultancy Servicesludhiana, punjab, in Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show moreLast updated: 24 days ago
- Promoted
- New!
Palantir Data Engineer
SageBeans RPOludhiana, punjab, in Location : Remote work in India.Experience and skills required for the Palantir Forward Deployed Engineer, Palantir FDE.Python, SQL and optionally Java / Scala.
Code repositories, Pipeline Builder, Cod...Show moreLast updated: 10 hours ago
- Promoted
- New!
Data Engineer
WhiteLotus Talent Partnersludhiana, punjab, in Job Title- Azure Data Engineer Pyspark.Location- Whitefield / Domlur Embassy Park , Bangalore.Minimum 5 years of PySpark Development experience, especially in Spark SQL and Complex Transformations....Show moreLast updated: 10 hours ago
- Promoted
Senior Data Engineer (Snowflake+ DBT)
Anblicksludhiana, punjab, in Senior Data Engineer (Snowflake + dbt).Hyderabad / Ahmedabad (Hybrid).Great Place to Work® Certified | Snowflake Elite Partner.
We are looking for a highly skilled.ELT pipelines and analytical data ...Show moreLast updated: 2 days ago
- Promoted
Senior Data Engineer
Donyatiludhiana, punjab, in We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show moreLast updated: 1 day ago
- Promoted
Senior Python Data Engineer
iVoyantludhiana, punjab, in Join a dynamic engineering team working on a high-impact tax reporting platform for the 2025 fiscal season.The core goal is to modernize and significantly accelerate the generation of Excel-based r...Show moreLast updated: 2 days ago
- Promoted
(Senior) Azure Data Engineer - Full remote - contractor in USD
All European Careersludhiana, punjab, inRemote
- Promoted
Azure Data Engineer
Tata Consultancy Servicesludhiana, punjab, in Interview Date : Weekend Virtual Drive 15-Nov-25.Extensive coding experience (3+ years) including Python / Pyspark (1 years +).
Experience developing in Azure with key data technologies (e.ADLS, ADF, A...Show moreLast updated: 30+ days ago
- Promoted
Databricks Data Engineer Lead – Sustainability Project
Blue Cloud Softech Solutions Limitedludhiana, punjab, in BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level ...Show moreLast updated: 1 day ago
- Promoted
Senior AI Engineer
eTeamludhiana, punjab, in We’re building AI products that are transforming the.Our mission is to revolutionize how organizations discover, develop, and engage talent through intelligent, human-centered AI solutions.We combi...Show moreLast updated: 1 day ago
- Promoted
Azure Data Engineer
SystemBenderludhiana, punjab, in Responsible for designing and maintaining scalable data pipelines on Microsoft Fabric and Azure.Focus includes ingesting structured, semi-structured, and unstructured data, managing OneLake / Delta L...Show moreLast updated: 9 days ago
- Promoted
GCP Data Engineer
Adastraludhiana, punjab, in We are looking for a proactive and solution-oriented GCP Data Engineer to join our team.This role requires hands-on experience in Google Cloud Platform (GCP), especially with BigQuery and Airflow, ...Show moreLast updated: 2 days ago