No longer accepting applications
%20LIMITED){kind=logo}
Senior Data Engineer
KOGTA FINANCIAL (INDIA) LIMITEDAgra, IN6 days ago
Job descriptionDesign and maintain scalable, high-performance data warehouse solutions on AWS. Implement optimized data models and structures for AWS Redshift or equivalent environments. Leverage AWS services such as S3, Lambda, Redshift , EMR , Step Functions and others to build end-to-end data solutions. Stay updated with AWS advancements and recommend new tools or services to enhance data infrastructure. Develop and optimize complex SQL queries, stored procedures, and views for analytics and reporting. Troubleshoot and fine-tune SQL performance to ensure efficient data retrieval. Design, Develop and optimize ETL pipelines using Pyspark . Leverage optimization and data modelling capabilities to design data pipelines. Continuously monitor and enhance ETL and query performance. Identify and resolve processing bottlenecks across data pipelines and warehouse layers. Collaborate with cross-functional teams to integrate data from multiple systems. Partner with business stakeholders to understand and deliver on data requirements. Implement strong data security and governance measures. Ensure compliance with relevant industry standards and organizational policies. Maintain detailed documentation for ETL processes, data models, and configurations . Ensure proper handover and knowledge transfer within the team. Bachelor’s degree in Computer Science, Information Technology , or a related field. Experience with Spark Streaming will be an advantage. Proven experience as an ETL / Data Warehouse Developer with expertise in AWS and SQL. Strong proficiency in SQL , including complex queries and performance tuning. Hands on experience with developing and maintaining ETL pipeline using Pyspark . Excellent understanding of Spark architecture. Hands-on experience with AWS services such as S3, EMR, Redshift, Lambda, and Step Functions. Solid understanding of data modeling , data integration, and warehousing principles. Familiarity with data security, compliance, and governance best practices. Strong analytical, problem-solving, and communication skills. AWS Certification or equivalent credentials preferred.
Job Summary
Kogta Financial Ltd. is seeking an experienced and highly skilled ETL & Data Warehouse Developer with strong expertise in AWS data services . As a key member of our data engineering team, you will be responsible for designing, developing, and optimizing ETL pipelines and scalable data warehouse solutions on the AWS platform. The ideal candidate will have a solid background in data modeling, SQL performance tuning, and AWS-based data architectures .
Key Responsibilities
1. ETL Development
- Design, develop, and implement robust ETL processes using AWS EMR, AWS Data Pipeline, or custom scripts .
- Ensure efficient extraction, transformation, and loading of data from multiple sources into the data warehouse.
2. Data Warehousing
3. AWS Service Utilization
4. SQL Expertise
5. Pyspark Expertise
6. Performance Optimization
7. Data Integration & Collaboration
8. Security & Compliance
9. Documentation
Qualifications & Skills
Create a job alert for this search
Senior Data Engineer • Agra, IN
Related jobs
For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show moreLast updated: 1 day ago
- Promoted
Data Engineer
BayOne SolutionsAgra, IN We are seeking a highly experienced Data Engineer to join our MarTech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engine...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
IntraEdgeAgra, IN Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
DonyatiAgra, IN We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show moreLast updated: 1 day ago
- Promoted
Senior Oracle Data Engineer
Strattek ConsultingAgra, IN This role centers on architecting robust data pipelines across on-prem and cloud Oracle ecosystems, automating ingestion from varied sources including APIs.
Exposure to Oracle FDI (Fusion Data Intel...Show moreLast updated: 1 day ago
- Promoted
Data Engineer (GCP)
HISH IT SERVICESAgra, IN We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery).
This role requires a hands-on developer who can collaborate closely wit...Show moreLast updated: 7 days ago
- Promoted
Senior Data Engineer
SAIVA AIAgra, IN We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
IntelliasAgra, IN Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines.
Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 16 days ago
- Promoted
Senior Data Engineer - Data Acquisition
InfoBeansAgra, IN We are seeking a highly skilled.Senior Data Engineer – Data Acquisition (ODS).The ideal candidate will have extensive hands-on experience in building and optimizing data ingestion and transformatio...Show moreLast updated: 8 days ago
- Promoted
Data Engineer
AceolutionAgra, IN Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show moreLast updated: 30+ days ago
- Promoted
Senior AWS Data Engineer
CYAN360Agra, IN Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •.
Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
DigitalzoneAgra, IN As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.
Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 16 days ago
- Promoted
Data Engineer - Palantir Foundry
NP GroupAgra, IN Data Engineer - Palantir Foundry, Workshop, Pyspark & Typescript.Long Term (initially 6 months) full time contract.We have an immediate requirement for an experienced Data Engineer to join the glob...Show moreLast updated: 30+ days ago
- Promoted
Senior AI Engineer
eTeamAgra, IN We’re building AI products that are transforming the.Our mission is to revolutionize how organizations discover, develop, and engage talent through intelligent, human-centered AI solutions.We combi...Show moreLast updated: 1 day ago
- Promoted
(Senior) Azure Data Engineer - Full remote - contractor in USD
All European CareersAgra, INRemote
- Promoted
Data Engineer
Insight GlobalAgra, IN GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts.
Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Randstad EnterpriseAgra, IN Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ).
GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Platform Engineer
Black Dog LabsAgra, IN Remote (collaboration across time zones), India or LATAM preferred.Proficient English communication.Data Engineering / Backend Engineering / DevOps.
We’re looking for a hands-on Senior Data Platform...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
RecroAgra, IN Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake.
AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago