%20LIMITED){kind=logo}
Senior Data EngineerKOGTA FINANCIAL (INDIA) LIMITED • Visakhapatnam, IN
No longer accepting applications
Senior Data Engineer
KOGTA FINANCIAL (INDIA) LIMITED • Visakhapatnam, IN
10 days ago
Job descriptionDesign and maintain scalable, high-performance data warehouse solutions on AWS. Implement optimized data models and structures for AWS Redshift or equivalent environments. Leverage AWS services such as S3, Lambda, Redshift , EMR , Step Functions and others to build end-to-end data solutions. Stay updated with AWS advancements and recommend new tools or services to enhance data infrastructure. Develop and optimize complex SQL queries, stored procedures, and views for analytics and reporting. Troubleshoot and fine-tune SQL performance to ensure efficient data retrieval. Design, Develop and optimize ETL pipelines using Pyspark . Leverage optimization and data modelling capabilities to design data pipelines. Continuously monitor and enhance ETL and query performance. Identify and resolve processing bottlenecks across data pipelines and warehouse layers. Collaborate with cross-functional teams to integrate data from multiple systems. Partner with business stakeholders to understand and deliver on data requirements. Implement strong data security and governance measures. Ensure compliance with relevant industry standards and organizational policies. Maintain detailed documentation for ETL processes, data models, and configurations . Ensure proper handover and knowledge transfer within the team. Bachelor’s degree in Computer Science, Information Technology , or a related field. Experience with Spark Streaming will be an advantage. Proven experience as an ETL / Data Warehouse Developer with expertise in AWS and SQL. Strong proficiency in SQL , including complex queries and performance tuning. Hands on experience with developing and maintaining ETL pipeline using Pyspark . Excellent understanding of Spark architecture. Hands-on experience with AWS services such as S3, EMR, Redshift, Lambda, and Step Functions. Solid understanding of data modeling , data integration, and warehousing principles. Familiarity with data security, compliance, and governance best practices. Strong analytical, problem-solving, and communication skills. AWS Certification or equivalent credentials preferred.
Job Summary
Kogta Financial Ltd. is seeking an experienced and highly skilled ETL & Data Warehouse Developer with strong expertise in AWS data services . As a key member of our data engineering team, you will be responsible for designing, developing, and optimizing ETL pipelines and scalable data warehouse solutions on the AWS platform. The ideal candidate will have a solid background in data modeling, SQL performance tuning, and AWS-based data architectures .
Key Responsibilities
1. ETL Development
- Design, develop, and implement robust ETL processes using AWS EMR, AWS Data Pipeline, or custom scripts .
- Ensure efficient extraction, transformation, and loading of data from multiple sources into the data warehouse.
2. Data Warehousing
3. AWS Service Utilization
4. SQL Expertise
5. Pyspark Expertise
6. Performance Optimization
7. Data Integration & Collaboration
8. Security & Compliance
9. Documentation
Qualifications & Skills
Create a job alert for this search
Senior Data Engineer • Visakhapatnam, IN
Related jobs
For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show more%20Pvt%20Ltd)
Senior Azure Data Engineer
Tata Consultancy Services • Visakhapatnam, Republic Of India, IN
Job Title : Senior Data Engineer (Azure / SSIS).Minimum 6 yrs of experience in building.ETL pipeline using Azure data Factory, Azure Synapse.
Minimum 6 yrs of ETL development using PL / SQL.Exposure in A...Show more
Last updated: 3 days ago • Promoted
Data Engineer
Recro • Visakhapatnam, IN
Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake.
AI Data Enablement : Collaborate wi...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
SAIVA AI • Visakhapatnam, IN
We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Mindlance • Visakhapatnam, IN
We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show more
Last updated: 3 days ago • Promoted
Senior Data Engineer
SGS & Co • visakhapatnam, andhra pradesh, in
Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in.
The ideal candidate will play a ke...Show more
Last updated: 20 days ago • Promoted
Senior Data Engineer
Intellias • Visakhapatnam, IN
Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines.
Kafka + Flink / Spark Streaming).Python for data engin...Show more
Last updated: 20 days ago • Promoted
Data Engineer
MyData Insights Pvt Ltd • Visakhapatnam, IN
The ideal candidate has a strong background in building scalable data solutions on.CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices.Design, bu...Show more
Last updated: 3 days ago • Promoted
Senior Oracle Data Engineer
Strattek Consulting • Visakhapatnam, IN
This role centers on architecting robust data pipelines across on-prem and cloud Oracle ecosystems, automating ingestion from varied sources including APIs.
Exposure to Oracle FDI (Fusion Data Intel...Show more
Last updated: 5 days ago • Promoted
Senior Data Science Engineer
Confidential • Visakhapatnam, India
INR 3000000-4000000 / year (based on experience).Full Time Permanent position(Payroll and Compliance to be managed by : Winmore).
Note : This is a requirement for one of Uplers' client - Winmore).What...Show more
Last updated: 12 days ago • Promoted
Senior Data Engineer
Donyati • Visakhapatnam, IN
We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show more
Last updated: 5 days ago • Promoted
Senior Data Engineer
Live Connections • vizianagaram, andhra pradesh, in
Hiring : Data Engineer | 9-12 Years Experience | Remote (India).Python, SQL, Big Data, Cloud, Snowflake.We are looking for an experienced.
The ideal candidate will have deep experience in.Python, SQL...Show more
Last updated: 30+ days ago • Promoted
(Senior) Azure Data Engineer - Full remote - contractor in USD
All European Careers • Visakhapatnam, IN
Remote
Last updated: 5 days ago • Promoted
Miracle Software Systems - Senior Data Engineer - Synapse Analytics
Miracle Software Systems (I) Pvt Ltd • Vizag
Description : Role : Sr Data Engineer Job Summary : We are seeking a highly s...Show more
Last updated: 19 days ago • Promoted
Senior Data Engineer
K&K Talents • Visakhapatnam, IN
This position is with one of our.Role : Senior Data Engineer (Tableau + Real Estate Domain).Pune | Bangalore | Hyderabad | Gurgaon | Chennai | Noida | Mumbai.
Tableau | ETL / ELT | SQL | Python | Snow...Show more
Last updated: 18 hours ago • Promoted • New!
Data Engineer
Insight Global • Visakhapatnam, IN
GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts.
Proficiency in ETL / ELT pipeline development...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
DataOrbit AI • Visakhapatnam, IN
DataOrbit AI is a leading AI consulting firm dedicated to empowering small and medium investment managers to achieve AI readiness.
By uniting strategy, data preparation, technology, and execution, w...Show more
Last updated: 18 hours ago • Promoted • New!
Senior Data Engineer - Data Acquisition
InfoBeans • Visakhapatnam, IN
We are seeking a highly skilled.Senior Data Engineer – Data Acquisition (ODS).The ideal candidate will have extensive hands-on experience in building and optimizing data ingestion and transformatio...Show more
Last updated: 12 days ago • Promoted
Data Engineer
Digitalzone • Visakhapatnam, IN
As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.
Develop and maintain scalable ETL / ELT pipelines using Py...Show more
Last updated: 20 days ago • Promoted