Data Engineer 2
ConfidentialHyderabad / Secunderabad, Telangana30+ days ago
Job descriptionDevelop and maintain scalable data pipelines. Build new API integrations to support data flow and analytics requirements. Implement large-scale, high-volume, low-latency applications for efficient data processing. Design, develop, and maintain ETL pipelines. Apply dimension modeling and data warehousing best practices. Write complex SQL queries for data transformation, extraction, and validation. Build stream processing platforms using Kafka and Spark Streaming. Optimize data pipelines for performance and scalability. Independently deliver end-to-end projects with minimal supervision. 5+ years of development experience in big data using Spark. Strong programming skills in Python. Expertise in SQL and complex query writing. Experience with dimension modeling, data warehousing, and ETL pipelines. Knowledge of streaming platforms like Kafka and Spark Streaming. Experience with job orchestration frameworks like Airflow, Oozie, or Luigi. Familiarity with AWS services such as S3, EMR, RDS. Understanding of cloud data warehouses like Snowflake. Knowledge of SQL distribution engines like Presto, Druid. Familiarity with streaming frameworks like Flink. Exposure to NoSQL databases such as HBase or Cassandra.
Key Responsibilities :
Data Architecture & Solution Development
- Translate business and functional requirements into robust, scalable data solutions aligned with overall architecture.
- Design and implement data integrations and data quality frameworks.
- Participate in full development lifecycle including design, implementation, testing, documentation, delivery, support, and maintenance.
Pipeline & API Development
Big Data & ETL Development
Streaming & Advanced Processing
Required Skills & Experience :
Nice to Have :
Skills Required
Python, Spark, Sql, Data Warehousing, Etl, Aws
Create a job alert for this search
Data Engineer • Hyderabad / Secunderabad, Telangana
Related jobs
- Promoted
Data Engineer
Canopus Infosystems - A CMMI Level 3 CompanyHyderabad, IN Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization.The ideal candidate should be capable of building data pipelines, performing web scra...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Optumhyderabad, telangana, in Support the full data engineering lifecycle including research, proof of concepts, design, development, testing, deployment, and maintenance of data management solutions.
Utilize knowledge of variou...Show moreLast updated: 23 days ago
- Promoted
Data Engineer
LTIMindtreesecunderabad, telangana, in We are seeking a skilled Data Engineer with hands-on experience in.The ideal candidate will be responsible for developing scalable data pipelines, transforming and ingesting large-scale data, and e...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Veraxionhyderabad, telangana, in Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions.
Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 13 days ago
- Promoted
Senior Data Engineer
EXLHyderabad, Telangana, India Job Summary : We are seeking an experienced.The role involves building and optimizing ETL / ELT workflows, managing big data environments, and ensuring seamless data availability for analytics, AI / ML,...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer Ii
ClearDemandHyderabad, Republic Of India, IN Building on the foundation of the SDE-I role, the DE- II position takes on a greater level of responsibility and leadership.
You'll play a crucial role in driving the evolution and efficiency of our...Show moreLast updated: 2 days ago
- Promoted
Data Engineer
DigitalzoneHyderabad, IN As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.
Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 2 days ago
- Promoted
Data Engineer II
ClearDemandHyderabad, IN Building on the foundation of the SDE-I role, the DE- II position takes on a greater level of responsibility and leadership.
You'll play a crucial role in driving the evolution and efficiency of our...Show moreLast updated: 2 days ago
- Promoted
Data Engineer
Technogen India Pvt. Ltd.Hyderabad, Telangana, India The Impact : - Design, build, and measure complex ELT jobs to process disparate data sources and form a high integrity, high quality, clean data asset.
Executes and provides feedback for data modeli...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Prudent Technologies and Consulting, Inc.hyderabad, telangana, in Seeking an experienced Senior Data Engineer with over 9 years of industry experience to architect, build, and manage advanced data pipelines and platforms in a cloud environment.The ideal candidate...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Dexian Indiasecunderabad, telangana, in Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights.
Constructing infrastructure for efficient ETL processes from vari...Show moreLast updated: 2 days ago
- Promoted
Data Engineer
Quess Corp Limitedhyderabad, telangana, in Mandatory Skills : Sql, Snowflake, Python, Matillion and Tableau.Design and build scalable data models, data pipelines, and ETL / ELT processes within the Snowflake environment.Write and optimize com...Show moreLast updated: 2 days ago
- Promoted
Data Engineer
Recrosecunderabad, telangana, in Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake.
AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer- Snowflake
Prudent Technologies and Consulting, Inc.hyderabad, telangana, in We are seeking a skilled Data Engineer with strong experience in Python, Snowflake, and AWS.The ideal candidate will be responsible for building and optimizing scalable data pipelines, integrating ...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer – Databricks Platform
Amicon Hub ServicesHyderabad, Telangana, India Delta Lake, Spark, PySpark, SQL).SQL Server, MongoDB, InfluxDB).Kafka, Azure Event Hubs, or similar).Excellent problem-solving skills and the ability to work in a fast-paced environment.Familiar wi...Show moreLast updated: 12 days ago
- Promoted
Data Engineer
Thermo Fisher ScientificHyderabad, Telangana, India This job is with Thermo Fisher Scientific, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community.
Please do not contact the recruiter directly...Show moreLast updated: 5 days ago
- Promoted
Data Engineer
Insight GlobalHyderabad, IN GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts.
Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer II
McDonalds in IndiaHyderabad, India Builds and maintains relevant and reliable data products that support Finance Analytics.Develops and implements new technology solutions as needed to ensure ongoing improvement with data reliabilit...Show moreLast updated: 30+ days ago