Data Solutions Engineer
StraiveHyderabad, Republic Of India, IN4 days ago
Job descriptionWrite and optimize complex SQL for ingestion, transformation and consumption layers. Tune Spark jobs for performance and cost : partitioning, join strategies, broadcast, memory / tuning, shuffle reduction. Ensure code quality via unit tests, integration tests, CI / CD and code reviews. Work with data modeling, schema evolution and data quality checks to ensure reliable outputs. Collaborate with platform / DevOps teams to deploy and monitor pipelines (retries, logging, alerting). Troubleshoot production issues and perform root-cause analysis. Mentor and guide junior engineers, share best practices and drive improvements to the data platform. 5–8 years industry experience as a Data Engineer. Strong hands-on experience with Apache Spark 3.X (development, tuning, debugging). Proficient in Scala programming for Spark ETL / ELT development (datasets, RDDs when required). Experience with streaming frameworks like Spark Structured Streaming, Kafka . Proficient in Python programming . Advanced SQL skills (complex queries, window functions, CTEs, query optimization). Experience building production-grade ETL / ELT workflows, testing and monitoring them. Experience with orchestration tools like Apache Airflow Strong software engineering fundamentals : version control (Git), modular code, code reviews, CI / CD pipelines. Experience with cloud object storage and common data formats (Parquet / ORC / Avro). Strong problem solving, communication and collaboration skills. Experience with AWS Glue, EMR, Athena, Redshift, S3 will be a plus.
Key Responsibilities :
- Design, build and maintain scalable batch and (optionally) streaming data pipelines using Apache Spark 3.X, Scala, Python & SQL
- Implement core ETL / ELT logic in Scala and Python;
author efficient Spark DataFrame / Dataset jobs.
Qualifications :
Create a job alert for this search
Solution Engineer • Hyderabad, Republic Of India, IN
Related jobs
- Promoted
Data Engineer
Prudent Technologies and Consulting, Inc.Hyderabad, Telangana, India Job Summary : Seeking an experienced Senior Data Engineer with over 9 years of industry experience to architect, build, and manage advanced data pipelines and platforms in a cloud environment.The i...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
DigitalzoneHyderabad, IN As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.
Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 17 days ago
- Promoted
Data Engineer
RecroHyderabad, IN Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake.
AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
- Promoted
AWS Data Engineer
Vista Applied Solutions Group IncHyderabad, IN Job Summary for AWS Data Engineer : .Job Qualification and Responsibilities for AWS Data Engineer : .Advanced SQL (performance tuning, joins, windows functions).
Hands-on with AWS : Glue, Lambda, Redshif...Show moreLast updated: 3 days ago
- Promoted
- New!
Azure Data Solutions Architect
KPI PartnersHyderabad, Republic Of India, IN KPI Partners are seeking highly skilled and experienced Senior Data Engineers to join our dynamic team at KPI, working on challenging and multi-year data transformation projects for our clients.Thi...Show moreLast updated: 1 hour ago
- Promoted
Data Engineer
Technogen India Pvt. Ltd.Hyderabad, Telangana, India The Impact : Design, build, and measure complex ELT jobs to process disparate data sources and form a high integrity, high quality, clean data asset.
Executes and provides feedback for data modeling ...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
HCLTechHyderabad, Telangana, India Currently Hiring for "Azure Data Engineer”.Chennai / Hyderabad / Bangalore / Pune / Noida.Interested candidate please share below details along with update resume.
Interested candidate please drop mail t...Show moreLast updated: 15 days ago
- Promoted
Data Engineer - Snowflake
Prudent Technologies and Consulting, Inc.hyderabad, telangana, in We are seeking a skilled Data Engineer with strong experience in Python, Snowflake, and AWS.The ideal candidate will be responsible for building and optimizing scalable data pipelines, integrating ...Show moreLast updated: 4 days ago
- Promoted
- New!
Data Integration Solutions Engineer
ConfidentialHyderabad, Republic Of India, IN We are looking for a highly skilled SnapLogic Developer with over 5 years of experience in designing, developing, and maintaining integration solutions.
The ideal candidate should have hands-on expe...Show moreLast updated: 1 hour ago
- Promoted
- New!
Databricks GenAI Solutions Engineer
SyrenHyderabad, Republic Of India, IN Model Serving, Vector Search, and embedding workflows.Clustering, Unity Catalog, Delta Lake).OpenAI / Azure OpenAI), and GenAI app patterns (RAG / Agents).
Proficiency in SQL, Spark performance tuning...Show moreLast updated: 1 hour ago
- Promoted
- New!
Lead Databricks Platform Engineer
SonatypeHyderabad, Republic Of India, IN The Databricks Administrator will be responsible for the overall health, security, and performance of the Databricks platform.
This includes managing user access, implementing and enforcing data gov...Show moreLast updated: 1 hour ago
- Promoted
Data Engineer Lead
JRD SystemsHyderabad, Telangana, India The ideal candidate will have a strong background in.Databricks, Azure Data Factory, Alteryx, Ab Initio, Talend, and Informatica.
This role will lead the design and delivery of.Databricks (PySpark, ...Show moreLast updated: 2 days ago
- Promoted
Lead Data Engineer
Accordion IndiaHyderabad, Telangana, India Accordion is a global private equity-focused financial consulting firm specializing in driving value creation through services rooted in Data & Analytics and powered by technology.Accordion works a...Show moreLast updated: 14 days ago
- Promoted
AWS Data Engineer
Tata Consultancy Servicessecunderabad, telangana, in Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show moreLast updated: 26 days ago
- Promoted
Databricks Data Engineer Lead – Sustainability Project
Blue Cloud Softech Solutions LimitedHyderabad, IN BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level ...Show moreLast updated: 3 days ago
- Promoted
AWS Data Solutions Engineer
Tata Consultancy ServicesHyderabad, Republic Of India, IN Desired Competencies (Technical / Behavioral Competency).Should have expertise in creating data warehouses in AWS utilizing the following tools : EC2, S3, EMR, Athena, Sagemaker, Aurora and Snowflake....Show moreLast updated: 30+ days ago
- Promoted
Azure Data Solutions Engineer
Tata Consultancy ServicesHyderabad, Republic Of India, IN TCS is conducting Weekday Virtual drive for the role of.Years of experience : 5 to 10 yrs.Date of Interview : 6th Nov 2025.
Time of Interview : 10 AM to 2 PM.Developing, managing and optimizing robust ...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Insight GlobalHyderabad, IN GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts.
Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago