Sr Data Engineer
ConfidentialHyderabad / Secunderabad, Telangana, Chennai, Bengaluru / Bangalore30+ days ago
Job descriptionDevelop, configure, and optimize Apache DolphinScheduler workflows for data processing and automation. Design and implement ETL pipelines, job scheduling, and workflow orchestration solutions. Troubleshoot and resolve performance, scalability, and reliability issues in DolphinScheduler. Integrate DolphinScheduler with big data tools such as Hadoop, Spark, Flink, Hive, and Kafka. Work closely with data engineers, DevOps, and software teams to enhance workflow automation. Develop custom plugins and extensions for DolphinScheduler as needed. Monitor and optimize job execution, resource allocation, and workflow efficiency. Maintain best practices for CI / CD, version control, and infrastructure automation.
Required Skills Qualifications :
- Strong experience with Apache DolphinScheduler in a production environment.
- Proficiency in Java, Python, or Scala for workflow scripting and automation.
- Experience with big data technologies like Hadoop, Spark, Hive, Flink, and Kafka.
- Understanding of workflow orchestration, DAG execution, and scheduling strategies.
- Strong problem-solving skills and ability to work in a fast-paced environment.
Role : Data Engineer
Industry Type : IT Services & Consulting
Department : Data Science & Analytics
Employment Type : Full Time, Permanent
Role Category : Data Science & Machine Learning
Education
UG : Any Graduate
PG : Any Postgraduate
Skills Required
Version Control, Orchestration, Scala, Resource Allocation, Workflow, Data Processing, Scheduling, Automation, Apache, Python
Create a job alert for this search
Sr Data Engineer • Hyderabad / Secunderabad, Telangana, Chennai, Bengaluru / Bangalore
Related jobs
- Promoted
Data Engineer
meanSquare.aiHyderabad, Telangana, India Data Engineer (onsite | Offshore | PST Overlap Required) We’re looking for an experienced and independent Data Engineer to help us design and build data systems that are clean, scalable, and reusa...Show moreLast updated: 2 days ago
- Promoted
Sr. Data Engineer
ConfidentialHyderabad / Secunderabad, Telangana, Chennai, Bengaluru / Bangalore We are seeking a Data Engineer to help build and integrate a Generative AI-powered conversational assistant, into our website and mobile app.
This role is crucial in handling data pipelines, model t...Show moreLast updated: 30+ days ago
- Promoted
- New!
lead Data Engineer
Cozzerahyderabad, telangana, in Location : Remote ( 1 week from noida office then remote).We are looking for an accomplished Lead Data Engineer with 8–10 years of experience in.
Delta Lake, Spark, MLflow), and modern orchestration ...Show moreLast updated: 20 hours ago
- Promoted
Data Engineer
IntraEdgesecunderabad, telangana, in The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago
- Promoted
Sr.Data Engineer
ConfidentialHyderabad / Secunderabad, Telangana Design, build, and maintain efficient and scalable data pipelines to ingest, process, and transform large volumes of data from a variety of sources into data warehouses or data lakes.Architecture &...Show moreLast updated: 30+ days ago
- Promoted
Sr Data Engineer
Mitchell Martin Inc.Hyderabad, IN Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer to design, build, and optimize data pipelines and systems that power our analytics, reporting, and data-driven decision-mak...Show moreLast updated: 3 days ago
- Promoted
Senior Data Engineer
AIQUHyderabad, IN We are hiring for Senior Data Engineer to join one of our major clients based out of KSA.Employment Type : Contract – 12 months & extendable.
The Senior Data Engineer plays a lead role in designing, ...Show moreLast updated: 1 day ago
- Promoted
Senior Data Engineer
TezoHyderabad, Telangana, India Tezo is a new generation Digital & AI solutions provider, with a history of creating remarkable outcomes for our customers.
We bring exceptional experiences using cutting-edge analytics, data profic...Show moreLast updated: 19 days ago
- Promoted
Sr Data Engineer I
ConfidentialHyderabad / Secunderabad, Telangana Our data team serves Zinnia through data engineering, data analysis, and data science.Our goal is to help uncover opportunities and make decisions with data.
We partner with all department stakehold...Show moreLast updated: 30+ days ago
- Promoted
- New!
Sr. Data Engineer – AWS Databricks / Data Tech Lead - Contract
Gravity Infosolutions, Inc.Hyderabad, Telangana, India Data Engineer – AWS Databricks / Data Tech Lead.Duration : 3 Months+ Extendable.Design and implement robust ETL / ELT pipelines using Databricks, PySpark, and Delta Lake to process structured and unst...Show moreLast updated: 4 hours ago
- Promoted
Data Engineer
Prudent Technologies and Consulting, Inc.Hyderabad, Telangana, India Seeking an experienced Senior Data Engineer with over 9 years of industry experience to architect, build, and manage advanced data pipelines and platforms in a cloud environment.The ideal candidate...Show moreLast updated: 21 days ago
- Promoted
Senior Data Engineer (AWS / Databricks)
Accoladehyderabad, telangana, in The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 22 days ago
- Promoted
Data Engineer Sr Associate
ConfidentialHyderabad / Secunderabad, Telangana Design, build and maintain complex ELT / ETL jobs that deliver business value.Extract, transform and load data from various sources including databases, APIs, and flat files using IICS or Python / SQL....Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
ConfidentialHyderabad / Secunderabad, Telangana We are looking for a highly motivated Sr Data Engineer to build a state-of-the-art data platform to solve various data-driven use cases across the organization.
This platform will host multiple data...Show moreLast updated: 30+ days ago
- Promoted
- New!
AI-Enabled Data Engineer (Azure | Teradata | Snowflake | Databricks)
Prophecy TechnologiesHyderabad, Telangana, India Job Title : AI-Enabled Data Engineer (Azure | Teradata | Snowflake | Databricks).Experience Level : Mid-Level (5+ Years).
We are looking for a dynamic and experienced Data Engineer with a strong found...Show moreLast updated: 11 hours ago
- Promoted
Senior Data Engineer
USEReadyhyderabad, telangana, in Job Title : Senior Databricks Engineer.As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakeho...Show moreLast updated: 22 days ago
- Promoted
Sr. Data Engineer
ValueMomentumHyderabad, Telangana, India We are seeking a Senior Databricks Data Engineer with experience in designing and developing data pipelines using Azure Databricks, Data Factory, and Datalake.
The role involves managing large volum...Show moreLast updated: 30+ days ago
- Promoted
- New!
Sr. Data Engineer – AWS Databricks / Data Tech Lead
Gravity Infosolutions, Inc.Hyderabad, Telangana, India Data Engineer – AWS Databricks / Data Tech Lead.Duration : 3 Months+ Extendable.Design and implement robust ETL / ELT pipelines using Databricks, PySpark, and Delta Lake to process structured and unst...Show moreLast updated: 4 hours ago