This job offer is not available in your country.
Data Engineering Azure databricks
EXLDelhi, IN6 hours ago
Job descriptionStrong knowledge on Python and Pyspark Expectation is to have ability to write Pyspark scripts for developing data workflows. Strong knowledge on SQL, Hadoop, Hive, Azure, Databricks and Greenplum Expectation is to write SQL to query metadata and tables from different data management system such as, Oracle, Hive, Databricks and Greenplum. Familiarity with big data technologies like Hadoop, Spark, and distributed computing frameworks. Expectation is to use Hue and run Hive SQL queries, schedule Apache Oozie jobs to automate the data workflows. Good working experience of communicating with the stakeholders and collaborate effectively with the business team for data testing. Expectation is to have strong problem-solving and troubleshooting skills. Expectation is to establish comprehensive data quality test cases, procedures and implement automated data validation processes. Degree in Data Science, Statistics, Computer Science or other related fields or an equivalent combination of education and experience. 4-7 years of experience in Data Engineer. Proficiency in programming languages commonly used in data engineering, such as Python, Pyspark, SQL. Experience in Azure cloud computing platform, such as developing ETL processes using Azure Data Factory, big data processing and analytics with Azure Databricks. Strong communication, problem solving and analytical skills with the ability to do time management and multi-tasking with attention to detail and accuracy.
Data Engineer (DE) Consultant is responsible for designing, developing, and maintaining data assets and data related products by liaising with multiple stakeholders.
Responsibilities :
- Work with stakeholders to understand the data requirements to design, develop, and maintain complex ETL processes.
- Create the data integration and data diagram documentation.
- Lead the data validation, UAT and regression test for new data asset creation.
- Create and maintain data models, including schema design and optimization.
- Create and manage data pipelines that automate the flow of data, ensuring data quality and consistency.
Qualifications and Skills :
Create a job alert for this search
Data Engineering • Delhi, IN
Related jobs
- Promoted
Lead Data Engineer
Eucloid Data SolutionsDelhi, IN Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 7 days ago
- Promoted
Data Architect
InfoBeansDelhi, IN Data Architect – Snowflake & Matillion.Snowflake, Matillion, Data Modeling, SQL, Python / Bash, Cloud Platforms (AWS / Azure).
Immediate to 15 days preferred.The ideal candidate is proactive, self-direc...Show moreLast updated: 16 days ago
- Promoted
Senior Data Engineer
EXLDelhi, IN We are seeking a highly skilled.You will work closely with cross-functional teams to provide thought leadership deliver robust, secure, and high-performance data solutions that empower analytics an...Show moreLast updated: 25 days ago
- Promoted
- New!
Senior Generative AI Engineer (Databricks,Data Lake)
AmpstekDelhi, IN Title : Senior Generative AI Engineer (Databricks,Data Lake).Design and implement GenAI models (LLMs, multimodal, embeddings, and fine-tuning) for enterprise use cases.
Architect and optimize data pi...Show moreLast updated: 6 hours ago
- Promoted
Lead Azure Data Engineer
RandomTreesGhaziabad, IN We’re a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologies.
If you're passionate about building r...Show moreLast updated: 26 days ago
- Promoted
Data Engineer
Insight GlobalDelhi, IN Notice Period : This is a ASAP hire - only apply if you can start 2 weeks after offer is extended!.Priority scheduling for candidates who message on with resume.
Design, develop, and maintain robust...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Kumaran SystemsDelhi, IN Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 7 days ago
- Promoted
Azure BI and Data Engineer with Fabric and Power BI
HTC Global ServicesDelhi, IN The Senior Business Intelligence (BI) & Data Engineer is responsible for the design, development, and delivery of business intelligence and data solutions.
This role ensures robust data architecture...Show moreLast updated: 22 days ago
- Promoted
Data Engineer
IntraEdgeDelhi, IN Snowflake, AWS (Lambda, Glue), DBT, and SQL.The ideal candidate will be responsible for enabling seamless data integration, transformation, and analytics to support business intelligence and advanc...Show moreLast updated: 30+ days ago
- Promoted
Data Platform Engineer
Intuitive.CloudDelhi, IN With the reputation of being a.Digital Transformation challenges across following Intuitive Superpowers : .Application & Database Modernization.
Platform Engineering (IaC / EaC, DevSecOps & SRE).Cloud N...Show moreLast updated: 5 days ago
- Promoted
- New!
Senior Generative AI Engineer (Databricks Data Lake)
AmpstekDelhi, IN Title : Senior Generative AI Engineer (Databricks Data Lake).We are seeking an experienced Senior Generative AI Engineer with a strong background in Databricks and data lake architectures.This indiv...Show moreLast updated: 6 hours ago
- Promoted
Senior Data Engineer
DeltacubesDelhi, IN Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect.
Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 15 days ago
- Promoted
Data Engineer
XebiaDelhi, IN We’re Hiring : Data Engineer | Xebia.Any Xebia location (Hybrid, 3 days office per week).Immediate to 2 weeks – only apply if you can join early.
Databricks, Python, SQL, and Postgres.The ideal candi...Show moreLast updated: 5 days ago
- Promoted
- New!
Data Engineering Azure databricks
EXLGhaziabad, IN Data Engineer (DE) Consultant is responsible for designing, developing, and maintaining data assets and data related products by liaising with multiple stakeholders.
Work with stakeholders to unders...Show moreLast updated: 6 hours ago
- Promoted
Data Engineer
Otomeyt AIDelhi, IN We are seeking a highly skilled 5+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 30+ days ago
- Promoted
Principal Data Engineer
XebiaDelhi, IN We’re Hiring : Principal Data Engineer | Any Xebia Location (Hybrid, 3 days in office per week).Any Xebia Location (Hybrid – 3 days in office per week).
Data Engineering with 4+ years team leadership...Show moreLast updated: 21 days ago
- Promoted
Senior Data Engineer
InfogainDelhi, IN Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers.
You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
- Promoted
Senior Full Stack SDE with Data Engineering for Analytics
TruckmentumDelhi, IN Truckmentum is seeking a Senior Full Stack Software Development Engineer (SDE) with deep data engineering experience to help us build cutting-edge software and data infrastructure for our AI-driven...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
HISH IT SERVICESDelhi, IN Location : Remote(Banglore,Chennai,Pune).Pay : 14LPA - 18 LPA(Based on Experience).Timings : A couple of hours overlap with EST, as the client is Canada-based (till 12AM IST).Start Date : 20th Octob...Show moreLast updated: 6 days ago
- Promoted
Data Engineer
Innodata Inc.Delhi, IN CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 25 days ago