Data Engineering Azure databricks
EXLJodhpur, IN23 days ago
Job descriptionStrong knowledge on Python and Pyspark Expectation is to have ability to write Pyspark scripts for developing data workflows. Strong knowledge on SQL, Hadoop, Hive, Azure, Databricks and Greenplum Expectation is to write SQL to query metadata and tables from different data management system such as, Oracle, Hive, Databricks and Greenplum. Familiarity with big data technologies like Hadoop, Spark, and distributed computing frameworks. Expectation is to use Hue and run Hive SQL queries, schedule Apache Oozie jobs to automate the data workflows. Good working experience of communicating with the stakeholders and collaborate effectively with the business team for data testing. Expectation is to have strong problem-solving and troubleshooting skills. Expectation is to establish comprehensive data quality test cases, procedures and implement automated data validation processes. Degree in Data Science, Statistics, Computer Science or other related fields or an equivalent combination of education and experience. 4-7 years of experience in Data Engineer. Proficiency in programming languages commonly used in data engineering, such as Python, Pyspark, SQL. Experience in Azure cloud computing platform, such as developing ETL processes using Azure Data Factory, big data processing and analytics with Azure Databricks. Strong communication, problem solving and analytical skills with the ability to do time management and multi-tasking with attention to detail and accuracy.
Data Engineer (DE) Consultant is responsible for designing, developing, and maintaining data assets and data related products by liaising with multiple stakeholders.
Responsibilities :
- Work with stakeholders to understand the data requirements to design, develop, and maintain complex ETL processes.
- Create the data integration and data diagram documentation.
- Lead the data validation, UAT and regression test for new data asset creation.
- Create and maintain data models, including schema design and optimization.
- Create and manage data pipelines that automate the flow of data, ensuring data quality and consistency.
Qualifications and Skills :
Create a job alert for this search
Data Engineering • Jodhpur, IN
Related jobs
Position : Databricks Engineer.Duration : 12 months with extensions.REQUIRED SKILLS AND EXPERIENCE.Strong hands-on experience with Databricks for data processing and pipeline development.Proficiency...Show moreLast updated: 5 days ago
- Promoted
- New!
Azure Databricks Admin
Greymatter InnovationzJodhpur, IN Greymatter Innovationz helps you stay digitally relevant across domains, technologies, and skillsets, every day.Location : Anywhere in India / Bangalore preferred.
Databricks Platform Support and capa...Show moreLast updated: 21 hours ago
- Promoted
Data Engineer
TalogyJodhpur, IN This opportunity is ideal for a determined and proactive individual who has a wide range of skills in a variety of database administration, reporting and dashboarding disciplines.This role requires...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
INFEC Servicesajit, rajasthan, in Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms.Imple...Show moreLast updated: 27 days ago
- Promoted
Data Platform Engineer
Intuitive.CloudJodhpur, IN With the reputation of being a.Digital Transformation challenges across following Intuitive Superpowers : .Application & Database Modernization.
Platform Engineering (IaC / EaC, DevSecOps & SRE).Cloud N...Show moreLast updated: 28 days ago
- Promoted
Senior Data Engineer
Saransh Incajit, rajasthan, in Data Engineer (Contract-to-Hire | Remote).Full-Time / Fixed-Term Contract (12 months, extendable based on performance).We are seeking a highly skilled.
The ideal candidate will be hands-on, detail-o...Show moreLast updated: 8 days ago
- Promoted
Databricks Engineer Remote Job Offshore
KPG99 INCJodhpur, INRemote
- Promoted
Azure Data Engineer
K&K Talents - IndiaJodhpur, IN This position is with one of our.Location : Bangalore, Bhopal, Chennai, Gurugram, Hyderabad, Jaipur, Pune.Employment Type : Full-time Permanent.
We are seeking an experienced Data Engineer with strong...Show moreLast updated: 7 days ago
- Promoted
Principal Data Engineer
K&K Talents - IndiaJodhpur, IN This position is with one of our.Title : Principal Data Engineer.Location : Bangalore, Bhopal, Chennai, Gurugram, Hyderabad, Jaipur, Pune.
Employment Type : Full-time Permanent.GCP or AWS, Spark, Pyspa...Show moreLast updated: 8 days ago
- Promoted
Engineering Manager - Data Platform
CoinbaseJodhpur, IN Ready to be pushed beyond what you think you’re capable of?.At Coinbase, our mission is to increase economic freedom in the world.
It’s a massive, ambitious opportunity that demands the best of us, ...Show moreLast updated: 1 day ago
- Promoted
Senior Azure Data Engineer
Programmers.ioajit, rajasthan, in Job Title : Senior Azure Data Engineer.Skills Required : Azure Synapse, Azure Data Factory, Azure Databricks, and ADLS Gen2, PySpark, SQL,Microsoft Fabrics.
Experience Range : 5 Years - 12 years.We are...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Response Informaticsjodhpur, rajasthan, in AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture.
CICD - Terraform or CloudFo...Show moreLast updated: 18 days ago
- Promoted
Data Engineering Role
100x.incJodhpur, IN At least 3 years of professional experience in Data Engineering.Demonstrated end-to-end ownership of ETL pipelines.Deep, hands-on experience with AWS services : EC2, Athena, Lambda, and Step Functio...Show moreLast updated: 18 days ago
- Promoted
Senior AWS Data Engineer
CYAN360Jodhpur, IN Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •.
Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
- Promoted
- New!
Data Engineering Manager – AI & Automation (7 to 12 Years)
AIMLEAPJodhpur, IN Data Engineering Manager – AI & Automation.Remote (Work from Home) / Bangalore / India .Tech / MCA / Computer Science / IT .
IT / Data / AI / E-commerce / FinTech / Healthcare .Python-based data scr...Show moreLast updated: 2 hours ago
- Promoted
Lead Data Engineer
ITQube LTDajit, rajasthan, in Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the A...Show moreLast updated: 18 days ago
- Promoted
Databricks Engineer
Tata Consultancy Servicesjodhpur, rajasthan, in Skills : Azure Databricks, Pyspark, ADLS, ADF.Responsibility of / Expectations from the Role : .Designing and building Databricks data pipelines is required.
Experience in transforming the data using A...Show moreLast updated: 16 days ago
- Promoted
- New!
Azure Cloud Data Engineer
Intelebeejodhpur, India Data Factory, Synapse, and Databricks.Python, PySpark, and Advanced SQL.Lakehouse / Medallion architecture.Customer Interaction & Technical Documentation.
Interact with clients and business stakehol...Show moreLast updated: 9 hours ago
- Promoted
Data Engineer(Azure / AWS, Python / Pyspark, SQL)
Sail Analyticsajit, rajasthan, in Architect, develop, test and maintain scalable data warehouses and data pipelines.Expertise in SQL, PySpark / Python and Azure(ADB, ADF) or AWS(Glue, Lambda, Redshift).
Bachelor's degree or equivalent...Show moreLast updated: 16 days ago