This job offer is not available in your country.
Data Engineering
EXLChennai, Tamil Nadu, India5 days ago
Job descriptionStrong knowledge on Python and Pyspark Expectation is to have ability to write Pyspark scripts for developing data workflows. Strong knowledge on SQL, Hadoop, Hive, Azure, Databricks and Greenplum Expectation is to write SQL to query metadata and tables from different data management system such as, Oracle, Hive, Databricks and Greenplum. Familiarity with big data technologies like Hadoop, Spark, and distributed computing frameworks. Expectation is to use Hue and run Hive SQL queries, schedule Apache Oozie jobs to automate the data workflows. Good working experience of communicating with the stakeholders and collaborate effectively with the business team for data testing. Expectation is to have strong problem-solving and troubleshooting skills. Expectation is to establish comprehensive data quality test cases, procedures and implement automated data validation processes. Degree in Data Science, Statistics, Computer Science or other related fields or an equivalent combination of education and experience. 3-7 years of experience in Data Engineer. Proficiency in programming languages commonly used in data engineering, such as Python, Pyspark, SQL. Experience in Azure cloud computing platform, such as developing ETL processes using Azure Data Factory, big data processing and analytics with Azure Databricks. Strong communication, problem solving and analytical skills with the ability to do time management and multi-tasking with attention to detail and accuracy.
Responsibilities :
- Work with stakeholders to understand the data requirements to design, develop, and maintain complex ETL processes.
- Create the data integration and data diagram documentation.
- Lead the data validation, UAT and regression test for new data asset creation.
- Create and maintain data models, including schema design and optimization.
- Create and manage data pipelines that automate the flow of data, ensuring data quality and consistency.
Qualifications and Skills :
Create a job alert for this search
Data Engineering • Chennai, Tamil Nadu, India
Related jobs
- Promoted
Engineering Manager - AI Platform
CoinbaseChennai, IN Ready to be pushed beyond what you think you’re capable of?.At Coinbase, our mission is to increase economic freedom in the world.
It’s a massive, ambitious opportunity that demands the best of us, ...Show moreLast updated: 30+ days ago
- Promoted
Engineering Manager - Data & Platform
DFCS TechnologiesChennai The Role : We're seeking an Engineering Manager for Data & Platform who thrives at the intersection of real-time data architecture and people leadership.Repo...Show moreLast updated: 22 days ago
- Promoted
Senior Engineering Manager-Big Data, Generative AI
Extreme NetworksChennai, IN Over 50,000 customers globally trust our end-to-end, cloud-driven networking solutions.They rely on our top-rated services and support to accelerate their digital transformation efforts and deliver...Show moreLast updated: 7 days ago
- Promoted
Engineering Lead - Cloud & Data Engineering
Nazztec Private LimitedChennai Job Title : Engineering Lead Cloud & Data Engineer Work Base Location : Chennai / Hyderabad / Pune Experience Ra...Show moreLast updated: 15 days ago
- Promoted
Lead Data Engineer
Eucloid Data SolutionsChennai, IN Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 7 days ago
- Promoted
SAP Datasphere
Tata Consultancy ServicesChennai, Tamil Nadu, India Looking for a strong profile who have implemented min.This role requires expertise in designing, implementing, and maintaining scalable data solutions.
Design and develop advanced data models using ...Show moreLast updated: 8 days ago
- Promoted
Managed Services Consultant - Data Engineering
JMAN GroupChennai, Tamil Nadu, India JMAN Group is a fast-growing data engineering & data science consultancy.We work primarily with Private Equity Funds and their Portfolio Companies to create commercial value using Data & Artificial...Show moreLast updated: 6 days ago
- Promoted
Senior Data Engineer - Data Build Tool & Snowflake DB
ResourcetreeChennai Job Description : We are looking for a skilled and experienced DBT-Snowflake Developer to join our team! As part of the team, you will be involved in the implementation of the ongoing and...Show moreLast updated: 30+ days ago
- Promoted
Scrum Master – Data Engineering
Incedo Inc.Chennai, Tamil Nadu, India Scrum Master – Data Engineering.Strong knowledge of Scrum methodology.Fundamental SQL expertise (Must have).Data Engineering background (Data processing, documentation).
Completed at least 2 Data En...Show moreLast updated: 20 days ago
- Promoted
Associate Architect - Data Engineering
Response Informaticschennai, tamil nadu, in We are seeking an experienced Data Architect to lead the transformation of enterprise data.Alteryx workflows into Azure Databricks.
Microsoft Azure ecosystem, including Azure.Data Factory, Databrick...Show moreLast updated: 26 days ago
- Promoted
Publicis Sapient - Data Engineering Manager / Architect
Publicis SapientChennai Manager Data Engineer As Manager, Data Engineering, you will be responsible for translating client requirements into design, architecting, and implementing GCP / Azure ...Show moreLast updated: 29 days ago
- Promoted
- New!
Data Engineering Azure databricks
EXLChennai, IN Data Engineer (DE) Consultant is responsible for designing, developing, and maintaining data assets and data related products by liaising with multiple stakeholders.
Work with stakeholders to unders...Show moreLast updated: 10 hours ago
- Promoted
Data Engineer
Talent Corner HR Services Pvt LtdChennai, Tamil Nadu, India We are seeking a dynamic professional to fill in our Data Engineering role who will be responsible for designing, developing, and maintaining the data architecture, infrastructure, and pipelines th...Show moreLast updated: 7 days ago
- Promoted
Data Platform Engineer
Intuitive.CloudChennai, IN With the reputation of being a.Digital Transformation challenges across following Intuitive Superpowers : .Application & Database Modernization.
Platform Engineering (IaC / EaC, DevSecOps & SRE).Cloud N...Show moreLast updated: 5 days ago
- Promoted
Senior Full Stack SDE with Data Engineering for Analytics
TruckmentumChennai, IN Truckmentum is seeking a Senior Full Stack Software Development Engineer (SDE) with deep data engineering experience to help us build cutting-edge software and data infrastructure for our AI-driven...Show moreLast updated: 30+ days ago
- Promoted
Principal Data Engineer
XebiaChennai, IN We’re Hiring : Principal Data Engineer | Any Xebia Location (Hybrid, 3 days in office per week).Any Xebia Location (Hybrid – 3 days in office per week).
Data Engineering with 4+ years team leadership...Show moreLast updated: 22 days ago
- Promoted
Rocket UniData Engineer
Mitra AIChennai, IN The ideal candidate will have a deep understanding of UniData and UniVerse environments, with a proven track record in developing, maintaining, and optimizing complex legacy systems.Design, develop...Show moreLast updated: 18 days ago
- Promoted
Senior Manager - Data Engineering Lead
DIAGEO Indiachennai, tamil nadu, in Senior Manager - Data Engineering Lead.Bachelor’s or master’s degree in computer science, Data Engineering, or related field.
Experience in data engineering.Proven experience in cloud platforms (AWS...Show moreLast updated: 26 days ago