No longer accepting applications
Data Engineering (3 Days Left)
EXLChennai, Tamil Nadu, India22 hours ago
Job descriptionStrong knowledge on Python and Pyspark Expectation is to have ability to write Pyspark scripts for developing data workflows. Strong knowledge on SQL, Hadoop, Hive, Azure, Databricks and Greenplum Expectation is to write SQL to query metadata and tables from different data management system such as, Oracle, Hive, Databricks and Greenplum. Familiarity with big data technologies like Hadoop, Spark, and distributed computing frameworks. Expectation is to use Hue and run Hive SQL queries, schedule Apache Oozie jobs to automate the data workflows. Good working experience of communicating with the stakeholders and collaborate effectively with the business team for data testing. Expectation is to have strong problem-solving and troubleshooting skills. Expectation is to establish comprehensive data quality test cases, procedures and implement automated data validation processes. Degree in Data Science, Statistics, Computer Science or other related fields or an equivalent combination of education and experience. 3-7 years of experience in Data Engineer. Proficiency in programming languages commonly used in data engineering, such as Python, Pyspark, SQL. Experience in Azure cloud computing platform, such as developing ETL processes using Azure Data Factory, big data processing and analytics with Azure Databricks. Strong communication, problem solving and analytical skills with the ability to do time management and multi-tasking with attention to detail and accuracy.
Responsibilities :
- Work with stakeholders to understand the data requirements to design, develop, and maintain complex ETL processes.
- Create the data integration and data diagram documentation.
- Lead the data validation, UAT and regression test for new data asset creation.
- Create and maintain data models, including schema design and optimization.
- Create and manage data pipelines that automate the flow of data, ensuring data quality and consistency.
Qualifications and Skills :
Create a job alert for this search
Days Left Engineering • Chennai, Tamil Nadu, India
Related jobs
- Promoted
Data Engineering Role
100x.incChennai, IN At least 3 years of professional experience in Data Engineering.Demonstrated end-to-end ownership of ETL pipelines.Deep, hands-on experience with AWS services : EC2, Athena, Lambda, and Step Functio...Show moreLast updated: 29 days ago
- Promoted
Senior Data Integration Engineer
IndsafriChennai, IN Senior Data Integration Engineer.We are seeking a highly experienced and strategic Senior Data Integration Engineer to architect, build, and manage the data pipelines that power our customer intell...Show moreLast updated: 18 days ago
- Promoted
Lead, Data Engineering
Standard Chartered BankChennai, Tamil Nadu, India This job is with Standard Chartered Bank, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community.
Please do not contact the recruiter directly....Show moreLast updated: 5 days ago
- Promoted
Engineering Manager - Data & Platform
DFCS TechnologiesChennai The Role : We're seeking an Engineering Manager for Data & Platform who thrives at the intersection of real-time data architecture and people leadership.Repo...Show moreLast updated: 30+ days ago
- Promoted
Tech Lead - Data Engineering
DHI SolutionsChennai Tech Lead - GCP Data Engineering Experience : 9+ Years Responsibilities : &l...Show moreLast updated: 11 days ago
- Promoted
Data Engineering
EXLChennai, Tamil Nadu, India Work with stakeholders to understand the data requirements to design, develop, and maintain complex ETL processes.Create the data integration and data diagram documentation.Lead the data validation...Show moreLast updated: 30+ days ago
- Promoted
Engineering Lead - Cloud & Data Engineering
Nazztec Private LimitedChennai Job Title : Engineering Lead Cloud & Data Engineer Work Base Location : Chennai / Hyderabad / Pune Experience Ra...Show moreLast updated: 30+ days ago
- Promoted
3i Infotech - Matillion Developer - ETL & Data Pipeline
3i Infotech LimitedChennai Position : Matillion Developer Banking Domain (Snowflake) Type : Full-Time Experience : 6+ years ...Show moreLast updated: 24 days ago
- Promoted
Developer - Data Engineering & Cloud Analytics
Geakminds Technologies Private LimitedChennai Developer - Data Engineering & Cloud Analytics.Role Overview : Responsible for building, maintaining, and optimizing large-scale data pipelines and analytics solutions lev...Show moreLast updated: 19 days ago
- Promoted
Data Architect - ETL / DataLake
HexaCorpChennai We are looking for a highly skilled Data Architect with expertise in Azure, AWS, and AI to design and deliver scalable, secure, and AI-driven data architectures for enterprise customers.Key Respons...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer - Data Build Tool & Snowflake DB
ResourcetreeChennai Job Description : We are looking for a skilled and experienced DBT-Snowflake Developer to join our team! As part of the team, you will be involved in the implementation of the ongoing and...Show moreLast updated: 30+ days ago
- Promoted
Publicis Sapient - Data Engineering Manager / Architect
Publicis SapientChennai Manager Data Engineer As Manager, Data Engineering, you will be responsible for translating client requirements into design, architecting, and implementing GCP / Azure ...Show moreLast updated: 30+ days ago
- Promoted
Lead Analyst - AI Engineering
Peak Hire SolutionsChennai Description : Required skills / Competencies : - Programming Languages - Strong in Python, data structures,...Show moreLast updated: 6 days ago
- Promoted
Data Engineering Manager - ETL Tools
Cloud DestinationsChennai Description : Company Overview : Cloud Destinations is a Silicon Valley-headquartered, well-established techno...Show moreLast updated: 17 days ago
- Promoted
3 Days Left! Senior Analyst - Data Science
Infosys FinacleChennai, Tamil Nadu, India Job Description : Data Scientist AI / RPA - Hands on experience in applying statistical methods, ML algorithms to large data sets for deriving insights / predictions using python / R packages.Looking ...Show moreLast updated: 25 days ago
- Promoted
AI / ML & Data Engineer
Mindfire SolutionsChennai, IN We are looking for an experienced AI / ML & Data Engineer to design, develop, and deploy scalable machine learning models and data infrastructure on AWS.
You will work closely with cross-functional te...Show moreLast updated: 10 days ago
- Promoted
Lead Data Engineer
JMAN GroupChennai, Tamil Nadu, India JMAN Group is a fast-growing data engineering & data science consultancy.We work primarily with Private Equity Funds and their Portfolio Companies to create commercial value using Data & Artificial...Show moreLast updated: 3 days ago
- Promoted
Data Engineer
VAANTECHChennai, Tamil Nadu, India Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning.
Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 30+ days ago