Data Engineering - GcpEXL • Avadi, Thiruvallur (district), India
No longer accepting applications
Data Engineering - Gcp
EXL • Avadi, Thiruvallur (district), India
12 hours ago
Job descriptionStrong knowledge on Python and Pyspark Expectation is to have ability to write Pyspark scripts for developing data workflows. Strong knowledge on SQL, Hadoop, Hive, Azure, Databricks and Greenplum Expectation is to write SQL to query metadata and tables from different data management system such as, Oracle, Hive, Databricks and Greenplum. Familiarity with big data technologies like Hadoop, Spark, and distributed computing frameworks. Expectation is to use Hue and run Hive SQL queries, schedule Apache Oozie jobs to automate the data workflows. Good working experience of communicating with the stakeholders and collaborate effectively with the business team for data testing. Expectation is to have strong problem-solving and troubleshooting skills. Expectation is to establish comprehensive data quality test cases, procedures and implement automated data validation processes. Degree in Data Science, Statistics, Computer Science or other related fields or an equivalent combination of education and experience. 3-7 years of experience in Data Engineer. Proficiency in programming languages commonly used in data engineering, such as Python, Pyspark, SQL. Experience in GCP computing platform, such as developing ETL processes Strong communication, problem solving and analytical skills with the ability to do time management and multi-tasking with attention to detail and accuracy.
Responsibilities :
- Work with stakeholders to understand the data requirements to design, develop, and maintain complex ETL processes.
- Create the data integration and data diagram documentation.
- Lead the data validation, UAT and regression test for new data asset creation.
- Create and maintain data models, including schema design and optimization.
- Create and manage data pipelines that automate the flow of data, ensuring data quality and consistency.
Qualifications and Skills :
Create a job alert for this search
Data Engineering • Avadi, Thiruvallur (district), India
Related jobs
Senior Data Engineer
LTIMindtree • Avadi, Thiruvallur (district), India
LTIMindtree is hiring for below positions and conducting only F2F-Inperson Drive in Chennai / Kolkata locations on 08th-Nov-2025(Saturday).
Open Positions for Chennai / Kolkata based-(5+ to 12 Years onl...Show more
Last updated: 30+ days ago • Promoted
Senior Dbt (Data Build Tool) Engineer
Ascendion • Avadi, Thiruvallur (district), India
Job Description : Senior DBT Engineer (8–12 Years).Senior Data Engineer with strong ELT experience.Focus on building scalable, efficient, and well-governed DBT data models on modern cloud platforms.Show more
Last updated: 12 hours ago • Promoted • New!
L2 Support Azure / Databricks
Randstad Digital • Ambattur, Thiruvallur (district), India
Job Role : L2 Support Azure / Databricks.Functioning as an Application Support for the new Cloud platform at one of the corporate investment bank.
Support the applications hosted on Azure / Databricks an...Show more
Last updated: 2 hours ago • Promoted • New!
Technical Lead
UNCIA • Avadi, Thiruvallur (district), India
We’re looking for a passionate Technology Lead / Engineering Manager to join our growing team and help build enterprise-grade banking products using.
NET Core, Angular, and a modern microservices ar...Show more
Last updated: 12 hours ago • Promoted • New!
Engineering Manager
Hyatt Regency Chennai • Avadi, Thiruvallur (district), India
Lead, mentor, and develop a team of hardware, electrical, and / or mechanical engineers.Support career growth through regular 1 : 1s, performance reviews, and skills development.Foster a collaborative,...Show more
Last updated: 2 hours ago • Promoted • New!
Data Scientist
Infosys Finacle • Ambattur, Thiruvallur (district), India
Minimum 4+years of Experience required.Excellent analytical and problem-solving skills.Experience using statistical computer languages (Python, SLQ, etc.
Knowledge of advanced statistical techniques...Show more
Last updated: 12 hours ago • Promoted • New!
Data Engineering - Gcp
EXL • Avadi, Tamil Nadu, India
Responsibilities : Work with stakeholders to understand the data requirements to design, develop, and maintain complex ETL processes.
Create the data integration and data diagram documentation.Le...Show more
Last updated: 1 day ago • Promoted
Data Science Engineer
Populus Empowerment Network • Ambattur, Thiruvallur (district), India
Develop and maintain backend systems for data processing and analytics.Implement and optimize machine learning models for OCR and NLP applications.
Leverage Python and related frameworks to process ...Show more
Last updated: 2 hours ago • Promoted • New!
Senior Data Engineer
Eucloid Data Solutions • Avadi, Thiruvallur (district), India
Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure for our cli...Show more
Last updated: 2 hours ago • Promoted • New!
Technical Lead - Control & Protection Engineering
Schneider Electric • Ambattur, Thiruvallur (district), India
At Schneider Electric, we are hiring for Technical Lead - Control & Protection Engineering position @ Chennai / Bengaluru location.
If you are an experienced Electrical Engineer passionate about power...Show more
Last updated: 2 hours ago • Promoted • New!
Integration Engineer
Bahwan CyberTek • Ambattur, Thiruvallur (district), India
Mid-Level Integration Engineer.Support, maintain, and enhance existing Java Spring Boot microservices in a distributed environment.
Design, develop, and implement ETL processes using tools like Info...Show more
Last updated: 2 hours ago • Promoted • New!
Databricks Lead
Mastech Digital • Avadi, Thiruvallur (district), India
Immediate joiner / Serving notice with less than 60 days / Notice is less than 60 days.We are looking for a highly skilled.
The ideal candidate will lead teams in designing, building, and optimizing sc...Show more
Last updated: 2 hours ago • Promoted • New!
Gcp Data Engineer(Only Immediate)
R Systems • Ambattur, Tamil Nadu, India
About the role–- As a Software Engineer II - Data, you will contribute to the design and development of data systems including pipelines, APIs, analytics, AI and machine learning at scale.You'll ...Show more
Last updated: 1 day ago • Promoted
Data Analyst
Themesoft Inc. • Ambattur, Thiruvallur (district), India
Gather, analyze, and document business requirements for technical, pharma-focused projects.Develop capability maps to align business needs with IT solutions.
Collaborate with cross-functional teams,...Show more
Last updated: 2 hours ago • Promoted • New!
Data Engineer
Movate • Avadi, Thiruvallur (district), India
Location : Chennai / Bangalore / .Develop data mapping specifications and transformation rules.Perform data cleansing, validation, and reconciliation activities.
Create and execute data conversion scr...Show more
Last updated: 2 hours ago • Promoted • New!
Gcp Data Engineer
Intellistaff Services Pvt. Ltd • Avadi, Thiruvallur (district), India
Data Engineer with Python and GCP.Airflow / Astronomer / Cloud Composer (2+ Year).Tekton pipeline / CI-CD Pipeline.Strong all-round communication skills (written / presentation, one-to-one / group) & Exc...Show more
Last updated: 2 hours ago • Promoted • New!
Data Science Manager
Live Connections • Ambattur, Thiruvallur (district), India
Required Notice Period - Immediate Joiners or Servving Notice or max up to 60 days.Job Description / Responsibilities.We are seeking someone who has in depth understanding of both the business and ...Show more
Last updated: 2 hours ago • Promoted • New!
Technical Architect - Data & Ai
HCLTech • Ambattur, Thiruvallur (district), India
Meet regularly with other team members to discuss progress and find.Generate progress reports for clients and senior leaders.
Manage organizational deliverables by using.Required skills and qualific...Show more
Last updated: 2 hours ago • Promoted • New!