Data Engineer

Description

Key Responsibilities :

• Productionize pipelines for large, complex data sets which meet technical and business requirements.
• Partner with data asset managers, architects, and development leads to ensure a sound technical solution.
• Follow, and contribute to, coding standards and best practices to ensure pipelines and components are efficient, robust, cost effective and reusable.
• Identify, design, and implement internal process improvements.
• Optimize Spark jobs for performance and cost. Tune configurations, minimize shuffles, and leverage advanced techniques like broadcast joins, caching, and partitioning.
• Ensure data quality, reliability, and performance by implementing best practices for data validation, monitoring, and optimization.
• Monitor and troubleshoot data pipelines and workflows to ensure seamless operation.
• Stay updated on the latest Databricks features, tools, and industry trends to continuously improve data engineering practices.
• Strong understanding of distributed computing concepts and big data processing.
• Excellent problem-solving skills and the ability to work collaboratively in a team environment.

Job Qualifications

About us

We produce globally recognized brands and we grow the best business leaders in the industry. With a portfolio of trusted brands as diverse as ours, it is paramount our leaders are able to lead with courage the vast array of brands, categories and functions. We serve consumers around the world with one of the strongest portfolios of trusted, quality, leadership brands, including Always®, Ariel®, Gillette®, Head & Shoulders®, Herbal Essences®, Oral-B®, Pampers®, Pantene®, Tampax® and more. Our community includes operations in approximately 70 countries worldwide. Visit to know more.

We are an equal opportunity employer and value diversity at our company. We do not discriminate against individuals on the basis of race, color, gender, age, national origin, religion, sexual orientation, gender identity or expression, marital status, citizenship, disability, HIV / AIDS status, or any other legally protected factor.

"At P&G, the hiring journey is personalized every step of the way, thereby ensuring equal opportunities for all, with a strong foundation of Ethics & Corporate Responsibility guiding everything we do.

All the available job opportunities are posted either on our website - pgcareers.com, or on our official social media pages, for the convenience of prospective candidates, and do not require them to pay any kind of fees towards their application.”

Job Schedule

Full time

Job Number

Job Segmentation

Experienced Professionals