Talent.com
This job offer is not available in your country.
IN-Senior Associate_Databricks Engineer_Data & Analytics_Advisory_Mumbai

IN-Senior Associate_Databricks Engineer_Data & Analytics_Advisory_Mumbai

ConfidentialMumbai, India
8 days ago
Job description

Line of Service

Advisory

Industry / Sector

Not Applicable

Specialism

Data, Analytics & AI

Management Level

Senior Associate

Job Description & Summary

At PwC, our people in data and analytics focus on leveraging data to drive insights and make informed business decisions. They utilise advanced analytics techniques to help clients optimise their operations and achieve their strategic goals.

In business intelligence at PwC, you will focus on leveraging data and analytics to provide strategic insights and drive informed decision-making for clients. You will develop and implement innovative solutions to optimise business performance and enhance competitive advantage.

Job Description

  • Why PWC At PwC, you will be part of a vibrant community of solvers that leads with trust and creates distinctive outcomes for our clients and communities. This purpose-led and values-driven work, powered by technology in an environment that drives innovation, will enable you to make a tangible impact in the real world. We reward your contributions, support your wellbeing, and offer inclusive benefits, flexibility programmes and mentorship that will help you thrive in work and life. Together, we grow, learn, care, collaborate, and create a future of infinite experiences for each other. Learn more about us .

At PwC, we believe in providing equal employment opportunities, without any discrimination on the grounds of gender, ethnic background, age, disability, marital status, sexual orientation, pregnancy, gender identity or expression, religion or other beliefs, perceived differences and status protected by law. We strive to create an environment where each one of our people can bring their true selves and contribute to their personal growth and the firm's growth. To enable this, we have zero tolerance for any discrimination and harassment based on the above considerations. "

Job Description & Summary : We are seeking a highly skilled and experienced Big Data Architect cum Data Engineer to join our dynamic team. The ideal candidate should have a strong background in big data technologies, designing the solutions and hands-on expertise in PySpark, Databricks, SQL and Hyper scalars. This position requires significant experience in building and managing data solutions in Databricks on Azure. The candidate should also have strong communication skills, experience in managing mid size teams, client conversations and presenting PoV and thought leadership.

Responsibilities :

3+ years' experience in DataBricks, including AI implementation, Strong in engineering and data operations. Candidate should be working more than 1 TB data (big volume data size )

  • Design and implement scalable big data architectures and solutions utilizing PySpark, SparkSQL, and Databricks on Azure or AWS.
  • Experience in building robust data models and maintain metadata-driven frameworks to optimize data processing and analytics.
  • Build, test, and deploy sophisticated ETL pipelines using Azure Data Factory and other Azure-based tools.
  • Ensure seamless data flow from various sources to destinations including ADLS Gen 2.
  • Implement data quality checks and validation frameworks.
  • Establish and enforce data governance principles ensuring data security and compliance with industry standards and regulations.
  • Manage version control and deployment pipelines using Git and DevOps best practices.
  • Provide accurate effort estimation and manage project timelines effectively.
  • Collaborate with cross-functional teams to ensure aligned project goals and objectives.
  • Strong industry knowledge in banking, insurance, oil & gas, retail, pharma, etc. to design tailor-made data solutions.
  • Stay updated with industry trends and innovations to proactively implement cutting-edge technologies and methodologies.
  • Facilitate discussions between technical and non-technical stakeholders to drive project success.
  • Document technical solutions and design specifications clearly and concisely. Problem-Solving : Creative thinker with strong problem-solving skills and attention to detail. Communication : Excellent communication skills, with the ability to explain complex concepts to non-technical stakeholders. Teamwork : Ability to work collaboratively in a fast-paced environment.

    • Mandatory skill sets :

  • 4+ years of experience in big data architecture and engineering.
  • Extensive experience with PySpark, SparkSQL, and Databricks on Azure.
  • Proficient in using Azure Data Lake Storage Gen 2, Azure Data Factory, Azure Event Hub, Synapse.
  • Strong experience in data modeling, metadata frameworks, and effort estimation.
  • Experience of DevSecOps practices with proficiency in Git.
  • Demonstrated experience in implementing data quality, data security, and data governance measures.
  • Excellent communication skills, capable of articulating complex technical concepts to diverse audiences.
  • Certification in Azure, Databricks or related Cloud technologies is a must.

    • Preferred skill sets :

  • Familiarity with machine learning frameworks and data science methodologies would be preferred.
  • Industry experience in banking, insurance, or pharma is a significant plus. telco, healthcare, oil & gas, manufacturing experiences will be preferred

    • Years of experience required :

    4 to 13 years

    Education qualification :

    Bachelor&aposs degree in computer science, Engineering, or a related field. Master's Degree preferred.

    Education (if blank, degree and / or field of study not specified)

    Degrees / Field of Study required : Bachelor of Engineering, Bachelor in Business Administration

    Degrees / Field of Study preferred :

    Certifications (if blank, certifications not specified)

    Required Skills

    Databricks Platform, Microsoft Azure, PySpark

    Optional Skills

    Accepting Feedback, Accepting Feedback, Active Listening, Analytical Thinking, Business Case Development, Business Data Analytics, Business Intelligence and Reporting Tools (BIRT), Business Intelligence Development Studio, Communication, Competitive Advantage, Continuous Process Improvement, Creativity, Data Analysis and Interpretation, Data Architecture, Database Management System (DBMS), Data Collection, Data Pipeline, Data Quality, Data Science, Data Visualization, Embracing Change, Emotional Regulation, Empathy, Inclusion, Industry Trend Analysis + 16 more

    Desired Languages (If blank, desired languages not specified)

    Travel Requirements

    Not Specified

    Available for Work Visa Sponsorship

    No

    Government Clearance Required

    No

    Job Posting End Date

    Show more

    Show less

    Skills Required

    Synapse, Git, Azure Data Factory, DevSecOps, Pyspark, Microsoft Azure, Databricks, Sparksql

    Create a job alert for this search

    IN-Senior Associate_Databricks Engineer_Data & Analytics_Advisory_Mumbai • Mumbai, India