Talent.com
Senior Consultant-Pyspark

Senior Consultant-Pyspark

ConfidentialChennai, India
8 days ago
Job description

Summary

Position Summary

Artificial Intelligence & Engineering

AI & Engineering leverages cutting-edge engineering capabilities to help build, deploy, and operate integrated / verticalized sector solutions in software, data, AI, network, and hybrid cloud infrastructure. These solutions insights are powered by engineering for business advantage, helping transforming mission-critical operations.

Join our AI & Engineering team to help in transforming technology platforms, driving innovation, and helping help make a significant impact on our clients' success achievements. You'll work alongside talented professionals reimagining and re-engineering operations and processes that are could be critical to businesses.

Position Summary

Level : SeniorConsultant

As a Senior Consultant at Deloitte Consulting, you will design, develop, and deploy enterprise-scale software solutions, lead the creation of robust pipelines and manage code deployment across environments. You will collaborate with cross-functional, global teams to translate functional requirements into effective deliverables, independently guiding and mentoring junior team members. Your role spans the full project lifecycle, including estimation, planning, execution, and tracking key metrics for analysis, ensuring high-quality and timely delivery of solutions.

Work you'll do :

Lead discussions with business and functional analysts to understand requirements and assess integration impacts on business architecture. Prepare technical architecture and design, clarify requirements, and resolve ambiguities. Develop solutions in line with established technical designs, integration standards, and quality processes. Create and enforce technical design and development guides, templates, and standards. Facilitate daily scrum meetings, manage deliverables, and prepare weekly status reports for leadership review. Conduct detailed deliverable reviews and provide technical guidance to team members. Collaborate with onsite clients, coordinators, analysts, and cross-functional teams. Design templates or scripts to automate routine development or operational tasks.

The team :

AI & Data offers a full spectrum of solutions for designing, developing, and operating cutting-edge Data and AI platforms, products, insights, and services. Our offering helps clients innovate, and enhance their data, AI, and analytics capabilities, ensuring they can mature and scale effectively.

AI & Data professionals will work with our clients to :

  • Design and modernize large-scale data and analytics platforms including data management, governance and the integration of structured and unstructured data to generate insights leveraging cloud, edge and AI / ML technologies, platforms and methodologies for storage, processing
  • Leverage automation, cognitive and AI based solutions to manage data, predict scenarios and prescribe actions
  • Drive operational efficiency by managing and upgrading their data ecosystems and application platforms, utilizing analytics expertise and providing As-a-Service models to ensure continuous insights and enhancements.

Qualifications

Must Have Skills / Project Experience / Certifications :

  • 6 - 10 years of hands-on experience in Apache Spark and Python programming
  • Deep technical understanding of distributed computing and broader awareness of different Spark versions
  • Strong UNIX operating system concepts and shell scripting knowledge
  • Hands-on experience using Spark & Python
  • Deep experience in developing data processing tasks using PySpark such as reading data from external sources, merging data, performing data enrichment and loading in to target data destinations.
  • Experience in deployment and operationalizing the code, knowledge of scheduling tools like Airflow, Control-M etc. is preferred
  • Working experience on AWS ecosystem, Google Cloud, BigQuery etc. is an added advantage
  • Hands on experience with AWS S3 Filesystem operations
  • Good knowledge of Hadoop, Hive and Cloudera / Hortonworks Data Platform
  • Should have exposure with Jenkins or equivalent CICD tool & Git repository
  • Experience handling CDC operations with a huge volume of data
  • Should understand and have operating experience with Agile delivery model
  • Should have experience in Spark related performance tuning
  • Should be well versed with understanding of design documents like HLD, TDD etc
  • Should be well versed with Data historical load and overall Framework concepts
  • Should have participated in different kinds of testing like Unit Testing, System Testing, User Acceptance Testing, etc
  • Good to Have Skills / Project Experience / Certifications :

  • Exposure to PySpark, Cloudera / Hortonworks, Hadoop and Hive.
  • Exposure to AWS S3 / EC2 and Apache Airflow
  • Participation in client interactions / meetings is desirable.
  • Participation in code-tuning is desirable.
  • Exposure to data migration from on-premise data warehouse to the Snowflake Cloud Platform.
  • Education :

  • BE / B.Tech / M.C.A. / M.Sc (CS) degree or equivalent from accredited university
  • Location :

  • Bengaluru / Hyderabad / Pune / Chennai / Kolkata
  • Our purpose

    Deloitte's purpose is to make an impact that matters for our people, clients, and communities. At Deloitte, purpose is synonymous with how we work every day. It defines who we are. Our purpose comes through in our work with clients that enables impact and value in their organizations, as well as through our own investments, commitments, and actions across areas that help drive positive outcomes for our communities.

    Our people and culture

    Our inclusive culture empowers our people to be who they are, contribute their unique perspectives, and make a difference individually and collectively. It enables us to leverage different ideas and perspectives, and bring more creativity and innovation to help solve our clients' most complex challenges. This makes Deloitte one of the most rewarding places to work.

    Professional development

    At Deloitte, professionals have the opportunity to work with some of the best and discover what works best for them. Here, we prioritize professional growth, offering diverse learning and networking opportunities to help accelerate careers and enhance leadership skills. Our state-of-the-art DU : The Leadership Center in India, located in Hyderabad, represents a tangible symbol of our commitment to the holistic growth and development of our people. Explore DU : The Leadership Center in India .

    Benefits To Help You Thrive

    At Deloitte, we know that great people make a great organization. Our comprehensive rewards program helps us deliver a distinctly Deloitte experience that helps that empowers our professionals to thrive mentally, physically, and financially—and live their purpose. To support our professionals and their loved ones, we offer a broad range of benefits. Eligibility requirements may be based on role, tenure, type of employment and / or other criteria. Learn more about what working at Deloitte can mean for you.

    Recruiting tips

    From developing a stand out resume to putting your best foot forward in the interview, we want you to feel prepared and confident as you explore opportunities at Deloitte. Check out recruiting tips from Deloitte recruiters.

    Requisition code : 300041

    Skills Required

    Airflow, BigQuery, Data Migration, Hadoop, Pyspark, Apache Spark, Google Cloud, Jenkins, Git, Hive, Shell Scripting, Unix Operating System, Python, Aws S3

    Create a job alert for this search

    Senior • Chennai, India

    Related jobs
    • Promoted
    Senior SAP Ariba Consultant ( Upstream )

    Senior SAP Ariba Consultant ( Upstream )

    S2IntegratorsChennai, IN
    We are looking for a highly skilled.The ideal candidate should have hands-on experience in.Sourcing, Contracts, Supplier Management (SIPM), and Ariba integration. Lead end-to-end implementation and ...Show moreLast updated: 5 days ago
    • Promoted
    Senior SAP CCM Consultant

    Senior SAP CCM Consultant

    MRP-GlobalChennai, IN
    Senior SAP CCM Consultant - 12-month initial contract - Immediate start - Excellent rates.We are partnered with a leading brand who are looking for a Senior SAP CCM Consultant with extensive experi...Show moreLast updated: 15 days ago
    • Promoted
    Senior Consultant

    Senior Consultant

    ProgliteChennai, IN
    We are seeking a motivated and skilled.Network / Cloud / Security Engineer.AWS, Google Cloud Platform (GCP), Cisco Meraki, and Palo Alto firewalls. The ideal candidate will be responsible for design...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Consultant

    Senior Consultant

    EmergysChennai, Tamil Nadu, India
    Hands-on experience in SAP PP-DS, MM, PPDS, PPQM configuration and support.Strong understanding of capacity planning, finite scheduling, and order sequencing. Experience with CIF integration between...Show moreLast updated: 15 hours ago
    • Promoted
    Senior Consultant

    Senior Consultant

    ConfidentialChennai, India
    PLM (Product Lifecycle Management).Danfoss Group Digital & IT team.This role is pivotal in supporting and enhancing our existing Siemens Teamcenter PLM systems and driving the success of our OnePLM...Show moreLast updated: 19 days ago
    • Promoted
    Senior Consultant

    Senior Consultant

    HCL TechnologiesChennai, Tamil Nadu, India
    HCLTech is a global technology company spread across 60 countries delivering industry-leading capabilities centered around digital engineering cloud and AI powered by a broad portfolio of technolog...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Consultant - CPI

    Senior Consultant - CPI

    valanticChennai, IN
    We are looking for an experienced.SAP Cloud Platform Integration (CPI).This role requires a deep understanding of APIs, system connectivity, and modern integration practices.Design, build, and deli...Show moreLast updated: 14 days ago
    • Promoted
    Senior Consultant

    Senior Consultant

    ValorantChennai, IN
    Valorant is a fast-growing consulting firm at the intersection of procurement and AI.We help global clients — across private equity, technology, life sciences, financial services, industrials, and ...Show moreLast updated: 30+ days ago
    • Promoted
    Kissflow - Principal Solution Consultant

    Kissflow - Principal Solution Consultant

    KissflowChennai
    Have you dreamt of working in a Product based company? Heres an opportunity for you! Kissflow is the leader in no-code citizen development and a strong player in low-code appl...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Consultant - TAS

    Senior Consultant - TAS

    ConfidentialChennai, India
    Transaction Advisory Services – Financial due diligence The Transaction Advisory Services team, part of Cohn Reznick Professional Services' Advisory ('CRPS Advisory'), manage and supports buy-side ...Show moreLast updated: 19 days ago
    • Promoted
    Senior Consultant, ERP Authorizations

    Senior Consultant, ERP Authorizations

    ConfidentialChennai, India
    Senior Consultant, ERP Authorizations.Danfoss Group IT, your expertise will be critical in driving secure and efficient utilization of our SAP systems. This role combines your substantial experience...Show moreLast updated: 19 days ago
    • Promoted
    Senior Consultant - Digital Manufacturing - Cloud

    Senior Consultant - Digital Manufacturing - Cloud

    Master Search Consulting India Private LimitedChennai, India
    Description : Role Overview : We are seeking an accomplished Senior Consultant - Digital Manufacturing (Cloud) to lead advanced manufacturing trans...Show moreLast updated: 9 days ago
    • Promoted
    Cloud Kinetics - Presales Consultant

    Cloud Kinetics - Presales Consultant

    Cloud Kinetics Technology Solutions Private LimiteChennai
    Description : Join our dynamic team as a Senior Solutions Architect Pre-Sales, where you'll play a pivotal role in designing cloud-n...Show moreLast updated: 8 days ago
    • Promoted
    Senior SAP SRE Consultant

    Senior SAP SRE Consultant

    MAK Technologies LLCChennai, IN
    Distribution Effort : 5 / Days per week.SAP for Me is SAP's strategic customer portal, serving as a single, digital entry point for a customer's entire SAP relationship. It provides a personalized and ...Show moreLast updated: 13 days ago
    • Promoted
    • New!
    Senior SAP Consultant

    Senior SAP Consultant

    Potentiam Ltdchennai, India
    Potentiam helps SME companies build world-class offshore teams.Our model is our locations and your dedicated staff under your control. Potentiam have offices in Iasi in Romania, Bangalore and Cape T...Show moreLast updated: 14 hours ago
    • Promoted
    Senior Functional Consultant - Oracle SCM Module

    Senior Functional Consultant - Oracle SCM Module

    MNR SolutionsChennai
    Description : About the Role We are looking for a highly skilled Senior Functional Consultant Oracle SCM Fusion to joi...Show moreLast updated: 27 days ago