Talent.com
Consultant-Pyspark

Consultant-Pyspark

ConfidentialIndia, Pune
11 hours ago
Job description

Summary

Position Summary

Artificial Intelligence & Engineering

AI & Engineering leverages cutting-edge engineering capabilities to help build, deploy, and operate integrated / verticalized sector solutions in software, data, AI, network, and hybrid cloud infrastructure. These solutions insights are powered by engineering for business advantage, helping transforming mission-critical operations.

Join our AI & Engineering team to help in transforming technology platforms, driving innovation, and helping help make a significant impact on our clients' success achievements. You'll work alongside talented professionals reimagining and re-engineering operations and processes that are could be critical to businesses.

Position Summary

Level : Consultant

As an experienced Consultant at Deloitte Consulting, you will be responsible for individually delivering high quality work products within due timelines. Need-basis you will be mentoring and / or directing junior team members / liaising with onsite / offshore teams to understand the functional requirements.

Work you'll do :

Apply industry knowledge to requirements gathering and analysis, ensuring alignment with sector needs. Demonstrate expertise across the entire software development lifecycle, from design and coding to deployment and defect resolution, collaborating with stakeholders for effective delivery. Conduct peer and team reviews to maintain quality standards. Actively engage in Agile practices, including sprint planning, retrospectives, and effort estimation. Build and share business process knowledge, supporting project knowledge management and team training. Proactively recommend process improvements, track efficiency gains, and contribute to automation and innovation, all aimed at enhancing project outcomes and delivering greater value to clients.

The team :

AI & Data offers a full spectrum of solutions for designing, developing, and operating cutting-edge Data and AI platforms, products, insights, and services. Our offering helps clients innovate, and enhance their data, AI, and analytics capabilities, ensuring they can mature and scale effectively.

AI & Data professionals will work with our clients to :

  • Design and modernize large-scale data and analytics platforms including data management, governance and the integration of structured and unstructured data to generate insights leveraging cloud, edge and AI / ML technologies, platforms and methodologies for storage, processing
  • Leverage automation, cognitive and AI based solutions to manage data, predict scenarios and prescribe actions
  • Drive operational efficiency by managing and upgrading their data ecosystems and application platforms, utilizing analytics expertise and providing As-a-Service models to ensure continuous insights and enhancements.

Qualifications

Must Have Skills / Project Experience / Certifications :

  • 3 - 6 years of hands-on experience in Apache Spark and Python programming experience.
  • Deep technical understanding of distributed computing and broader awareness of different Spark versions
  • Strong UNIX operating system concepts and shell scripting knowledge
  • Hands-on experience using Spark & Python
  • Deep experience in developing data processing tasks using PySpark such as reading data from external sources, merge data, perform data enrichment and load in to target data destinations.
  • Experience in deployment and operationalizing the code, knowledge of scheduling tools like Airflow, Control-M etc. is preferred
  • Working experience on AWS ecosystem, Google Cloud, BigQuery etc. is an added advantage Hands on experience with AWS S3 Filesystem operations
  • Good knowledge of Hadoop, Hive and Cloudera / Hortonworks Data Platform
  • Should have exposure with Jenkins or equivalent CICD tool & Git repository
  • Experience handling CDC operations for huge volume of data
  • Should understand and have operating experience with Agile delivery model
  • Should have experience in Spark related performance tuning
  • Should be well versed with understanding of design documents like HLD, TDD etc
  • Should be well versed with Data historical load and overall Framework concepts
  • Should have participated in different kinds of testing like Unit Testing, System Testing, User Acceptance Testing, etc
  • Good to Have Skills / Project Experience / Certifications :

  • Exposure to PySpark, Cloudera / Hortonworks, Hadoop and Hive.
  • Exposure to AWS S3 / EC2 and Apache Airflow
  • Participation in client interactions / meetings is desirable.
  • Participation in code-tuning is desirable.
  • Exposure to data migration from on-premise data warehouse to the Snowflake Cloud Platform.
  • Education : Location :

  • Bengaluru / Hyderabad / Pune / Chennai / Kolkata
  • Our purpose

    Deloitte's purpose is to make an impact that matters for our people, clients, and communities. At Deloitte, purpose is synonymous with how we work every day. It defines who we are. Our purpose comes through in our work with clients that enables impact and value in their organizations, as well as through our own investments, commitments, and actions across areas that help drive positive outcomes for our communities.

    Our people and culture

    Our inclusive culture empowers our people to be who they are, contribute their unique perspectives, and make a difference individually and collectively. It enables us to leverage different ideas and perspectives, and bring more creativity and innovation to help solve our clients' most complex challenges. This makes Deloitte one of the most rewarding places to work.

    Professional development

    At Deloitte, professionals have the opportunity to work with some of the best and discover what works best for them. Here, we prioritize professional growth, offering diverse learning and networking opportunities to help accelerate careers and enhance leadership skills. Our state-of-the-art DU : The Leadership Center in India, located in Hyderabad, represents a tangible symbol of our commitment to the holistic growth and development of our people. Explore DU : The Leadership Center in India .

    Benefits To Help You Thrive

    At Deloitte, we know that great people make a great organization. Our comprehensive rewards program helps us deliver a distinctly Deloitte experience that helps that empowers our professionals to thrive mentally, physically, and financially—and live their purpose. To support our professionals and their loved ones, we offer a broad range of benefits. Eligibility requirements may be based on role, tenure, type of employment and / or other criteria. Learn more about what working at Deloitte can mean for you.

    Recruiting tips

    From developing a stand out resume to putting your best foot forward in the interview, we want you to feel prepared and confident as you explore opportunities at Deloitte. Check out recruiting tips from Deloitte recruiters.

    Requisition code : 300028

    Skills Required

    Airflow, BigQuery, Hadoop, Hortonworks Data Platform, Pyspark, Apache Spark, Google Cloud, Jenkins, Git, Hive, Shell Scripting, Cloudera, Unix Operating System, Python

    Create a job alert for this search

    Consultant-Pyspark • India, Pune

    Related jobs
    • Promoted
    SAP RedWood Consultant

    SAP RedWood Consultant

    WiproPune, Maharashtra, India
    Title : SAP Redwood Developer Location : Pune, India (Hybrid) 3 days work from office mandatory Job time : Fulltime Responsibilities : Design, develop, and implement complex automated workflows and jo...Show moreLast updated: 30+ days ago
    • Promoted
    SAP PS Consultant

    SAP PS Consultant

    Growel Softech Pvt. Ltd.Pune
    Role : SAP PS Exp : 6 to 10 years Location : Bangalore, Mumbai, Pune Job Desc...Show moreLast updated: 28 days ago
    • Promoted
    Techno-Functional Consultant

    Techno-Functional Consultant

    Williams-Sonoma, Inc.Pune, India
    Job Description – Techno-Functional Consultant (Blue Yonder).Location - Pune / Hyderabad (Hybrid).We are looking for an experienced Techno-Functional Consultant with deep expertise in Blue Yonder (...Show moreLast updated: 2 days ago
    • Promoted
    • New!
    Solution Consultant

    Solution Consultant

    Palo Alto Networkspune, maharashtra, in
    At Palo Alto Networks® everything starts and ends with our mission : .Being the cybersecurity partner of choice, protecting our digital way of life. Our vision is a world where each day is safer and m...Show moreLast updated: 9 hours ago
    • Promoted
    Solutions Consultant

    Solutions Consultant

    Searce IncPune, Maharashtra, India
    Solutions Consulting | Lead Modern tech solutions advisory & 'futurify' consulting as a Searce lead fds (‘forward deployed solver’) with revenue accountability from net-new accounts & intelligent ...Show moreLast updated: 20 days ago
    • Promoted
    Oracle EBS APPS Technical Consultant

    Oracle EBS APPS Technical Consultant

    LTIMindtreePune, Maharashtra, India
    Job Skill : EBS Apps Tech Years of experience : 5+ Years Location : Pan India (LTIMindtree office).Oracle EBS APPS Technical Consultant. Must have worked in EBS support projects ability to analyze issu...Show moreLast updated: 30+ days ago
    • Promoted
    EPCMCS Sr. Consultant

    EPCMCS Sr. Consultant

    MatchPointpune, maharashtra, in
    Must have 5+ years’ experience in Oracle EPM Cloud, 3+ years' experience in Oracle EPCMCS.Specializes in Oracle EPM Groovy scripting. Nice to have good skill on EPM Automate.Good knowledge of financ...Show moreLast updated: 15 days ago
    • Promoted
    • New!
    Solution Consultant

    Solution Consultant

    Aerchainpune, maharashtra, in
    Solution Consultant – Enterprise SaaS.Bangalore – Work From Office (WFO).We are rewriting procurement with an AI-first platform already powering billions in enterprise spend and scaling rapidly.Joi...Show moreLast updated: 9 hours ago
    • Promoted
    Technical Consultant

    Technical Consultant

    Programmers.ioPune, Maharashtra, India
    Senior Microsoft D365 Techno-Functional Architect- FTE.PAN INDIA Remote, Work from Home.We are seeking a Microsoft Dynamics 365 Techno-Functional Architect with deep expertise across both Dynamics ...Show moreLast updated: 21 days ago
    • Promoted
    Biztalk Consultant

    Biztalk Consultant

    Head Hunter IndiaPune
    A Biztalk Developer is responsible for designing, developing and maintaining integration solutions using Microsoft Biztalk Server. They work closely with the business stakeholders, project managers,...Show moreLast updated: 30+ days ago
    • Promoted
    Workday Extend Consultant

    Workday Extend Consultant

    AgilysisPune, Maharashtra, India
    IT consulting firm providing advisory assistance, managed services, and staffing support exclusively in Workday.With our Workday Sales Referral Partner status, we can bring a steady flow of Workday...Show moreLast updated: 30+ days ago
    • Promoted
    Technical Consultant - Infor Process Automation

    Technical Consultant - Infor Process Automation

    Renovision Automation Services Pvt.Ltd.Pune
    We are seeking an experienced Technical Consultant - Infor Process Automation (IPA) to support the design, development, and deployment of automated workflows and integrations wit...Show moreLast updated: 23 days ago
    • Promoted
    Business and Technical Consultant

    Business and Technical Consultant

    AvaloqPune, Maharashtra, India
    This job is with Avaloq, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly.Company Descripti...Show moreLast updated: 9 days ago
    • Promoted
    SAP Basis Technical Consultant - Public cloud

    SAP Basis Technical Consultant - Public cloud

    SyntaxPune, IN
    Syntax is a leading Managed Cloud Provider for Mission Critical Enterprise Applications and has been providing comprehensive technology solutions to businesses of all sizes since 1972.Syntax has un...Show moreLast updated: 30+ days ago
    • Promoted
    SAP PI / PO Consultant (Integration Suite)

    SAP PI / PO Consultant (Integration Suite)

    Radiansys Inc.pune, maharashtra, in
    Role : SAP PI / PO Consultant (Integration Suite).Location : Bangalore / Pan India Wipro (Remote).Long-term Contract to Hire (C2H). Client is looking for a skilled Integration Suite Developer to support...Show moreLast updated: 13 days ago
    • Promoted
    Identity Management Consultant

    Identity Management Consultant

    Webologix Ltd / INCpune, maharashtra, in
    Job Position : IAM Engineer – SailPoint Focus.Mandatory Skills : JavaScript, Java Development, Data Encryption and Key Management, IAM - SailPoint IIQ,IDAM - Sailpoint Identity Now, Identity Governan...Show moreLast updated: 30+ days ago
    • Promoted
    Techno-Functional Consultant - Oracle EBS

    Techno-Functional Consultant - Oracle EBS

    Jade GlobalPune
    Description : Key Responsibilities : - Provide techno-functional support for Oracle EBS modules : AP, AR, GL, FA, PA, iExpense...Show moreLast updated: 30+ days ago
    • Promoted
    JDEdwards Technical Consultant / Lead - EnterpriseOne Implementation

    JDEdwards Technical Consultant / Lead - EnterpriseOne Implementation

    Information TechnologyPune
    Experience : At least 10 years IT experience with recent focus around J.Edwards EnterpriseOne (preferably 9.OMW, RDA, TDA, FDA, Visual Compare, FRW...Show moreLast updated: 30+ days ago