Talent.com
This job offer is not available in your country.
PySpark Data Engineer

PySpark Data Engineer

EXTRAGIGPune, IN
20 hours ago
Job description

๐Ÿš€ Contract Assistant โ€“ Data Engineer Support (Remote, EST Hours) ๐Ÿš€

๐Ÿ“… Start Date : Sept 10, 2025

โณ Duration : 6 months (extendable)

๐Ÿ’ฐ Pay : $1,000 / month

๐Ÿ•— Work Hours : 8 : 00 AM โ€“ 5 : 30 PM EST

Weโ€™re looking for a Contract Assistant to support a PySpark Data Engineer with daily activities. This is a remote contract role (not formal employment) .

What Youโ€™ll Do :

  • Execute creative software and data solutions, including design, development, and technical troubleshooting, by thinking beyond routine approaches to build solutions or break down technical problems.
  • Develop secure, high-quality production code and data pipelines, reviewing and debugging processes implemented by others.
  • Identify opportunities to eliminate or automate remediation of recurring issues to improve operational stability of software applications and systems.
  • Lead evaluation sessions with external vendors, startups, and internal teams to drive outcomes-oriented probing of architectural designs and technical credentials.
  • Work with business stakeholders to understand requirements and design appropriate solutions, producing architecture and design artifacts for complex applications.
  • Implement robust monitoring and alerting systems to proactively identify and address data ingestion issues, optimizing performance and throughput.
  • Implement data quality checks and validation processes to ensure accuracy and reliability of data.
  • Design and implement scalable data frameworks to manage end-to-end data pipelines for workforce data analytics.
  • Share and develop best practices with Platform and Architecture teams to improve data pipeline framework and modernize the workforce data analytics platform.
  • Gather, analyze, and synthesize large, diverse data sets to continuously improve capabilities and user experiences, leveraging data-driven insights.
  • Contribute to software engineering communities of practice and events that explore new and emerging technologies, fostering a culture of diversity, opportunity, inclusion, and respect.

What Youโ€™ll Need :

  • Ability to work alongside me during US EST business hours.
  • 5+ years of applied experience in data engineering, including design, application development, testing, and operational stability.
  • Advanced proficiency in data processing frameworks and tools, including Parquet, Iceberg, PySpark, Glue, Lambda, Databricks, and AWS data services like EMR, Athena, and Redshift.
  • Proficiency in programming languages like Python, Java, or Scala for data processing and application development.
  • Proficiency in automation and continuous delivery methods, utilizing CI / CD pipelines with tools like Git / Bitbucket, Jenkins, or Spinnaker for automated deployment and version control.
  • Hands-on practical experience delivering system design, application development, testing, and operational stability, with advanced understanding of agile methodologies, application resiliency, and security.
  • Demonstrated proficiency in software applications and technical processes within technical disciplines like cloud, artificial intelligence, machine learning, and mobile.
  • In-depth knowledge of the financial services industry and their IT systems.
  • Proficiency in database management and data modeling, working with relational databases like Oracle or SQL Server. Skilled in writing SQL queries for efficient data management and retrieval, utilizing SQL tools such as DML for data handling, DDL for schema management, and PL / SQL for procedural extensions in Oracle databases.
  • Experience with scheduling tools like Autosys to automate and manage job scheduling for efficient workflow execution.
  • ๐Ÿ“Œ This role offers hands-on exposure to real-world BA activities, stakeholder engagement, and technology evaluation โ€” perfect for someone looking to strengthen their BA career while working remotely.

    ๐Ÿ“ง Interested? Send me a DM or comment below!

    #NowHiring #RemoteJobs #TechTalent #DataEngineer #HiringNow #WorkFromHome #TechOpportunities #JobAlert #PySpark #AWSData #Databricks #Glue #Lambda #EMR #Athena #Redshift #SQL #PLSQL #Python #Scala #Java #Automation #CICD #Jenkins #Bitbucket #DataPipelines #DataQuality #DataArchitecture

    Create a job alert for this search

    Data Engineer โ€ข Pune, IN

    Related jobs
    • Promoted
    Salesforce Data Cloud Developer

    Salesforce Data Cloud Developer

    KPMG IndiaPune, Maharashtra, India
    Location - Pune, Bangalore, Mumbai, Gurgaon.Proficiency in Salesforce Data Cloud features and architecture.Strong understanding of data modelling, data transformation, and ETL processes.Experience ...Show moreLast updated: 8 days ago
    • Promoted
    Data / ML Engineer

    Data / ML Engineer

    GleantapPune, Maharashtra, India
    Gleantap is a customer engagement platform powering fitness, wellness, and service businesses.We're evolving into an AI-native platform, where intelligent agents predict churn, upsell opportunities...Show moreLast updated: 1 day ago
    • Promoted
    Databricks Solution Architect

    Databricks Solution Architect

    InspireXTPune
    Description : About InspireXT : InspireXT is on a mission to build the most trusted supply chains in the world.Our Connected I...Show moreLast updated: 8 days ago
    • Promoted
    Big Data Engineer

    Big Data Engineer

    Information TechnologyPune
    Big Data Engineer Key Responsibilities : - Build and manage highly scalable Big Data pipelines for large structured datasets.C...Show moreLast updated: 21 days ago
    • Promoted
    Senior Big Data Engineer - PySpark / Scala

    Senior Big Data Engineer - PySpark / Scala

    Consulting PanditsPune
    Exciting Job Opportunity in Pune! Are you an experienced Senior Big Data Engineer with over 5 years of expertise? We have a fantastic opportunity waiting for you!<...Show moreLast updated: 30+ days ago
    • Promoted
    Qualys - Big Data Engineer / Lead

    Qualys - Big Data Engineer / Lead

    QUALYS SECURITY TECHSERVICES PRIVATE LIMITEDPune
    About the job : Come work at a place where innovation and teamwork come together to support the most exciting missions in the world! Job...Show moreLast updated: 30+ days ago
    • Promoted
    Databricks Engineer

    Databricks Engineer

    Tata Consultancy Servicespune, maharashtra, in
    Skills : Azure Databricks, Pyspark, ADLS, ADF.Responsibility of / Expectations from the Role : .Designing and building Databricks data pipelines is required. Experience in transforming the data using A...Show moreLast updated: 9 days ago
    • Promoted
    Python & Power BI Developer

    Python & Power BI Developer

    AllianzPune
    Python and PowerBI Developer We are seeking a talented and experienced Python and PowerBI Developer to join our Automation Chapter. The ideal candidate will have a min...Show moreLast updated: 30+ days ago
    • Promoted
    AI Lead - Python / Machine Learning

    AI Lead - Python / Machine Learning

    hashxpertPune
    Role Overview : We are seeking a visionary AI Lead to spearhead the design, development, and deployment of advanced AI / ML solutions in the domain of ...Show moreLast updated: 6 days ago
    • Promoted
    Big Data Engineer

    Big Data Engineer

    WorkiFicientPune
    To be successful in this role, you should possess : - Collaborate closely with Product Management and Engineering leadership to devise and...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Engineer

    Big Data Engineer

    LION AND ELEPHANTS CONSULTANCY PRIVATE LIMITEDPune
    Job Description : We are looking for skilled Big Data Engineers using Java Spark with 5-10 years of experience in Big Data / legacy platforms, who can join immediate...Show moreLast updated: 30+ days ago
    • Promoted
    Databricks Data Engineer

    Databricks Data Engineer

    AscendionPune, Maharashtra, India
    Job Title : Senior Data Engineer.Location : Gurgaon / Pune / Bangalore.Skills : PySpark, SQL, Databricks, AWS.The ideal candidates should have hands-on expertise in building. Databricks and AWS, along w...Show moreLast updated: 30+ days ago
    • Promoted
    GCP Big Data Engineer

    GCP Big Data Engineer

    Talentmaticspune, maharashtra, in
    The ideal candidate will bring strong leadership capabilities, technical depth, and a proven track record of delivering end-to-end big data solutions in cloud environments.Lead and mentor teams in ...Show moreLast updated: 20 days ago
    • Promoted
    Senior Salesforce Developer

    Senior Salesforce Developer

    EVERSANAPune / Pimpri-Chinchwad Area, India
    At EVERSANA, we are proud to be certified as a Great Place to Work across the globe.Weโ€™re fueled by our vision to create a healthier world. How? Our global team of more than 7,000 employees is commi...Show moreLast updated: 9 days ago
    • Promoted
    Big Data Engineer - Spark / Scala

    Big Data Engineer - Spark / Scala

    Leinex ConsultingPune
    Role & responsibilities : - Evaluate domain, financial and technical feasibility of solution ideas with help of all key stakeholders < / p&...Show moreLast updated: 22 days ago
    • Promoted
    Databricks Data Engineer

    Databricks Data Engineer

    Persistent SystemsPune, Maharashtra, India
    We are seeking a Databricks Data engineer with AWS experience.Role : Databricks Data Engineer.Location : All Persistent Location. Job Type : Full Time Employment.Must have knowledge and working experie...Show moreLast updated: 11 days ago
    • Promoted
    Lead Big Data Engineer - Spark

    Lead Big Data Engineer - Spark

    QUALYS SECURITY TECHSERVICES PRIVATE LIMITEDPune
    Come work at a place where innovation and teamwork come together to support the most exciting missions in the world!.Description : We are seeking a talented Lead Big ...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Associate Machine Learning Architect

    Associate Machine Learning Architect

    goMLPune, IN
    Architect the Future of AI with goML.Generative AI, AI / ML solutions.AI research and real-world enterprise adoption.AI seamlessly across operations. AWS, Generative AI, and ML system design.In this r...Show moreLast updated: 20 hours ago
    • Promoted
    NITOR - Senior ETL Developer - Python / SQL

    NITOR - Senior ETL Developer - Python / SQL

    Nitor Infotech Pvt. LtdPune
    Job Overview : We are seeking an ETL Developer with expertise in Advanced SQL, Python, and Shell Scripting.This full-time position reports to the Data Engineering M...Show moreLast updated: 30+ days ago
    • Promoted
    Qualys - Senior Big Data Engineer

    Qualys - Senior Big Data Engineer

    QUALYS SECURITY TECHSERVICES PRIVATE LIMITEDPune
    Description : We are seeking a talented Sr.Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Commun...Show moreLast updated: 30+ days ago