Talent.com
This job offer is not available in your country.
PySpark Data Engineer

PySpark Data Engineer

EXTRAGIGKottayam, IN
4 hours ago
Job description

๐Ÿš€ Contract Assistant โ€“ Data Engineer Support (Remote, EST Hours) ๐Ÿš€

๐Ÿ“… Start Date : Sept 10, 2025

โณ Duration : 6 months (extendable)

๐Ÿ’ฐ Pay : $1,000 / month

๐Ÿ•— Work Hours : 8 : 00 AM โ€“ 5 : 30 PM EST

Weโ€™re looking for a Contract Assistant to support a PySpark Data Engineer with daily activities. This is a remote contract role (not formal employment) .

What Youโ€™ll Do :

  • Execute creative software and data solutions, including design, development, and technical troubleshooting, by thinking beyond routine approaches to build solutions or break down technical problems.
  • Develop secure, high-quality production code and data pipelines, reviewing and debugging processes implemented by others.
  • Identify opportunities to eliminate or automate remediation of recurring issues to improve operational stability of software applications and systems.
  • Lead evaluation sessions with external vendors, startups, and internal teams to drive outcomes-oriented probing of architectural designs and technical credentials.
  • Work with business stakeholders to understand requirements and design appropriate solutions, producing architecture and design artifacts for complex applications.
  • Implement robust monitoring and alerting systems to proactively identify and address data ingestion issues, optimizing performance and throughput.
  • Implement data quality checks and validation processes to ensure accuracy and reliability of data.
  • Design and implement scalable data frameworks to manage end-to-end data pipelines for workforce data analytics.
  • Share and develop best practices with Platform and Architecture teams to improve data pipeline framework and modernize the workforce data analytics platform.
  • Gather, analyze, and synthesize large, diverse data sets to continuously improve capabilities and user experiences, leveraging data-driven insights.
  • Contribute to software engineering communities of practice and events that explore new and emerging technologies, fostering a culture of diversity, opportunity, inclusion, and respect.

What Youโ€™ll Need :

  • Ability to work alongside me during US EST business hours.
  • 5+ years of applied experience in data engineering, including design, application development, testing, and operational stability.
  • Advanced proficiency in data processing frameworks and tools, including Parquet, Iceberg, PySpark, Glue, Lambda, Databricks, and AWS data services like EMR, Athena, and Redshift.
  • Proficiency in programming languages like Python, Java, or Scala for data processing and application development.
  • Proficiency in automation and continuous delivery methods, utilizing CI / CD pipelines with tools like Git / Bitbucket, Jenkins, or Spinnaker for automated deployment and version control.
  • Hands-on practical experience delivering system design, application development, testing, and operational stability, with advanced understanding of agile methodologies, application resiliency, and security.
  • Demonstrated proficiency in software applications and technical processes within technical disciplines like cloud, artificial intelligence, machine learning, and mobile.
  • In-depth knowledge of the financial services industry and their IT systems.
  • Proficiency in database management and data modeling, working with relational databases like Oracle or SQL Server. Skilled in writing SQL queries for efficient data management and retrieval, utilizing SQL tools such as DML for data handling, DDL for schema management, and PL / SQL for procedural extensions in Oracle databases.
  • Experience with scheduling tools like Autosys to automate and manage job scheduling for efficient workflow execution.
  • ๐Ÿ“Œ This role offers hands-on exposure to real-world BA activities, stakeholder engagement, and technology evaluation โ€” perfect for someone looking to strengthen their BA career while working remotely.

    ๐Ÿ“ง Interested? Send me a DM or comment below!

    #NowHiring #RemoteJobs #TechTalent #DataEngineer #HiringNow #WorkFromHome #TechOpportunities #JobAlert #PySpark #AWSData #Databricks #Glue #Lambda #EMR #Athena #Redshift #SQL #PLSQL #Python #Scala #Java #Automation #CICD #Jenkins #Bitbucket #DataPipelines #DataQuality #DataArchitecture

    Create a job alert for this search

    Data Engineer โ€ข Kottayam, IN

    Related jobs
    • Promoted
    Azure Databricks

    Azure Databricks

    Tata Consultancy ServicesKochi, Kerala, India
    TCS present an excellent opportunity for Azure Databricks.Experience required : 7-10 Yrs.Hands-on experience of developing and operating ETL / ELT pipelines with Azure Data Factory, Azure Databricks ...Show moreLast updated: 18 days ago
    Senior Data Engineer / Data Engineer

    Senior Data Engineer / Data Engineer

    InvokhrKochi, Kerala, India
    Quick Apply
    LOOKING FOR IMMEDIATE JOINERS OR 15 DAYS NOTICE PERIODS AND THIS IS WORK FROM HOME OPPORTUNITY.Position : Senior Data Engineer / Data Engineer. You will act as a key member of the Data consulting tea...Show moreLast updated: 30+ days ago
    • Promoted
    Salesforce Data Cloud Architect

    Salesforce Data Cloud Architect

    RialtesKochi, IN
    Job Description : Salesforce Data Cloud Lead.Freelance / Contract - 6 months.We are looking for an experienced.This role requires deep knowledge of. Salesforce Data Cloud (formerly Customer Data Plat...Show moreLast updated: 30+ days ago
    • Promoted
    Data & AI Architect

    Data & AI Architect

    Delphi Consulting Middle EastKochi, IN
    Ready to embark on a journey where your growth is intertwined with our commitment to making a positive impact? Join the Delphi family - where Growth Meets Values. Interviews and onboarding are condu...Show moreLast updated: 30+ days ago
    • Promoted
    Databricks Engineer

    Databricks Engineer

    Tata Consultancy Servicesalappuzha, kerala, in
    Skills : Azure Databricks, Pyspark, ADLS, ADF.Responsibility of / Expectations from the Role : .Designing and building Databricks data pipelines is required. Experience in transforming the data using A...Show moreLast updated: 8 days ago
    • Promoted
    • New!
    SAP WM & EWM (Data Migration)

    SAP WM & EWM (Data Migration)

    brabersAlappuzha, IN
    The SAP EWM / WM Data Migration serves as the global focal point for warehouse-related data objects during migration projects. This role ensures accurate collection, validation, and migration of EWM / W...Show moreLast updated: 4 hours ago
    • Promoted
    • New!
    GCP Data Engineer

    GCP Data Engineer

    EXLKochi, IN
    Must Have- GCP Data Engineer with Banking / Finance Institutions Experience.Google Cloud Platform (GCP) Engineers.This solution will integrate data from diverse sources including.SAS systems, Excel ...Show moreLast updated: 4 hours ago
    • Promoted
    The Sourcing Team - Big Data Developer - Hadoop / Hive

    The Sourcing Team - Big Data Developer - Hadoop / Hive

    The Sourcing Team Pvt LtdKochi
    Role : Big Data Developer Job Description : - Strong experience with big data technologies and associated tools such as Hadoop, Unix, HDFS, Hive, Impala, ...Show moreLast updated: 30+ days ago
    • Promoted
    Highly Skilled Data Engineer Wanted

    Highly Skilled Data Engineer Wanted

    beBeeDataEngineeringAlappuzha, Kerala, India
    Data engineers design, develop and maintain robust data platforms for internal and external stakeholders.Designing data infrastructure to support business needs. Improving data pipelines for better ...Show moreLast updated: 1 day ago
    • Promoted
    Data Architecture Specialist

    Data Architecture Specialist

    beBeeBackendKottayam, Kerala, India
    We're investing in cutting-edge technology to drive innovation and deliver strategic products that enhance our customers' growth and transformation agendas. Design, develop, and maintain scalable da...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Senior Machine Learning Engineer

    Senior Machine Learning Engineer

    IntellifAI Labs IncKottayam, IN
    At IntellifAI Labs, we are at the forefront of innovation, developing proprietary state-of-the-art industry leading machine learning applications that span a wide range of areas in machine learning...Show moreLast updated: 4 hours ago
    • Promoted
    Power BI Developer-Snowflakes Specialist

    Power BI Developer-Snowflakes Specialist

    IT Company in UAEKottayam, Kerala, India
    Leading International Recruitment Service provider for more than 30 Years across the globe.We have an opening for a Power BI Developer- Reporting, Dashboard Development, Microsoft Fabric & Snowflak...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    LLM - Python for Machine Learning - 2+

    LLM - Python for Machine Learning - 2+

    Jupiter AI LabsKochi, IN
    We are seeking skilled and experienced ML Developers to join our innovative team.The ideal candidate will have strong hands-on ML experience with the ability to understand complex data models and t...Show moreLast updated: 4 hours ago
    • Promoted
    Machine Learning Engineer

    Machine Learning Engineer

    Branch InternationalAlappuzha, IN
    Branch delivers world-class financial services to the mobile generation.With offices in the United States, Nigeria, Kenya, and India, Branch is a for-profit socially conscious company that uses the...Show moreLast updated: 30+ days ago
    • Promoted
    Data / ML Engineer

    Data / ML Engineer

    GleantapKochi, IN
    Gleantap is a customer engagement platform powering fitness, wellness, and service businesses.Python (scikit-learn, LightGBM, XGBoost). Set up retraining and monitoring pipelines (Airflow, MLflow, o...Show moreLast updated: 30+ days ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    TEKsystemsKochi, IN
    We are actively hiring for Skilled GCP Data Engineers for a global banking client.Years of experience : 4+ years (relevant). Looking for immediate joiners โ€ข โ€ข.Onboard new data sources - negotiate, agre...Show moreLast updated: 22 days ago
    • Promoted
    Machine Learning Engineer

    Machine Learning Engineer

    LaurenAlappuzha, IN
    Develop prompt engineering strategies.Specify ML methodologies for demo scenarios.Implement AI / ML components where applicable. Optimize model performance for demo environments.Expertise in prompt en...Show moreLast updated: 10 days ago
    • Promoted
    • New!
    Associate Machine Learning Architect

    Associate Machine Learning Architect

    goMLKochi, IN
    Architect the Future of AI with goML.Generative AI, AI / ML solutions.AI research and real-world enterprise adoption.AI seamlessly across operations. AWS, Generative AI, and ML system design.In this r...Show moreLast updated: 4 hours ago
    • Promoted
    GCP Big Data Engineer

    GCP Big Data Engineer

    Talentmaticsernakulam, kerala, in
    The ideal candidate will bring strong leadership capabilities, technical depth, and a proven track record of delivering end-to-end big data solutions in cloud environments.Lead and mentor teams in ...Show moreLast updated: 20 days ago
    • Promoted
    Senior Machine Learning Engineer

    Senior Machine Learning Engineer

    Elife TransferAlappuzha, IN
    A fast-growing start-up headquartered in San Francisco, CA, USA in the heart of Silicon Valley.We recruit worldwide as our customer base is global. Reliable ground transportation provider, any type ...Show moreLast updated: 30+ days ago