Talent.com
This job offer is not available in your country.
PySpark Data Engineer

PySpark Data Engineer

EXTRAGIGPalakkad, IN
23 hours ago
Job description

๐Ÿš€ Contract Assistant โ€“ Data Engineer Support (Remote, EST Hours) ๐Ÿš€

๐Ÿ“… Start Date : Sept 10, 2025

โณ Duration : 6 months (extendable)

๐Ÿ’ฐ Pay : $1,000 / month

๐Ÿ•— Work Hours : 8 : 00 AM โ€“ 5 : 30 PM EST

Weโ€™re looking for a Contract Assistant to support a PySpark Data Engineer with daily activities. This is a remote contract role (not formal employment) .

What Youโ€™ll Do :

  • Execute creative software and data solutions, including design, development, and technical troubleshooting, by thinking beyond routine approaches to build solutions or break down technical problems.
  • Develop secure, high-quality production code and data pipelines, reviewing and debugging processes implemented by others.
  • Identify opportunities to eliminate or automate remediation of recurring issues to improve operational stability of software applications and systems.
  • Lead evaluation sessions with external vendors, startups, and internal teams to drive outcomes-oriented probing of architectural designs and technical credentials.
  • Work with business stakeholders to understand requirements and design appropriate solutions, producing architecture and design artifacts for complex applications.
  • Implement robust monitoring and alerting systems to proactively identify and address data ingestion issues, optimizing performance and throughput.
  • Implement data quality checks and validation processes to ensure accuracy and reliability of data.
  • Design and implement scalable data frameworks to manage end-to-end data pipelines for workforce data analytics.
  • Share and develop best practices with Platform and Architecture teams to improve data pipeline framework and modernize the workforce data analytics platform.
  • Gather, analyze, and synthesize large, diverse data sets to continuously improve capabilities and user experiences, leveraging data-driven insights.
  • Contribute to software engineering communities of practice and events that explore new and emerging technologies, fostering a culture of diversity, opportunity, inclusion, and respect.

What Youโ€™ll Need :

  • Ability to work alongside me during US EST business hours.
  • 5+ years of applied experience in data engineering, including design, application development, testing, and operational stability.
  • Advanced proficiency in data processing frameworks and tools, including Parquet, Iceberg, PySpark, Glue, Lambda, Databricks, and AWS data services like EMR, Athena, and Redshift.
  • Proficiency in programming languages like Python, Java, or Scala for data processing and application development.
  • Proficiency in automation and continuous delivery methods, utilizing CI / CD pipelines with tools like Git / Bitbucket, Jenkins, or Spinnaker for automated deployment and version control.
  • Hands-on practical experience delivering system design, application development, testing, and operational stability, with advanced understanding of agile methodologies, application resiliency, and security.
  • Demonstrated proficiency in software applications and technical processes within technical disciplines like cloud, artificial intelligence, machine learning, and mobile.
  • In-depth knowledge of the financial services industry and their IT systems.
  • Proficiency in database management and data modeling, working with relational databases like Oracle or SQL Server. Skilled in writing SQL queries for efficient data management and retrieval, utilizing SQL tools such as DML for data handling, DDL for schema management, and PL / SQL for procedural extensions in Oracle databases.
  • Experience with scheduling tools like Autosys to automate and manage job scheduling for efficient workflow execution.
  • ๐Ÿ“Œ This role offers hands-on exposure to real-world BA activities, stakeholder engagement, and technology evaluation โ€” perfect for someone looking to strengthen their BA career while working remotely.

    ๐Ÿ“ง Interested? Send me a DM or comment below!

    #NowHiring #RemoteJobs #TechTalent #DataEngineer #HiringNow #WorkFromHome #TechOpportunities #JobAlert #PySpark #AWSData #Databricks #Glue #Lambda #EMR #Athena #Redshift #SQL #PLSQL #Python #Scala #Java #Automation #CICD #Jenkins #Bitbucket #DataPipelines #DataQuality #DataArchitecture

    Create a job alert for this search

    Data Engineer โ€ข Palakkad, IN

    Related jobs
    • Promoted
    Machine Learning Consultant

    Machine Learning Consultant

    Sony Research IndiaThrissur, IN
    Sony Research India is driving cutting-edge research and development in various locations around the globe, including laboratories in Japan, the United States, Europe, and Asia.We endeavor to creat...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Machine Learning Engineer

    Senior Machine Learning Engineer

    Impetusthrissur, kerala, in
    We are looking for an engineer with strong experience in building, deploying, and scaling chatbot solutions on AWS.The role involves working closely with product and engineering teams to design con...Show moreLast updated: 23 days ago
    • Promoted
    Machine Learning Engineer

    Machine Learning Engineer

    INSPYR Solutionscoimbatore, tamil nadu, in
    Remote (Night Shift โ€“ 10 PM to 7 AM CST).ML operations, pipelines, and production deployments.The ideal candidate will be hands-on, detail-oriented, and capable of working independently to ensure M...Show moreLast updated: 11 days ago
    • Promoted
    Associate Machine Learning Architect

    Associate Machine Learning Architect

    goMLThrissur, IN
    Architect the Future of AI with goML.Generative AI, AI / ML solutions.AI research and real-world enterprise adoption.AI seamlessly across operations. AWS, Generative AI, and ML system design.In this r...Show moreLast updated: 23 hours ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    EXLCoimbatore, IN
    Must Have- GCP Data Engineer with Banking / Finance Institutions Experience.Google Cloud Platform (GCP) Engineers.This solution will integrate data from diverse sources including.SAS systems, Excel ...Show moreLast updated: 23 hours ago
    • Promoted
    Machine Learning Engineer

    Machine Learning Engineer

    Philodesign Technologies Incthrissur, kerala, in
    Notice Period : Immediate Joiner โ€“ 15 days.We are looking for highly motivated and experienced Machine Learning Engineers to join our. The ideal candidates will have strong proficiency in building,.E...Show moreLast updated: 30+ days ago
    • Promoted
    Machine Learning Engineer

    Machine Learning Engineer

    RecroThrissur, IN
    We are looking for an experienced.Azure and AWS cloud ecosystems.The ideal candidate should bring a strong background in. GenAI tooling, automation, and CI / CD pipelines.Design, implement, and manage...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    AI Generalist

    AI Generalist

    CEECO INTERNATIONAL CONSULTANCYkerala, kerala, in
    CEECO International Consultancy is a trusted overseas education firm helping students secure admissions in top global universities, especially for MBBS and healthcare studies.Based in Kerala with a...Show moreLast updated: 21 hours ago
    • Promoted
    Salesforce Data Cloud Architect

    Salesforce Data Cloud Architect

    RialtesCoimbatore, IN
    Job Description : Salesforce Data Cloud Lead.Freelance / Contract - 6 months.We are looking for an experienced.This role requires deep knowledge of. Salesforce Data Cloud (formerly Customer Data Plat...Show moreLast updated: 30+ days ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    TEKsystemsThrissur, IN
    We are actively hiring for Skilled GCP Data Engineers for a global banking client.Years of experience : 4+ years (relevant). Looking for immediate joiners โ€ข โ€ข.Onboard new data sources - negotiate, agre...Show moreLast updated: 23 days ago
    • Promoted
    Senior Machine Learning Engineer

    Senior Machine Learning Engineer

    IntellifAI Labs IncPalakkad, IN
    At IntellifAI Labs, we are at the forefront of innovation, developing proprietary state-of-the-art industry leading machine learning applications that span a wide range of areas in machine learning...Show moreLast updated: 23 hours ago
    • Promoted
    Senior Machine Learning Engineer

    Senior Machine Learning Engineer

    Elife TransferCoimbatore, IN
    A fast-growing start-up headquartered in San Francisco, CA, USA in the heart of Silicon Valley.We recruit worldwide as our customer base is global. Reliable ground transportation provider, any type ...Show moreLast updated: 30+ days ago
    • Promoted
    Machine Learning Engineer

    Machine Learning Engineer

    Gabeo.aithrissur, kerala, in
    Please apply only if you're available to start right away.If you're currently serving a notice period or cannot join immediately, we kindly ask that you refrain from applying.We're only interested ...Show moreLast updated: 30+ days ago
    • Promoted
    Machine Learning Engineer

    Machine Learning Engineer

    Branch InternationalThrissur, IN
    Branch delivers world-class financial services to the mobile generation.With offices in the United States, Nigeria, Kenya, and India, Branch is a for-profit socially conscious company that uses the...Show moreLast updated: 30+ days ago
    • Promoted
    Databricks Engineer

    Databricks Engineer

    Tata Consultancy Servicescoimbatore, tamil nadu, in
    Skills : Azure Databricks, Pyspark, ADLS, ADF.Responsibility of / Expectations from the Role : .Designing and building Databricks data pipelines is required. Experience in transforming the data using A...Show moreLast updated: 9 days ago
    • Promoted
    Machine Learning Engineer

    Machine Learning Engineer

    goMLPalakkad, IN
    Looking for a culture to thrive & build a rewarding career for yourself, join the core team of young hustlers building the next generation of Machine Learning platform & services.You will develop t...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Machine Learning Engineer

    Senior Machine Learning Engineer

    Recrothrissur, kerala, in
    You will develop, train, test and deploy machine learning models in various fields such as.LLMs, tabular and time series data. Experimenting with novel deep learning based technologies such as self-...Show moreLast updated: 23 days ago
    • Promoted
    LLM - Python for Machine Learning - 2+

    LLM - Python for Machine Learning - 2+

    Jupiter AI LabsPalakkad, IN
    We are seeking skilled and experienced ML Developers to join our innovative team.The ideal candidate will have strong hands-on ML experience with the ability to understand complex data models and t...Show moreLast updated: 23 hours ago
    • Promoted
    Data & AI Architect

    Data & AI Architect

    Delphi Consulting Middle EastThrissur, IN
    Ready to embark on a journey where your growth is intertwined with our commitment to making a positive impact? Join the Delphi family - where Growth Meets Values. Interviews and onboarding are condu...Show moreLast updated: 30+ days ago
    • Promoted
    Machine Learning Engineer

    Machine Learning Engineer

    LaurenCoimbatore, IN
    Develop prompt engineering strategies.Specify ML methodologies for demo scenarios.Implement AI / ML components where applicable. Optimize model performance for demo environments.Expertise in prompt en...Show moreLast updated: 11 days ago