Talent.com
This job offer is not available in your country.
Data Engineer

Data Engineer

ACL Digitalkottayam, kerala, in
30+ days ago
Job description
  • Design, develop, and optimize Spark-based data pipelines on Databricks for large-scale data processing.
  • Design, develop, and optimize AWS pipeline as applicable.
  • Implement and manage GitHub asset bundles for version control, CI / CD workflows, and collaborative development.
  • Leverage Databricks capabilities including Delta Lake, MLflow, and notebooks to build robust data solutions.
  • Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality, production-ready datasets.
  • Ensure data quality, integrity, and security across all stages of the pipeline.
  • Monitor and troubleshoot performance issues in Spark jobs and Databricks clusters.
  • Document technical designs, workflows, and best practices.

    • Required Qualifications

    • Minimum 5+ years of hands-on experience with Spark in a production environment.
    • Strong proficiency in Databricks platform and ecosystem.
    • Solid understanding of GitHub asset bundle management, including branching strategies, pull requests, and release workflows.
    • Proficient in Python, Scala, or SQL for data engineering tasks.
    • Experience with Delta Lake, Structured Streaming, and Databricks Workflows.
    • Familiarity with cloud platform (AWS) and AWS data services.
    • Excellent problem-solving and communication skills.
    Create a job alert for this search

    Data Engineer • kottayam, kerala, in

    Related jobs
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data SolutionsKochi, IN
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Manuh TechnologiesKottayam, IN
    Strong proficiency in Python programming (Pandas, NumPy, PySpark, or similar).Hands-on experience with Dask for large-scale distributed data processing. Proven expertise as a Data Modeler (conceptua...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    EveriseAlappuzha, IN
    Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineer

    Data Engineer

    RevXKochi, IN
    RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Otomeyt AIKochi, IN
    We are seeking a highly skilled 5+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    HISH IT SERVICESKochi, IN
    Location : Remote(Banglore,Chennai,Pune).Pay : 14LPA - 18 LPA(Based on Experience).Timings : A couple of hours overlap with EST, as the client is Canada-based (till 12AM IST).Start Date : 20th Octob...Show moreLast updated: 6 days ago
    • Promoted
    Data / ML Engineer

    Data / ML Engineer

    GleantapKottayam, IN
    Gleantap is a customer engagement platform powering fitness, wellness, and service businesses.Python (scikit-learn, LightGBM, XGBoost). Set up retraining and monitoring pipelines (Airflow, MLflow, o...Show moreLast updated: 22 days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Kline + CompanyKottayam, IN
    Here at Kline our data capabilities have grown exponentially over the last four years.Having gone through a rapid digitization process and becoming a cloud-native corporation, we are looking for to...Show moreLast updated: less than 1 hour ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeKochi, IN
    Snowflake, AWS (Lambda, Glue), DBT, and SQL.The ideal candidate will be responsible for enabling seamless data integration, transformation, and analytics to support business intelligence and advanc...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalKochi, IN
    Notice Period : This is a ASAP hire - only apply if you can start 2 weeks after offer is extended!.Priority scheduling for candidates who message on with resume. Design, develop, and maintain robust...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    BrightEdgeKottayam, IN
    BrightEdge About Us BrightEdge is a leading SEO and content performance marketing platform that transforms online content into tangible business results. Our platform processes massive amounts of da...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    AceolutionKottayam, IN
    We are looking for a freelancer to engage with us for 20-40 hours per week.Kindly find the JD below for your reference.Design, develop, and maintain scalable data pipelines and workflows.Work exten...Show moreLast updated: 7 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    InfogainKottayam, IN
    Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Innodata Inc.Kochi, IN
    CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 25 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Bahwan CyberTekKottayam, IN
    Job Title : Data Engineer – Google Cloud Platform (GCP).We are seeking a skilled and motivated Data Engineer with hands-on experience in building scalable data pipelines and cloud-native data soluti...Show moreLast updated: 17 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DeltacubesAlappuzha, IN
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 15 days ago
    • Promoted
    Rocket UniData Engineer

    Rocket UniData Engineer

    Mitra AIKottayam, IN
    The ideal candidate will have a deep understanding of UniData and UniVerse environments, with a proven track record in developing, maintaining, and optimizing complex legacy systems.Design, develop...Show moreLast updated: 17 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kumaran SystemsKottayam, IN
    Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    XebiaKottayam, IN
    We’re Hiring : Data Engineer | Xebia.Any Xebia location (Hybrid, 3 days office per week).Immediate to 2 weeks – only apply if you can join early. Databricks, Python, SQL, and Postgres.The ideal candi...Show moreLast updated: 5 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Velodata Global Pvt LtdKochi, Kerala, India
    Work Location - Trivandrum, Kochi& Remote.Note • • - Candidates are required to attend the final round of the interview.The selected candidate must work from the office during the first month.We are ...Show moreLast updated: 30+ days ago