Talent.com
Senior Data Engineer
Senior Data EngineerAppXcess Technologies • Coimbatore, Tamil Nadu, India
Senior Data Engineer

Senior Data Engineer

AppXcess Technologies • Coimbatore, Tamil Nadu, India
5 hours ago
Job description

Senior Data Engineer

Location : Coimbatore

Experience : 3–5 Years

Work Mode : On-site

About the Role

We are seeking a Senior Data Engineer who will take end-to-end ownership of designing, building, and scaling data pipelines, integrations, and analytics layers for our Enterprise AI Operational Platform .

The role involves integrating data from construction-focused enterprise tools such as Sage 300, Paperless, WorkMax, Procore, Kojo, CRM platforms , and other financial, procurement, and field applications to create a unified operational data ecosystem .

You will architect scalable systems, build automated ETL / ELT workflows, standardize data governance, and enable real-time insights, predictive analytics, and automated operational intelligence across the organization.

This position suits someone who brings strong technical depth, system architecture capability, and hands-on experience building large-scale data systems using Microsoft Azure and / or Snowflake .

Key Responsibilities

Data Architecture & System Design

  • Architect modular, scalable, and secure data platforms.
  • Design centralized data models to support analytics, forecasting, AI, and automation workloads .
  • Define data governance standards including lineage, quality, and retention.
  • Produce HLD / LLD architecture diagrams, integration maps, and technical documentation.
  • Build frameworks that support complex cross-system workflows.

Integrations Across Enterprise Tools (Sage 300, Paperless, WorkMax, Procore, Kojo, CRM, etc.)

  • Lead integrations across construction and operations software including :
  • Sage 300 (Financials, Job Costing, AP / AR, GL)
  • Paperless (Document workflows, invoice automation)
  • WorkMax (Timecards, units, production, field data)
  • Procore (Project management, RFIs, submittals, schedules)
  • Kojo (Procurement, materials management)
  • CRM systems (Sales pipeline, customer records)
  • Develop connectors using REST APIs, GraphQL, Webhooks, Secure File Transfer, and Database links .
  • Standardize schemas across tools to create a single source of truth .
  • Ensure secure and reliable data ingestion from on-prem and cloud systems.
  • Implement robust incremental sync, batch loads, and real-time event-based ingestion.
  • ETL / ELT Development & Data Pipelines

  • Build automated ETL / ELT workflows using Airflow, NiFi, Azure Data Factory, or custom frameworks .
  • Ensure pipelines are fault-tolerant, versioned, and optimized for performance .
  • Handle complex transformations, reconciliations, and multi-system data validation.
  • Develop end-to-end data ingestion frameworks supporting large structured and unstructured datasets.
  • Deploy pipelines into production with CI / CD practices.
  • Data Warehousing, Modeling & Real-Time Reporting

  • Build enterprise-wide data warehouse layers using Snowflake (preferred) , Azure SQL, or cloud data stores.
  • Maintain real-time operational data models for job cost, purchasing, productivity, CRM, safety, compliance, and field activity.
  • Create unified analytical datasets for dashboards and business intelligence.
  • Support executive and departmental reporting by eliminating manual spreadsheets and fragmented data silos.
  • Ensure high data accuracy, reliability, and performance at scale.
  • Predictive Analytics & AI Enablement

  • Prepare AI-ready datasets for forecasting, anomaly detection, productivity modeling, and operational risk scoring.
  • Collaborate with data scientists / AI engineers to build and deploy ML pipelines.
  • Develop streaming / near-real-time data flows to support AI-driven decision automation.
  • Integrate predictive insights back into operation systems (alerts, workflows, dashboards).
  • Automation & Operational Workflows

  • Automate KPI tracking, threshold-based alerts, and data validation rules.
  • Build automated workflows for :
  • RFIs
  • CORs
  • Contracts
  • Vendor documents
  • Field reporting
  • Implement monitoring frameworks for pipeline health, error handling, retry logic, and SLA compliance.
  • Documentation & Knowledge Sharing

  • Create detailed documentation for data models, transformations, integrations, and pipelines.
  • Conduct internal training and handover sessions to engineering, analytics, and operations teams.
  • Maintain continuous improvement of data standards and reusable components.
  • Skills & Experience Required

    Core Experience

  • 3–5 years of hands-on Data Engineering / Data Platform development .
  • Strong expertise in API-based integrations , especially with enterprise applications.
  • Practical experience with :
  • Python , FastAPI, Node.js
  • ETL frameworks : Airflow / NiFi / Azure Data Factory
  • Snowflake (strongly preferred) or Azure-based data warehousing
  • SQL + cloud databases
  • Azure Functions, Storage, Data Lake environments
  • Data Architecture & Modeling

  • Strong data modeling principles (Kimball, Data Vault, or custom patterns).
  • Building scalable data lakes, warehouse schemas, and analytical data marts.
  • Tools & Platforms

  • Dashboarding tools : Power BI / Tableau
  • Experience working with large structured, semi-structured, and unstructured datasets .
  • Background in financial or field operations workflows (preferred).
  • Preferred Knowledge

  • Working with industry tools such as :
  • Sage 300
  • Procore
  • WorkMax
  • Kojo
  • Paperless
  • Experience in building ML / AI data pipelines.
  • Exposure to Azure DevOps, CI / CD , and cloud deployment best practices.
  • Key Competencies

  • Strong system design and architecture thinking.
  • High ownership, accountability, and delivery focus.
  • Excellent analytical and problem-solving abilities.
  • Clear communication and documentation skills.
  • Ability to work with leadership, operations, finance, field teams, and engineering.
  • Commitment to data accuracy, reliability, and operational performance.
  • What We Offer

  • Opportunity to build a next-generation Enterprise AI Data Platform .
  • Career growth into Data Platform Lead / Engineering Manager roles .
  • Medical insurance and employee benefits.
  • Supportive leadership, high visibility, and impactful responsibilities.
  • Competitive compensation aligned with expertise and contribution.
  • Create a job alert for this search

    Senior Data Engineer • Coimbatore, Tamil Nadu, India

    Related jobs
    Data Engineer

    Data Engineer

    Randstad Enterprise • Coimbatore, IN
    Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    TerraGiG • Coimbatore, IN
    Lead the design, development, and implementation of data solutions using AWS and Snowflake.Collaborate with cross-functional teams to understand business requirements and translate them into techni...Show more
    Last updated: 30+ days ago • Promoted
    Senior Snowflake Data Engineer

    Senior Snowflake Data Engineer

    Luxoft • Coimbatore, IN
    We are seeking a highly skilled Snowflake Data Engineer with 7 years of IT experience to design, build, and optimize scalable data pipelines and cloud-based solutions across AWS, Azure, and GCP.The...Show more
    Last updated: 10 days ago • Promoted
    Data Engineer

    Data Engineer

    EXL • Coimbatore, IN
    The person will be part of the EDP Data Platform (EDP) team for a major Insurance client.He / She will work with different stakeholders for architecting & Building EDP application platform to suppor...Show more
    Last updated: 30+ days ago • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Adastra • Coimbatore, IN
    We are looking for a proactive and solution-oriented GCP Data Engineer to join our team.This role requires hands-on experience in Google Cloud Platform (GCP), especially with BigQuery and Airflow, ...Show more
    Last updated: 17 days ago • Promoted
    Senior Data Engineer - Data Acquisition

    Senior Data Engineer - Data Acquisition

    InfoBeans • Coimbatore, IN
    We are seeking a highly skilled.Senior Data Engineer – Data Acquisition (ODS).The ideal candidate will have extensive hands-on experience in building and optimizing data ingestion and transformatio...Show more
    Last updated: 23 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    VXI Global Solutions • Coimbatore, IN
    We are seeking talented and motivated Data Engineers to join our dynamic team and contribute to our mission of harnessing the power of data to drive growth and success. As a Data Engineer at VXI Glo...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AI • Coimbatore, Tamil Nadu, India
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
    Last updated: 30+ days ago • Promoted
    Senior Oracle Data Engineer

    Senior Oracle Data Engineer

    Strattek Consulting • Coimbatore, IN
    This role centers on architecting robust data pipelines across on-prem and cloud Oracle ecosystems, automating ingestion from varied sources including APIs. Exposure to Oracle FDI (Fusion Data Intel...Show more
    Last updated: 16 days ago • Promoted
    Data Engineer

    Data Engineer

    IntraEdge • Coimbatore, IN
    We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Confidential • Coimbatore, IN
    Expertise in big data technologies such as Apache Spark and real-time streaming technologies like Apache Kafka.Strong programming skills in Python, Java, C++, SQL etc. Advanced knowledge of a major ...Show more
    Last updated: 7 hours ago • Promoted • New!
    Senior GenAI Engineer

    Senior GenAI Engineer

    Mitra AI • Coimbatore, IN
    AI System Design & Development : .Architect, develop, and deploy large-scale Generative AI, LLM-based systems, including intelligent agents and automation workflows. LLM Integration & Optimization : .In...Show more
    Last updated: 14 days ago • Promoted
    Senior Python Data Engineer

    Senior Python Data Engineer

    iVoyant • Coimbatore, IN
    Join a dynamic engineering team working on a high-impact tax reporting platform for the 2025 fiscal season.The core goal is to modernize and significantly accelerate the generation of Excel-based r...Show more
    Last updated: 17 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Ironbook AI • Coimbatore, IN
    The ideal candidate will have strong experience with cloud platforms, modern ETL / ELT tools, and deep technical skills in Python, SQL, and distributed data frameworks. Design, develop, and maintain s...Show more
    Last updated: 7 hours ago • Promoted • New!
    Lead Data Engineer

    Lead Data Engineer

    Ironbook AI • Coimbatore, IN
    We are seeking an experienced and driven Lead Data Engineer to spearhead the.AI use cases across the organization.Minimum 7 years of experience in data engineering, with at.Strong hands-on experien...Show more
    Last updated: 7 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    MyRemoteTeam Inc • Coimbatore, IN
    MyRemoteTeam, Inc is a fast-growing distributed workforce enabler, helping companies scale with top global talent.We empower businesses by providing world-class software engineers, operations suppo...Show more
    Last updated: 7 hours ago • Promoted • New!
    Lead Data Engineer

    Lead Data Engineer

    Guidanz Inc • Coimbatore, IN
    BI Connector is the industry leading solution for integrating Oracle Fusion Cloud data into modern BI platforms like Power BI, Tableau, and Data Warehouse, without complex ETL.Our Data Architecture...Show more
    Last updated: 30+ days ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Paritas Recruitment • Coimbatore, IN
    Azure Data Engineer - 6 Month+ Rolling Contract.Remote - (Sunday to Thursday working days).Paritas is working with a global IT Consultancy & leading Energy client who are seeking an experienced and...Show more
    Last updated: 1 day ago • Promoted