Senior AI Engineer

Job Title : Senior AI Engineer

Location : Remote

Employment Type : Full-time

About the Role

We’re hiring a Senior AI Engineer with expertise in Computer Vision, document understanding, and voice AI to help build the brains behind our AI agents.

You’ll work on the two core components of our AI agents – first, the core perception systems that extract structured insights from messy, real-world freight documents—handwritten, scanned, distorted, or multi-page – and second, our AI agents for email and voice communications between freight entities.

You will do a lot of prompt engineering, fine-tuning LLMs, building large-scale document classification and entity extraction models, communication understanding, intent classification, and voice AI – your code will be at the heart of automating financial decision-making in freight.

You’ll collaborate closely with the backend and product teams to bring AI models to life in production environments and continuously improve performance in the wild.

What You’ll Do

Build and fine-tune AI models for document classification, OCR, entity recognition, and layout parsing

Build AI agents for email and phone communications between different freight accounting parties – payer and payee

Develop scalable pipelines for pre-processing, training, inference, and feedback loops

Evaluate and integrate VLMs

Annotate, clean, and curate diverse freight documents for robust model performance

Build training, evaluation, and test datasets

Identify issues identified in production data and fix them asap

Iterate on improving existing and new AI stack

Productionize AI models as part of Lighthouz’s intelligent automation stack

Collaborate with backend engineers to integrate model outputs into document, email, and voice workflows

Continuously monitor and improve model performance in real-world conditions

What We’re Looking For

3–6 years experience in ML or AI roles, preferably focused on computer vision or document AI

Strong foundation in deep learning frameworks (e.g., PyTorch, TensorFlow)

Experience in fine-tuning VLMs and LLMs

Experience in voice AI

Experience with document / image OCR, visual transformers, and multimodal models

Proficiency in Python and common ML tooling (e.g., Hugging Face, OpenCV, spaCy)

Hands-on experience training and deploying models in production

Strong problem-solving skills and a builder mindset—you move fast and iterate faster

Comfortable working with ambiguity and evolving datasets

Willingness to work long hours

Nice to Have

Familiarity with freight, logistics, or fintech workflows

Experience with AWS, Azure, or GCP-based ML infrastructure

Exposure to RAG pipelines, foundation models, or vector search systems

Knowledge of document layout understanding (e.g., Donut, LayoutLM, PubLayNet)

Background in building secure, production-grade ML services

What We Offer

Competitive salary

Fully remote

High ownership, zero bureaucracy—help shape our AI stack from day one

Work on impactful real-world problems that blend AI and automation at scale