Senior AI Engineer - Computer Vision [15h Left]

Our Mission

To make video as accessible to machines as text and voice are today.

At lookup, we believe the world's most valuable asset is trapped. Video is everywhere, but it's unsearchable—a black box of insight that no one can open or atleast open affordably. We're changing that. We're building the search engine for the visual world, so anyone can find or do anything with video just by asking.

Text is queryable. Voice is transcribed. Video, the largest and richest data source of all, is still a black box. A computer can't understand it, and so its value remains trapped.

Our mission at lookup is to fix this.

When video is truly accessible to machines, it doesn't just mean a person can finally search their archives. It means an entirely new generation of automated workflows, creative tools, and intelligent applications can be built. We are not just building an app; we are building the API for software to see the world!

About the Role

We are looking for founding Machine Learning Engineers to help build state-of-the-art video understanding and assistant capabilities. You will work across the stack, including query understanding, video understanding, domain-adapted language models, natural language question answering, evaluation, video agents, and experimentation. You will partner closely with customers, deeply understand their pain points, and use the right tools, simple or complex to solve real problems.

What You'll Do

• Prototype, fine‐tune, and productionize vision-language models for video content.
• Design and implement embedding pipelines to represent visual and audio signals for text-based retrieval and multimodal RAG.
• Build models that generate concise, domain-focused natural language summaries, captions, and transcripts for videos.
• Adapt and fine‐tune state-of-the-art VLMs to answer natural language questions grounded in video frames, temporal context, and audio.
• Develop evaluation frameworks and benchmarks, including metric definitions, offline experiments, A / B tests, and regression tracking.
• Apply and extend classical CV models and trackers (e.g., RF‐DETR, DeepSORT, YOLO‐pose) to power an object / event database and to enable video agents orchestrated with LLMs.

Who You Are

Nice to have (optional) :

Location & Culture

Why You Will Love This Role

https : / / lookupteam.notion.site /