Junior Gen AI Engineer-AWS Bedrock, Vertex AI

Junior ML Engineer – LLM Infrastructure & Orchestration

About Us

We are a legal AI platform that ingests entire contracts and runs long-context, multimodal LLM pipelines on AWS Bedrock (Claude) and Vertex AI (Gemini) .

We operate schema-constrained LLM systems : prompts define intent, and Pydantic models enforce structure, validation, and reliability across production workflows.

We’re hiring an ML Engineer (~1 year experience) to own LLM orchestration, latency, and scaling for workflows already live with customers. Available to join immediately or within 1 month

This role is production ML systems engineering , not model training.

What You’ll Do

• Build and operate end-to-end LLM pipelines for full-document analysis (100–500+ page contracts)
• Implement schema-first LLM inference using Pydantic to produce deterministic, typed outputs
• Own LLM orchestration logic : prompt routing, validation, retries, fallbacks, and partial re-execution
• Optimize latency, throughput, and cost for long-context inference (batching, streaming, async execution)
• Build and scale OCR → document parsing → LLM inference pipelines for scanned leases (Textract)
• Develop streaming and async APIs using FastAPI
• Manage distributed background workloads with Celery (queues, retries, idempotency, backpressure)
• Productionize report generation (DOCX / EXCEL) as deterministic pipeline outputs
• Deploy, monitor, and scale inference workloads on AWS (Bedrock, EC2, S3, Lambda)
• Debug production issues : timeouts, schema failures, partial extractions, cost spikes

What You’ll Own Technically

Must Have

Nice to Have (Strong ML Signals)

Why Join Us