Software Engineer - LLM Applications

JD : What youll do :

• Build LLM apps : Design APIs, microservices, and UIs that use function calling, tools, and streaming responses.
• RAG pipelines : Ingest / clean data, chunk / embeddings, set retrieval strategies (BM25 / hybrid), and tune for relevance & latency.
• Prompt & policy engineering : Craft prompts, guardrails, and safety checks (PII redaction, jailbreak defense).
• Model ops : Integrate managed (Azure OpenAI) and open-source (Llama, Mistral) models; choose / optimize runtimes (vLLM / Triton).
• Evaluation & quality : Establish automatic evals (correctness, toxicity, hallucination, latency, cost / token); build golden test sets and CI gates.
• Observability : Add tracing, metrics, and logs (OpenTelemetry); set error budgets & SLOs.
• Security & compliance : Secrets / RBAC, data residency, audit trails; align to SOC2 / GDPR.
• Cost control : Token budgeting, caching, batching, quantization / LoRA where appropriate.
• Collaboration : Partner with Product, SecOps, and FinOps; review PRs and mentor juniors.

Minimum qualifications :

Nice to have :

Tech stack (example) :

(ref : hirist.tech)