Generative AI Engineer

About Codewalla

Codewalla is a New York–based product studio with engineering teams in India. Since 2005, we’ve built innovative products that scale. We work at the intersection of design, engineering, and AI developing systems shaped by real business needs and tested in the real world. Our team moves fast, thinks deeply, and cares about pushing what software can do to empower people and businesses

About the Role

We’re hiring a Gen AI Engineer with 6–8 years of engineering experience, including at least one year shipping LLM-powered features. Your north star, turn raw LLM potential into reliable features and products.

If fast feedback loops, hands-on execution, and code that ships straight into users’ hands sound like your kind of work, we’d love to talk.

What You’ll Work On

• Build MCP servers and agentic clients that handle user intent parsing, tool orchestration, and structured response generation
• Architect efficient RAG pipelines with chunk decay, latency budgeting, and cost-aware vector search
• Automate evaluation pipelines that test LLM outputs for relevance, accuracy, and coherence
• Work closely with DevOps to codify and deploy infrastructure using CDK or Terraform
• Set up observability dashboards for prompt performance, latency, and failure traceability
• Continuously refine prompts, embeddings, and model behavior based on user feedback and regression tests

What Makes You a Great Fit

Tools & Tech We Work With

Why Join Codewalla?

Inclusion Matters

We’re an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all team members.

Ready to build the future with LLMs, without waiting for the future to catch up?

Apply now and let’s build together.