LLM Optimization & Evaluation

Austin, TX



Job Summary

We are seeking a highly skilled LLM Optimization & Evaluation Specialist to design, optimize, and evaluate large language model (LLM) systems in production. This role focuses on prompt optimization, RAG tuning, inference efficiency, and modern evaluation frameworks to ensure high-quality, scalable, and cost-effective GenAI solutions.

The ideal candidate has hands-on experience with LLM-as-a-Judge evaluators, RAG pipelines, observability, and enterprise-grade GenAI systems.