LLM Application Engineer
You will engineer production applications around language models, implementing tool use, streaming interfaces, and validation schemas.
What you'll work with.
As an LLM Application Engineer at TheWebVale, you will build applications powered by large language models for client teams. You will develop AI customer support assistants, contract summarization portals, and intelligent workflow assistants for legal firms, coaching businesses, and software teams. You will work in close coordination with frontend developers and backend architects throughout our two-to-three week delivery cycles. You will ensure models adhere strictly to business schemas, handle edge cases gracefully, and stream responses with low latency.
Your day to day.
6 things, one at a time. Keep scrolling.
Develop production-grade software applications driven by commercial and open-source LLMs.
Implement function-calling tools that allow models to query client databases and APIs safely.
Build streaming response handlers with Server-Sent Events for fluid chat interfaces.
Design Pydantic and Zod validation schemas to enforce strict JSON structure from models.
Implement token budgeting and conversation truncation algorithms for long chat threads.
Write comprehensive automated tests to evaluate model reliability across diverse inputs.
What we look for.
6 things, one at a time. Keep scrolling.
Possess 2–4 years of software development experience with focused LLM application work.
Demonstrate advanced proficiency in Python or TypeScript with asynchronous programming.
Show extensive hands-on experience with OpenAI, Anthropic, or Gemini API tool-calling.
Understand prompt formatting, system instructions, few-shot examples, and temperature tuning.
Exhibit disciplined Git habits, unit testing practices, and clean code documentation.
Communicate technical constraints and mitigation strategies clearly to client managers.
What you get.
Three steps, no tricks.
- 1
Intro chat
A short call about what you want to work on and how you like to work.
- 2
Work review
Walk us through projects, code or designs you are proud of.
- 3
Paid task
A small paid task or pairing session, so both sides see the fit.
Apply for LLM Application Engineer .
Tell us about your work. We reply to every application, usually within a few days.