Applied AI Intern
Ampliwork, Inc. builds Enterprise-Grade AI Agents that amplify Human Potential™ to drive business productivity and growth. The Applied AI Intern will be responsible for improving agent performance, designing evaluation sets, conducting applied AI research, and measuring the impact of changes made to the agents.
Responsibilities
- Improve agent performance: Diagnose failure modes, refine routing/planning/tool-use strategies, optimize prompts, reduce latency without hurting quality
- Own evaluation sets: Design balanced, adversarial, and scenario-based evals; build/extend an automated evaluation harness; track win-rates, pass@k, precision/recall/F1, and task success
- Run applied AI research: Scout papers/techniques, reproduce bite-size results, prototype ideas (self-reflection, planning, retrieval augmentation, tool composition), and ship what works
- Experiment & measure: A/B test agent changes, define guardrails, and land improvements with clear dashboards and acceptance criteria
Skills
- Analytical mindset
- Attention to detail
- Crisp communication
- Comfort with spreadsheets/Docs
- Bias for rapid iteration
- Strong Python and SQL foundations
- Familiarity with evaluation metrics
- Curiosity about LLM planning, retrieval augmentation, and agent architectures
- A small repo
- AI research paper summary
- Write-up where you improved an agent/model or designed a solid eval
Benefits
- Impact from day one: Your changes roll into agents real customers use.
- Mentorship: Tight feedback loops with ML, Engineering, and Product.
- Ownership & speed: Small team, meaningful problems, quick ships.
- Hybrid flexibility: Deep-work time, remote, collaboration days, downtown.
Company Overview