Information Designer II
Akraya, Inc. · Posted Nov 13, 2026
- Mountain View, California, United States
- Hybrid
- Contract · Senior
- $45–$50 per hour
- 8+ years
This role focuses on improving the quality and accuracy of AI-powered chatbots and voice assistants. You will design conversational experiences, build golden datasets, evaluate AI-generated responses at scale, and provide insights to improve AI performance.
Compensation
Pay Range: $45-$50 Per Hour on W2
Responsibilities
- Design conversation strategies, principles, and playbooks for AI-powered products.
- Build AI skills using Claude Code or similar tools to generate golden datasets.
- Evaluate AI responses using LLM-as-a-Judge models and human feedback.
- Analyze AI answer quality, accuracy, and customer experience trends.
- Partner with Engineering and Data Science teams to drive improvements.
Requirements
- Nice to have: Claude Code
- Nice to have: LLM-as-a-Judge models
- Nice to have: NLP/NLU
- Nice to have: RAG
- Nice to have: machine learning frameworks