▲
Claude Academy
Tracks
Quizzes
Exam Sim
Flashcards
Videos
Vault
Dashboard
Sign in
☰
CCAR-P Domain 4 (Evaluation, Testing & Optimization)
1 / 16
You are building the first eval dataset for a customer-support classifier that routes messages into four intents. The team has 10,000 labeled production transcripts available. Which dataset composition best supports ongoing prompt iteration?
A.
200 synthetic examples generated by Claude so every intent class is perfectly balanced
B.
The 500 most recent production messages, taken as-is to reflect current traffic
C.
A production sample that covers typical, ambiguous, and refusal/edge cases for each intent
D.
The 300 hardest cases the team can find, since easy cases waste evaluation budget
← Back
Check answer