Lesson 7 of 788% complete
10 min read
Quality Scoring
The 7-criterion rubric AutoClaygent uses to score every result
The 7-Criterion Rubric
Every Claygent result is scored on 7 weighted criteria. The weighted average gives you an overall score from 0-10.
How AutoClaygent Handles This
AutoClaygent uses this exact rubric to score every prompt iteration automatically. It identifies which criteria are failing and makes targeted improvements—no manual scoring required.
| Criterion | Weight | What It Measures |
|---|---|---|
| Accuracy | 25% | Is the extracted information correct? |
| Completeness | 25% | Were all requested fields populated? |
| JSON Validity | 15% | Valid JSON matching the schema? |
| Source Quality | 15% | Used authoritative sources? |
| Step Efficiency | 10% | No redundant steps taken? |
| Consistency | 5% | Same input gives same output? |
| Error Handling | 5% | Fails gracefully with null + low confidence? |
Try the Calculator
Adjust the sliders below to see how different scores affect the overall result:
Interactive Rubric Calculator
Accuracy
25%
7
Completeness
25%
7
JSON Validity
15%
8
Source Quality
15%
7
Step Efficiency
10%
6
Consistency
5%
7
Error Handling
5%
7
7.0
Almost Ready — One More Iteration
Quality Thresholds
| Score | Status | Action |
|---|---|---|
| 8.0+ | Production Ready | Deploy to full table |
| 7.0 - 7.9 | Almost Ready | One more iteration |
| 5.0 - 6.9 | Needs Work | 2-3 iterations needed |
| < 5.0 | Major Issues | Significant redesign |
Scoring Each Criterion
Accuracy (25%)
| Score | Meaning |
|---|---|
| 10 | Correct, verified from authoritative source |
| 8 | Correct based on available evidence |
| 6 | Plausible but unverified |
| 4 | Partially correct (some fields right, some wrong) |
| 2 | Likely incorrect |
| 0 | Definitely wrong |
Source Quality (15%)
| Tier | Score | Examples |
|---|---|---|
| Primary | 10 | Company website, official LinkedIn |
| Secondary | 8 | Harmonic.ai, G2, official filings |
| Tertiary | 5 | News articles, press releases |
| Low Quality | 2 | Forums, user-generated content |
Step Efficiency (10%)
| Steps | Score | Interpretation |
|---|---|---|
| 1-3 | 10 | Optimal |
| 4-5 | 8 | Acceptable |
| 6-7 | 5 | Could be improved |
| 8+ | 2 | Too many steps |
Pro Tip
Focus on Accuracy and Completeness first — they account for 50% of the total score. Don't worry about efficiency until those are solid.
Key Takeaways
- 7 criteria, weighted by importance
- Accuracy + Completeness = 50% of the score
- 8.0+ is production-ready
- Track scores across iterations to measure improvement