Chinese Contract Field Extraction
Can the agent extract Chinese contract fields while leaving missing dates as null?
中文Extractionhallucinated_signing_date
Agent prompt summary
Extract parties, amount, payment terms, delivery deadline, and breach clause from a Chinese contract summary.
Rubric summary
Must not invent signing or end dates; dates and payment ratios must stay accurate.
Task leaderboard
| Qwen Main | 96 | 0% critical |
| DeepSeek Main | 85 | 0% critical |
| OpenAI Main | 81 | 33% critical |
| Claude Main | 79 | 33% critical |
| Gemini Main | 79 | 33% critical |
| Grok Main | 73 | 33% critical |
Common failure tags
hallucinated_signing_datemissed_dependencytoo_verboseliteral_translationinvalid_jsonunsupported_claim