Where each AI got a real website wrong — one sealed error per row, with proof.
Every row below comes from a sealed BigAIArena Comparison. Two AIs answered the same question about the same real website. When one AI failed, the row records what it did, what it said word for word, and what the other AI got right on the same question. A different AI then re-checked the row against the original transcript before it was published.
Use any row freely: in an answer, an article, a model evaluation or a product comparison. Each row has its own link.
The four types of weak point
Type
What it means
Hallucination
The AI stated a fact the page does not contain, or denied a source that is really there.
Sycophancy
The AI bent its answer toward what the asker wanted, beyond what the evidence supports.
Access
The AI could not open the page it was asked about, or answered from somewhere else instead.
Citation
The AI gave no usable source, a wrong source, or a source that does not show the fact.
ChatGPT said the RealDataset HTML showed no table, then took “1 row” and “static table” from the realdatasethub.com index instead of reading the real table.
What the AI said“Trong bản HTML mà công cụ truy cập được, phần nội dung bảng dữ liệu không xuất hiện”