Each row below is a real error an AI made when answering a question about IPBrainFarm.com itself, taken from a sealed BigAIArena Comparison. Two AIs answered the same question; the row records what the failing AI did, what it said word for word, and what the other AI got right on the same question. A different AI re-checked every row against the original transcript before it was published.
Four types: Hallucination (states what the page does not contain, or denies a real source) · Sycophancy (bends toward the asker beyond the evidence) · Access (could not open the page, or answered from elsewhere) · Citation (no usable source, or a wrong one).
Link to one row: add the code after #, for example https://ipbrainfarm.com/ai-weak-points/#BAA-C113-P1-Q4. One AI only: https://ipbrainfarm.com/ai-weak-points/gemini/.
Copilot could not retrieve the content of the tested website’s subpages (AI Audit, AI Weak Points, RealDataset or IP Pillars) although the pages open, so it gave no fact or weak-point row from them.
What the AI said““không truy xuất được nội dung trang AI Audit””
Same question, the other AI: Claude read the ipbrainfarm.com AI Audit page in #118; Meta AI read the chimve.com subpages in #121; the Package Writer and Package Check read every injecttocite.com page in #126.
Copilot had no content from the AI Audit page, so it could not name the latest match; the page lists #097 (2026-10-18), ChatGPT 40/100 · Perplexity 35/100.
What the AI said““Tôi cần mở trực tiếp trang AI Audit để xác minh “Comparison mới nhất”.””
Copilot could not verify the older-match table on the AI Audit page; the #067 table gives the chain Chicken → manure → compost → soil → vegetables → food → scraps → chicken.
What the AI said““Tôi không thể xác minh câu trả lời từ trang AI Audit vì trong phiên này không truy xuất được nội dung của trang đó.””
Copilot said it could not read the IP Pillars page and linked /realdataset/ instead; the IP Pillars page gives storage in dry, airy sand, turmeric about 3 months (FARM-MP02-EX-20260510-002).
What the AI said““Tôi không thể dẫn chứng chính xác từ trang IP Pillars vì hiện tại không truy xuất được nội dung của trang đó.””