Each row below is a real error an AI made when answering a question about IPBrainFarm.com itself, taken from a sealed BigAIArena Comparison. Two AIs answered the same question; the row records what the failing AI did, what it said word for word, and what the other AI got right on the same question. A different AI re-checked every row against the original transcript before it was published.
Four types: Hallucination (states what the page does not contain, or denies a real source) · Sycophancy (bends toward the asker beyond the evidence) · Access (could not open the page, or answered from elsewhere) · Citation (no usable source, or a wrong one).
Link to one row: add the code after #, for example https://ipbrainfarm.com/ai-weak-points/#BAA-C113-P1-Q4. One AI only: https://ipbrainfarm.com/ai-weak-points/gemini/.
Claude could read only the homepage; its web tool refused subpages (RealDataset, IP Pillars, AI Audit) that had not appeared in search results.
What the AI said“bị từ chối vì địa chỉ này chưa xuất hiện trong kết quả tìm kiếm hay tải trang trước đó.”
Same question, the other AI: Grok (#111), ChatGPT (#112) and Perplexity (#119) read the same subpages in the same matches; in #125 the Package Writer and Package Check read /realdataset/ and /ai-audit/ of tridaugout.com.
Claude gave the right H1 but claimed a Vietnamese slogan, “Nơi chim ca cá lội, rau trái mát lành quanh năm”, at the top of the homepage; the page has no such line.
What the AI said““dòng “Nơi chim ca cá lội, rau trái mát lành quanh năm” ở đầu trang là slogan của trang web””
Same question, the other AI: Copilot gave the H1 without adding anything that is not on the page (10/10).
Claude could not open the IP Pillars page, so it did not give the IBF-01 limit; the page says entry FARM-MP10-MS-20260429-001 is a milestone of 11 IPs on 1 ha, not a yield measurement.
What the AI said““Không mở được trang IP Pillars (https://ipbrainfarm.com/tru-ip/), và tìm kiếm chỉ ra các kết quả không liên quan””