Hacker News comment item 50430601, posted 2026-11-09 by ariwilson in the thread for the story Is Opus 5.5 nerfed? Thinking patterns changed on November 3, records a re-run of the author's own baseline evaluation on Opus 5.5 at medium effort in Claude Code, that 20 of the tasks were last run on Nov 1, twice each, that Nov 1 solved 36 of 40 and today solved 19 of 20, and that the one significant change was speed, with median time to first token decreasing from 3.0s to 1.7s; the comment notes the caveat of one run per task today, medium effort only.
Verbatim Excerpts from Cited Records
“Eval context: 30 bug fixes and features evaluated by tests the agent didn't see. Ran on Opus 5.5 at medium effort in Claude Code.”
·
Hacker News (Hacker News comment 50430601, eval context paragraph)
·
2026-11-09T19:34:19Z
·Original Post ↗·Parent Thread ↗
“20 of the tasks were last run on Nov 1, twice each. Nov 1 solved 36/40, and today solved 19/20.”
·
Hacker News (Hacker News comment 50430601, results paragraph)
·
2026-11-09T19:34:19Z
·Original Post ↗·Parent Thread ↗
“The one significant change was speed: median time to first token decreased from 3.0s to 1.7s.”
·
Hacker News (Hacker News comment 50430601, results paragraph)
·
2026-11-09T19:34:19Z
·Original Post ↗·Parent Thread ↗
“Caveats: one run per task today, medium effort only.”
·
Hacker News (Hacker News comment 50430601, caveats paragraph)
·
2026-11-09T19:34:19Z
·Original Post ↗·Parent Thread ↗
Counter-record: The comment is a single-author measurement, not an independent replication: the author states the caveats (one run per task today, medium effort only) and that the eval context is 30 bug fixes and features evaluated by tests the agent did not see. A near-identical comment by the same author (50430746, 65.2) was posted in another thread the same day and is treated here as a duplicate, not a second claim. The comment has no replies in the surveyed thread and no retraction appears; the claim documents only what the comment reports.
Falsification probe: If HN comment 50430601 is deleted without archive, if the author edits the comment so the quoted sentences no longer match verbatim, or if the author posts a retraction of the comment, this claim drops to Withdrawn.
Audit verification: Verified 100% continuous verbatim substring against official Hacker News Firebase API by
scripts/verify_claim_verbatim.py.