Benchmarks
Each page here is a benchmark I keep up to date. When a new model comes out, it gets run on the same tests and the page is updated, with a changelog at the bottom. The write-ups that explain the results are under Posts.
- Budget LLMs on cybersecurity
Budget-tier LLMs from Korea, the US and China: closed-book security knowledge vs solving CTF challenges as an agent.
updated ·