miniblog.

← Back to all posts
Dec 29, 2015 at 22:46
A sign of a well written test suite is when new users reporting bugs can see how to write a failing test.

Related Posts

Oct 5, 2025 at 14:59
1
LLMs seem to handle dependency upgrades really well. The task is well-specified, there's usually a build/test suite to check correctness of the modifications, and there's often a changelog they can consume too.
Dec 30, 2024 at 07:18
I love how the CommonMark Spec has a test suite that's just a JSON array. It's really easy to test a library for compliance, and I've seen developers nerd-sniped into full compliance. https://spec.commonmark.org/0.31.2/spec.json
Jul 5, 2023 at 18:37
Sweep is a really impressive demo of LLMs with coding: given your source code and an issue, it will generate a PR! Example: https://github.com/edreisMD/plugnplai/issues/65 I'd want to have a really thorough test suite if I was accepting LLM PRs though.
Only allow activating a maximum of 3 plugins · Issue #65 · edreisMD/plugnplai
Only allow activating a maximum of 3 plugins · Issue #65 · edreisMD/plugnplai
The description prompt becames too big as you add too many plugins. A max of 3 seems to be a good limit, and its the same number as OpenAI allows on ChatGPT.