llgoyal6/vacuous-testsv0.3.0Public
Vacuous tests
A green suite is only worth what its assertions are worth.
Read the full description
This answers one question about a repo: which tests pass without proving anything. It is the third member of a family and differs from the other two in exactly one way: skipped-tests inventories the tests that do not run and flaky-signals finds the tests that run unreliably, while this one finds the tests that DO run, reliably, and prove nothing. Seven rules, ranked by how much false confidence each one buys rather than by how easy it was to match. A test with no assertion at all is CRITICAL when its siblings in the same file all assert, because somebody believed that path was covered, and HIGH when they do not. A tautological assertion is HIGH: assert True, assertTrue(1), expect(x).toBe(x), assert result == result, assert_eq!(got, got), assert.Equal(t, got, got) -- the truth of the assertion is fixed before the code under test runs. A snapshot test with no committed snapshot is HIGH, because the runner WRITES the expectation on the first run and ther
Before you run it10 local tools
Everything here is checked on your machine when rote inspects the play. This page never learns what you have installed or which credentials you hold.
- ○bashlocal tool
Requires >=3.2.0. Run rote play inspect to check your host; unverified versions remain unknown.
- ○python3local tool
Requires >=3.9.0. Run rote play inspect to check your host; unverified versions remain unknown.
- ○findlocal tool
Must be on your PATH when used. minimum version undeclared.
- ○greplocal tool
Must be on your PATH when used. minimum version undeclared.
- ○sortlocal tool
Must be on your PATH when used. minimum version undeclared.
- ○sedlocal tool
Must be on your PATH when used. minimum version undeclared.
- ○mktemplocal tool
Must be on your PATH when used. minimum version undeclared.
- ○rmlocal tool
Must be on your PATH when used. minimum version undeclared.
- ○wclocal tool
Must be on your PATH when used. minimum version undeclared.
- ○trlocal tool
Must be on your PATH when used. minimum version undeclared.
Inputs2, 1 required
rote asks for these before running and shows the defaults it will use.
- Root
rootABSOLUTE path to the directory tree whose test files should be read for assertions that prove nothing. A relative path is refused, because a step runs in rote's own workspace rather than in your shell directory, so a bare dot would scan the wrong tree and then report a clean bill about it.
requiredstringexample/Users/you/your-repocustom value allowed - Depth
depthHow many directory levels below root to search for test files
optionalstringdefault8example3custom value allowed
What it changes
No write operations are declared in this version's manifest.
Credentials remain in the recipient's local rote vault; this page and the publisher never receive them.
Runtime details
- rote CLIversion 0.62.0 or newer
- Servicesnone declared
- Digest
sha256:46759f08d2e87bed3b9f736efcb9b9140e4f4eca02f650c97ab5fff5da74575c - Archive size44173 bytes
- Published2026-09-04T04:47:42.046048+00:00
- Published withrote 0.79.0
Credential values and current readiness remain local. Opening this page never prompts for a credential, opens an authorization browser, or calls a service this play uses.
A play is a published, versioned automation package that runs on your own machine through rote, a free command-line tool. Opening this page installs nothing and runs nothing.