playrote.play.v1

hhimanshu-jha/experiment-inference-sanityv0.1.0Public

Experiment inference sanity

Runs a repeatable pre-decision gate over a binary two-arm experiment: sample-ratio mismatch, absolute effect with confidence interval, power against the prespecified MDE, and sequential-look plus family-wise multiple-testing claims.

Read the full description

Four independent statistical probes feed a join that blocks a launch claim when assignment integrity or adjusted significance fails, while distinguishing underpowered or direction-uncertain evidence as review work. It is deterministic, offline, and read-only. Calculations use transparent large-sample normal approximations and diagnostic O’Brien-Fleming/Bonferroni/Holm checks; they do not replace a prespecified design, variance-reduction model, clustered analysis, or domain decision cost.

  • Published 4 Sep 2026
  • Downloads 3
  • Needs rote 0.62.0+
  • License MIT
  • Digest sha256:4ce6731cf5c7…
  • Reference himanshu-jha/experiment-inference-sanity@0.1.0

Before you run it1 local tool

Everything here is checked on your machine when rote inspects the play. This page never learns what you have installed or which credentials you hold.

  • ○
    python3local tool

    Requires >=3.8. Run rote play inspect to check your host; unverified versions remain unknown.

Inputs1, all optional

rote asks for these before running and shows the defaults it will use.

  • Inputinput

    JSON with planned allocation, binary arm counts, alpha, MDE, desired power, sequential looks, and metric p-values. Empty uses the packaged cautionary demo.

    optionalstringexample ./experiment-summary.jsoncustom value allowed

What it changes

No write operations are declared in this version's manifest.

Credentials remain in the recipient's local rote vault; this page and the publisher never receive them.

Runtime details
  • rote CLIversion 0.62.0 or newer
  • Servicesnone declared
  • Digestsha256:4ce6731cf5c7857410fb93021c043c330debfdd9c9752f6577774f459f6f1277
  • Archive size9102 bytes
  • Published2026-09-04T09:01:14.912847+00:00
  • Published withrote 0.79.0

Credential values and current readiness remain local. Opening this page never prompts for a credential, opens an authorization browser, or calls a service this play uses.

A play is a published, versioned automation package that runs on your own machine through rote, a free command-line tool. Opening this page installs nothing and runs nothing.