File size: 4,326 Bytes
ba476f8
cf28d02
cd53181
cf28d02
 
ba476f8
 
 
4b37a3d
ba476f8
 
cf28d02
 
cd53181
 
 
cf28d02
 
0ffcbff
cf28d02
cd53181
 
cf28d02
 
74a6888
cf28d02
 
49ffa14
cf28d02
0ffcbff
cf28d02
034f8b6
 
cf28d02
 
 
 
 
5ac6adb
cf28d02
 
 
 
 
 
 
 
cd53181
cf28d02
 
 
 
74a6888
cf28d02
 
cd53181
 
 
 
cf28d02
 
de16b8d
cd53181
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
---
title: PRML Playground
emoji: 🔐
colorFrom: green
colorTo: gray
sdk: static
pinned: false
license: mit
short_description: In-browser SHA-256 manifest editor for the PRML spec
---

# PRML Playground

[![DOI](https://zenodo.org/badge/DOI/10.5281/zenodo.20177839.svg)](https://doi.org/10.5281/zenodo.20177839)
[![SchemaStore](https://img.shields.io/badge/schema-in%20SchemaStore-blue.svg)](https://www.schemastore.org/json/)

> Edit a Pre-Registered ML Manifest in your browser. Watch canonical bytes update. SHA-256 computed via Web Crypto. Optionally anchor publicly.

This is a Hugging Face Space mirror of the playground at [falsify.dev/playground](https://falsify.dev/playground). Same code, same hash output (byte-equivalent to the Python reference across 21 conformance vectors), zero server-side state.

**Latest:** The PRML JSON Schema was merged into the [SchemaStore catalog](https://www.schemastore.org/json/) on 2026-05-11 — `*.prml.yaml` files now autocomplete in VS Code, JetBrains, Helix, Zed, and Cursor out of the box. v0.1 is also published on Zenodo with a citable DOI: [10.5281/zenodo.20177839](https://doi.org/10.5281/zenodo.20177839).

## What is PRML?

**PRML** (Pre-Registered ML Manifest) is an open specification (Community Specification License 1.0) for committing ML evaluation claims to a SHA-256 hash *before* the experiment runs. Nine YAML fields hashed over canonical bytes — the hash is the receipt that the threshold direction was fixed before the data arrived.

- **Spec:** [spec.falsify.dev/v0.1](https://spec.falsify.dev/v0.1)
- **v0.2 RFC** (frozen 2026-05-22): [spec.falsify.dev/v0.2-rfc](https://spec.falsify.dev/v0.2-rfc)
- **JSON Schema:** [spec.falsify.dev/schema/](https://spec.falsify.dev/schema/)
- **Reference impls:** four — `pip install falsify` (PyPI) · `npm install falsify-js` (npm) · Go + Rust source at [falsify-dev/falsify/impl/](https://github.com/falsify-dev/falsify/tree/main/impl) (all MIT, byte-equivalent across 21 conformance vectors)
- **Repos:** [github.com/falsify-dev/falsify](https://github.com/falsify-dev/falsify)
- **The measurement:** across 29 published AI-assurance case studies a reader can recover the pass rule in three — [falsify.dev/notes/threshold-disclosure](https://falsify.dev/notes/threshold-disclosure/)
- **Asking for this evidence rather than producing it?** The gate and a procurement clause: [falsify.dev/require](https://falsify.dev/require/)

## How to use this Space

1. Pick one of the four pre-loaded examples (minimal accuracy, RLHF win-rate, streaming Elo, revoked) or paste your own YAML
2. Watch the canonical bytes and SHA-256 update on every keystroke
3. Click **Anchor publicly** to commit the hash to the public registry at [registry.falsify.dev](https://registry.falsify.dev) — no account required; the registry stores the manifest content-addressed by hash and the receipt verifies offline
4. Or click **Generate badge** for a local-only badge URL

Pure browser computation. The SHA-256 is computed via the Web Crypto API (`crypto.subtle.digest`). No data leaves your browser unless you click "Anchor publicly".

## Why pre-registration

> Most published ML accuracy numbers are unfalsifiable in practice. The metric, threshold, dataset slice, and random seed are reported *after* the experiment, leaving no cryptographic record of what was committed *before* it.

PRML closes one specific gap: it makes post-hoc threshold tuning mechanically detectable. It is not an attestation framework, a benchmark, or a publication-integrity system. PRML §8.1 names what it does not solve: a publisher who pre-registers ten claims and publishes only the favourable ones is still operating below the line of public accountability.

## License

- **This Space (HTML/CSS/JS):** MIT
- **PRML specification:** Community Specification License 1.0
- **Patent non-assertion grant** is published with the spec: implementations are free to use the manifest schema, canonical byte serialisation, and registry anchor protocol royalty-free, irrevocably, worldwide.

## Cite

Öztürk, C. (2026). *PRML: A Pre-Registered Manifest Format for Machine Learning Evaluation Claims (v0.1)*. Zenodo. <https://doi.org/10.5281/zenodo.20177839>

## Authors

Cüneyt Öztürk.
Contact: hello@falsify.dev · [falsify.dev](https://falsify.dev)