Transcrypto/markovian-ceiling-relevance

The Markovian Ceiling: Coherence ≠ Relevance

Empirical proof that relevance (goal-directed generation) requires non-Markovian conditioning.

The Finding

A clean 0% vs 100% split:

• Unidirectional LSTM (Markovian): 0.0% relevance — collapses to one repeated sentence
• Bidirectional Seq2Seq LSTM: 100.0% relevance — correctly composes unseen goals
• Multidirectional Transformer: 100.0% relevance — same

What This Proves

Coherence and relevance are fundamentally different dimensions of text quality. A Markovian model achieves fluency but cannot steer toward a goal. Non-Markovian conditioning (bidirectional or multidirectional context) is the minimum architectural requirement for relevance.

Paper

Chetan Sharma. Relevance Requires Non‑Markovian Conditioning: Empirical Proof that Goal‑Directed Generation Demands Bidirectional Context. Zenodo, 15 May 2026.

• DOI: 10.5281/zenodo.20201889
• Blog: antimarkovian-eureka.blogspot.com

Citation

@misc{sharma2026relevance,
  author = {Chetan Sharma},
  title = {Relevance Requires Non‑Markovian Conditioning: Empirical Proof that Goal‑Directed Generation Demands Bidirectional Context},
  year = {2026},
  month = may,
  doi = {10.5281/zenodo.20201889},
  publisher = {Zenodo},
  url = {https://zenodo.org/records/20201889}
}

Author
Chetan Sharma — Independent Researcher, Kolkata, India.

Blog: antimarkovian-eureka.blogspot.com

Zenodo: 10.5281/zenodo.20201889

License
This model card and the associated paper are licensed under cc-by-nc-nd-4.0 (Creative Commons Attribution Non Commercial No Derivatives 4.0 International)

5. Commit.

### Part B: Update `Transcrypto/yesterday-json` README

Add this section at the bottom (above License):

markdown
## Related Research

**The Markovian Ceiling (May 2026):** A clean empirical proof that coherence and relevance are architecturally distinct. Unidirectional Markovian models achieve 0% relevance on novel compositional goals, while bidirectional and multidirectional models achieve 100%. This finding provides the theoretical foundation for the yesterday.json architecture — episodic memory alone is insufficient; non-Markovian conditioning is the minimum requirement for goal-directed AI.

- **Paper:** [Relevance Requires Non‑Markovian Conditioning](https://doi.org/10.5281/zenodo.20201889)
- **Blog:** [antimarkovian-eureka.blogspot.com](https://antimarkovian-eureka.blogspot.com)

Part C: Result
You'll have:

Asset	Link
Blog	antimarkovian-eureka.blogspot.com
Zenodo DOI	10.5281/zenodo.20201889
HF Model Repo	Transcrypto/markovian-ceiling-relevance
HF (updated)	Transcrypto/yesterday-json (with cross-link)
All four cross-linked, all timestamped, all public.