--- title: "Logit Loom: turn the token boundary into a programmable surface" date: 2026-07-23 canonical: https://patrickaudley.com/#post-logit-loom cross-posted-from: https://www.linkedin.com/feed/update/urn:li:activity:7486090856559677452/ source-platform: LinkedIn tags: [rust, ai-engineering, open-source, llama-cpp, token-generation, model-steering, reproducible-inference, neuro-symbolic-ai] mentions: [https://patrickaudley.com/#proj-logit-loom] author: Patrick Colm Audley author-url: https://patrickaudley.com/ license: Creative Commons BY-NC-SA CAv2.5 lang: en --- # Logit Loom: turn the token boundary into a programmable surface > Logit Loom turns the token boundary into a programmable Rust surface: compose ordered logit transforms, observe exact token bytes, stop at defined boundaries, checkpoint llama.cpp sessions, and retain serializable receipts of the mechanics that ran. LLM's generate one token at a time, but we usually consume them as turns - that's missing most of the fun! **Logit Loom** turns the token boundary into a programmable surface. Play with the stream, mess with logits, observe exactly what gets admitted, and get right inside the generation loop. I’ve open-sourced a Rust toolkit for building precise, inspectable generation pipelines around `llama.cpp`: compose ordered logit transforms, observe exact token bytes, stop at defined boundaries, checkpoint sessions, and retain serializable receipts of what ran. It’s a foundation for custom sampling and steering, constrained generation, agent runtimes, reproducible inference experiments, and the mechanics layer of neuro-symbolic systems. It's not going to write the fun bits for you, but it will take the tedium OUT of writing those bits. Be your own Dr. Frankenstein and play with the nascent minds of your agentic friends! The repo is open: [Logit Loom](https://github.com/paudley/logit-loom). ## LLMs think one token at a time **Date:** 2026-07-23 · **Cross-posted from:** [X (Twitter)](https://x.com/paudley/status/2080331398670651781) LLMs think one token at a time. Be your own Dr. Frankenstein. ⚡ Logit Loom is an open-source Rust toolkit for reaching into the token stream: mess with logits, inspect exact token bytes, checkpoint sessions, and keep receipts around `llama.cpp`. Repo: [Logit Loom](https://github.com/paudley/logit-loom). ## Cosplay Dr. Frankenstein with your agent friends! (or: how to build a neuro-symbolic framework) **Date:** 2026-07-23 · **Cross-posted from:** [Reddit (r/llamacpp)](https://www.reddit.com/r/llamacpp/comments/1v4n7jk/cosplay_dr_frankenstein_with_your_agent_friends/) Be your own Dr. Frankenstein and play with the nascent minds of your agentic friends! [Logit Loom](https://github.com/paudley/logit-loom) LLM's generate one token at a time, but we usually consume them as turns - that's missing most of the fun! Logit Loom turns the token boundary into a programmable surface. Play with the stream, mess with logits, observe exactly what gets admitted, and get right inside the generation loop. I’ve open-sourced a Rust toolkit for building precise, inspectable generation pipelines around `llama.cpp`: compose ordered logit transforms, observe exact token bytes, stop at defined boundaries, checkpoint sessions, and retain serializable receipts of what ran. It’s a foundation for custom sampling and steering, constrained generation, agent runtimes, reproducible inference experiments, and the mechanics layer of neuro-symbolic systems. It's not going to write the fun bits for you, but it will take the tedium OUT of writing those bits. --- *Originally published 2026-07-23 — [LinkedIn](https://www.linkedin.com/feed/update/urn:li:activity:7486090856559677452/). Canonical version at . Author: [Patrick Colm Audley](https://patrickaudley.com/). *