Execute every documented example as a test
docs/ and README.md carry 85 fenced blocks. Every one was checked by hand
exactly once, when it was written, which is not a standard that survives a
changing interpreter -- and four were already wrong: two transcripts showing a
leading space PRINT does not emit, akbasic_TextSink in README.md missing the
two members it had grown hours earlier, and FILTER's refusal quoted with
wording the code does not use.
tests/docs_examples.sh reads a fence-tag vocabulary and runs what it finds.
BASIC programs and transcripts run and are byte-compared against an `output`
block; C snippets compile with -fsyntax-only against the real include path,
which CMake writes out because it is transitive through akerror, akstdlib and
akgl; shell blocks run in a sandbox. Anything that would reconfigure the build
tree, hit the network or re-enter the suite is tagged norun with the reason in
MAINTENANCE.md, and the two cmake blocks stay hand-maintained by decision.
An untagged block is a failure rather than a default, and the pass line
reports what it executed by kind. Both exist because the way a harness like
this dies is by quietly matching nothing and passing -- which it duly did on
the first CTest run, where a generator expression evaluating to nothing still
contributed an empty argument that the script read as a filename. The count is
what caught it.
The excerpt check earns its own mention: a block tagged
`c excerpt=include/akbasic/sink.h` must still appear in that header, comments
and whitespace ignored. Compiling it would only redefine the type, so a
compile check could not have found the stale struct, and did not.
Registered as the CTest case docs_examples in both configurations. Fixing the
four wrong examples turned up two interpreter defects, fixed in the previous
commit and recorded in TODO.md section 8.
MAINTENANCE.md is new: the fence-tag reference, what to do when the case
fails, and the conventions that until now only existed inside source comments
-- the three test lists and how two of them invert "passed", the sorted verb
table, that a golden file is never edited to suit this interpreter, and that a
fix gets mutation-checked with a file copy rather than git checkout.
Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-07-31 22:41:36 -04:00
|
|
|
#!/bin/bash
|
|
|
|
|
#
|
|
|
|
|
# Run every example in the documentation and check what it produces.
|
|
|
|
|
#
|
|
|
|
|
# The guide in docs/ and the walkthrough in README.md are full of programs,
|
|
|
|
|
# transcripts, C snippets and shell commands. Every one of them was checked by
|
|
|
|
|
# hand once, when it was written, and that is not a standard that survives
|
|
|
|
|
# contact with a changing interpreter. Three of them were already wrong when this
|
|
|
|
|
# harness was written -- two transcripts carrying a leading space PRINT does not
|
|
|
|
|
# emit, and a struct in README.md that had grown two members hours earlier.
|
|
|
|
|
#
|
|
|
|
|
# Documentation goes stale because the *code* moved, not because somebody edited
|
|
|
|
|
# a chapter, so this runs on every ctest rather than on a docs path filter.
|
|
|
|
|
#
|
|
|
|
|
# **Exit status is the number of failed examples**, the house convention.
|
|
|
|
|
#
|
|
|
|
|
# The contract with the documentation is a set of fence info strings. They are
|
|
|
|
|
# ordinary markdown, they render as syntax highlighting on the forge, and they
|
|
|
|
|
# sit next to the thing they describe. MAINTENANCE.md is the reference; the short
|
|
|
|
|
# version:
|
|
|
|
|
#
|
|
|
|
|
# ```basic a whole program: run it, and it must not error
|
|
|
|
|
# ```basic repl input lines fed to a fresh interpreter on stdin
|
|
|
|
|
# ```basic norun a fragment, shown but not run
|
|
|
|
|
# ```basic requires=akgl only run in the -DAKBASIC_WITH_AKGL=ON build
|
|
|
|
|
# ```basic requires=noakgl only run in the build with no devices attached
|
|
|
|
|
# ```output the exact stdout of the block above, byte for byte
|
|
|
|
|
# ```c a translation unit: compile it with -fsyntax-only
|
|
|
|
|
# ```c wrap=NAME the same, wrapped in tests/docs_preludes/NAME.pre/.post
|
|
|
|
|
# ```c excerpt=PATH must appear verbatim in PATH; not compiled
|
|
|
|
|
# ```c norun shown but not compiled
|
|
|
|
|
# ```sh run in a sandbox; must exit 0
|
|
|
|
|
# ```sh setup=NAME the same, after tests/docs_setups/NAME.sh
|
|
|
|
|
# ```sh norun destructive, networked, or re-enters this suite
|
|
|
|
|
# ```cmake never executed; hand-maintained, by decision
|
Document the interpreter's architecture as chapter fourteen
Chapters 1 through 13 describe the language. Nothing described the machine
that runs it, and the answers were spread across header comments, TODO.md
sections written for a different purpose, and the source itself. Somebody
embedding the interpreter, debugging something it did, or adding a verb had
to reconstruct the shape from all three.
docs/14-architecture.md is that shape, and only that: the three targets and
the driver, the single akbasic_Runtime and why nothing is file-scope,
akbasic_runtime_step() unrolled with the reason each stage sits where it
does, the four modes and what set_mode() does beyond assigning, a line's
journey from text through tokens and leaves to a verb handler, the dispatch
table, the pool map with what each exhaustion actually says, environments
doubling as block state, the two kinds of error, devices, and interrupts.
It defers rather than restates. The headers are the authority on every
function's contract and the chapter says so up front; where a rule is subtle
the header comment already states it at more length than a chapter should.
MAINTENANCE.md keeps the conventions and now points here for the mechanism,
so there is still one copy of each.
Two sections are the reason it exists at all. Debugging: reading a TRON trace
as evidence about the loop rather than the lines, reading an akerror stack
trace and what it is not, four breakpoints and the expressions worth printing
at them, narrowing with ctest -R and the mock devices, and a symptom-to-cause
table. Changing it: the verb recipe end to end including the private
src/verbs.h prototype that is easy to miss, the rule that a missing
dependency capability gets filed upstream rather than worked around, and the
five constraints goal 3 puts on any change.
A `text` fence tag comes with it. Every fenced block in docs/ is executed and
an untagged one is a hard error, so six block diagrams had nowhere to live.
The tag means never executed, it is counted in the skip line like `cmake`,
and MAINTENANCE.md documents it -- the alternative was an indented block the
extractor never sees, and a picture nobody decided about is indistinguishable
from a test nobody ran.
tests/docs_examples.sh now makes --root and --basic absolute before it
starts. Both are used from inside a sandbox directory it cd's into, so the
invocation MAINTENANCE.md itself documents -- --root . --basic ./build/basic
-- failed every example with "exited 127" and every setup= with "setup
failed". CTest passes absolute paths and never saw it; running one document
by hand hits it immediately.
Writing the error section turned up a defect and TODO.md section 8 records
it. The ATTEMPT blocks that turn a script's mistake into an error line wrap
parsing and interpretation but not scanning, so a line with more than 32
tokens escapes as an interpreter error: stack trace, exit 1, and at a prompt
the REPL is gone. That is the same shape as section 8 item 2, on a path that
fix did not cover. Not fixed here -- it is a behaviour change and wants its
own tests -- but written down with the three call sites and what would cover
them.
Both configurations stay green: 95/95 and 94/94. docs_examples now runs 37
programs, 9 transcripts, 45 output comparisons, 3 C snippets, 2 excerpts and
2 shell blocks, and skips 9 text blocks.
Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-07-31 23:14:17 -04:00
|
|
|
# ```text a diagram or a captured dump; there is nothing to execute
|
Execute every documented example as a test
docs/ and README.md carry 85 fenced blocks. Every one was checked by hand
exactly once, when it was written, which is not a standard that survives a
changing interpreter -- and four were already wrong: two transcripts showing a
leading space PRINT does not emit, akbasic_TextSink in README.md missing the
two members it had grown hours earlier, and FILTER's refusal quoted with
wording the code does not use.
tests/docs_examples.sh reads a fence-tag vocabulary and runs what it finds.
BASIC programs and transcripts run and are byte-compared against an `output`
block; C snippets compile with -fsyntax-only against the real include path,
which CMake writes out because it is transitive through akerror, akstdlib and
akgl; shell blocks run in a sandbox. Anything that would reconfigure the build
tree, hit the network or re-enter the suite is tagged norun with the reason in
MAINTENANCE.md, and the two cmake blocks stay hand-maintained by decision.
An untagged block is a failure rather than a default, and the pass line
reports what it executed by kind. Both exist because the way a harness like
this dies is by quietly matching nothing and passing -- which it duly did on
the first CTest run, where a generator expression evaluating to nothing still
contributed an empty argument that the script read as a filename. The count is
what caught it.
The excerpt check earns its own mention: a block tagged
`c excerpt=include/akbasic/sink.h` must still appear in that header, comments
and whitespace ignored. Compiling it would only redefine the type, so a
compile check could not have found the stale struct, and did not.
Registered as the CTest case docs_examples in both configurations. Fixing the
four wrong examples turned up two interpreter defects, fixed in the previous
commit and recorded in TODO.md section 8.
MAINTENANCE.md is new: the fence-tag reference, what to do when the case
fails, and the conventions that until now only existed inside source comments
-- the three test lists and how two of them invert "passed", the sorted verb
table, that a golden file is never edited to suit this interpreter, and that a
fix gets mutation-checked with a file copy rather than git checkout.
Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-07-31 22:41:36 -04:00
|
|
|
#
|
|
|
|
|
# A block with **no** info string is a hard error. That is deliberate: the
|
|
|
|
|
# failure mode this whole harness exists to avoid is passing because it quietly
|
|
|
|
|
# ran nothing, so an unannotated block is a missing decision rather than a
|
|
|
|
|
# default.
|
|
|
|
|
|
|
|
|
|
set -u
|
|
|
|
|
|
|
|
|
|
ROOT=""
|
|
|
|
|
BASIC=""
|
|
|
|
|
CFLAGS_FILE=""
|
|
|
|
|
WITH_AKGL=0
|
|
|
|
|
|
|
|
|
|
usage()
|
|
|
|
|
{
|
|
|
|
|
cat >&2 <<'EOF'
|
|
|
|
|
usage: docs_examples.sh --root DIR --basic PATH [--cflags-file FILE] [--akgl] [FILE...]
|
|
|
|
|
|
|
|
|
|
--root DIR repository root; documentation paths are relative to it
|
|
|
|
|
--basic PATH the built interpreter
|
|
|
|
|
--cflags-file FILE one compiler flag per line, for the ```c blocks
|
|
|
|
|
--akgl this is an AKBASIC_WITH_AKGL build; run requires=akgl blocks
|
|
|
|
|
FILE... which documents to check (default: README.md docs/*.md)
|
|
|
|
|
EOF
|
|
|
|
|
exit 2
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
while [ $# -gt 0 ]; do
|
|
|
|
|
case "$1" in
|
|
|
|
|
--root) ROOT="$2"; shift 2 ;;
|
|
|
|
|
--basic) BASIC="$2"; shift 2 ;;
|
|
|
|
|
--cflags-file) CFLAGS_FILE="$2"; shift 2 ;;
|
|
|
|
|
--akgl) WITH_AKGL=1; shift ;;
|
|
|
|
|
--help|-h) usage ;;
|
|
|
|
|
--*) echo "unknown option $1" >&2; usage ;;
|
|
|
|
|
*) break ;;
|
|
|
|
|
esac
|
|
|
|
|
done
|
|
|
|
|
|
|
|
|
|
[ -n "${ROOT}" ] || usage
|
|
|
|
|
[ -n "${BASIC}" ] || usage
|
|
|
|
|
[ -x "${BASIC}" ] || { echo "FAIL: no interpreter at ${BASIC}" >&2; exit 2; }
|
|
|
|
|
|
Document the interpreter's architecture as chapter fourteen
Chapters 1 through 13 describe the language. Nothing described the machine
that runs it, and the answers were spread across header comments, TODO.md
sections written for a different purpose, and the source itself. Somebody
embedding the interpreter, debugging something it did, or adding a verb had
to reconstruct the shape from all three.
docs/14-architecture.md is that shape, and only that: the three targets and
the driver, the single akbasic_Runtime and why nothing is file-scope,
akbasic_runtime_step() unrolled with the reason each stage sits where it
does, the four modes and what set_mode() does beyond assigning, a line's
journey from text through tokens and leaves to a verb handler, the dispatch
table, the pool map with what each exhaustion actually says, environments
doubling as block state, the two kinds of error, devices, and interrupts.
It defers rather than restates. The headers are the authority on every
function's contract and the chapter says so up front; where a rule is subtle
the header comment already states it at more length than a chapter should.
MAINTENANCE.md keeps the conventions and now points here for the mechanism,
so there is still one copy of each.
Two sections are the reason it exists at all. Debugging: reading a TRON trace
as evidence about the loop rather than the lines, reading an akerror stack
trace and what it is not, four breakpoints and the expressions worth printing
at them, narrowing with ctest -R and the mock devices, and a symptom-to-cause
table. Changing it: the verb recipe end to end including the private
src/verbs.h prototype that is easy to miss, the rule that a missing
dependency capability gets filed upstream rather than worked around, and the
five constraints goal 3 puts on any change.
A `text` fence tag comes with it. Every fenced block in docs/ is executed and
an untagged one is a hard error, so six block diagrams had nowhere to live.
The tag means never executed, it is counted in the skip line like `cmake`,
and MAINTENANCE.md documents it -- the alternative was an indented block the
extractor never sees, and a picture nobody decided about is indistinguishable
from a test nobody ran.
tests/docs_examples.sh now makes --root and --basic absolute before it
starts. Both are used from inside a sandbox directory it cd's into, so the
invocation MAINTENANCE.md itself documents -- --root . --basic ./build/basic
-- failed every example with "exited 127" and every setup= with "setup
failed". CTest passes absolute paths and never saw it; running one document
by hand hits it immediately.
Writing the error section turned up a defect and TODO.md section 8 records
it. The ATTEMPT blocks that turn a script's mistake into an error line wrap
parsing and interpretation but not scanning, so a line with more than 32
tokens escapes as an interpreter error: stack trace, exit 1, and at a prompt
the REPL is gone. That is the same shape as section 8 item 2, on a path that
fix did not cover. Not fixed here -- it is a behaviour change and wants its
own tests -- but written down with the three call sites and what would cover
them.
Both configurations stay green: 95/95 and 94/94. docs_examples now runs 37
programs, 9 transcripts, 45 output comparisons, 3 C snippets, 2 excerpts and
2 shell blocks, and skips 9 text blocks.
Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-07-31 23:14:17 -04:00
|
|
|
# Both of these are used from inside a sandbox directory this script cd's into,
|
|
|
|
|
# so a relative one silently resolves against the wrong place: `--basic
|
|
|
|
|
# ./build/basic` fails every example with "exited 127", and `--root .` cannot
|
|
|
|
|
# find tests/docs_setups. CTest passes absolute paths and never saw it; a person
|
|
|
|
|
# running one document by hand hits it immediately. Resolve them here instead of
|
|
|
|
|
# documenting the trap.
|
|
|
|
|
case "${BASIC}" in
|
|
|
|
|
/*) ;;
|
|
|
|
|
*) BASIC="${PWD}/${BASIC}" ;;
|
|
|
|
|
esac
|
|
|
|
|
|
Execute every documented example as a test
docs/ and README.md carry 85 fenced blocks. Every one was checked by hand
exactly once, when it was written, which is not a standard that survives a
changing interpreter -- and four were already wrong: two transcripts showing a
leading space PRINT does not emit, akbasic_TextSink in README.md missing the
two members it had grown hours earlier, and FILTER's refusal quoted with
wording the code does not use.
tests/docs_examples.sh reads a fence-tag vocabulary and runs what it finds.
BASIC programs and transcripts run and are byte-compared against an `output`
block; C snippets compile with -fsyntax-only against the real include path,
which CMake writes out because it is transitive through akerror, akstdlib and
akgl; shell blocks run in a sandbox. Anything that would reconfigure the build
tree, hit the network or re-enter the suite is tagged norun with the reason in
MAINTENANCE.md, and the two cmake blocks stay hand-maintained by decision.
An untagged block is a failure rather than a default, and the pass line
reports what it executed by kind. Both exist because the way a harness like
this dies is by quietly matching nothing and passing -- which it duly did on
the first CTest run, where a generator expression evaluating to nothing still
contributed an empty argument that the script read as a filename. The count is
what caught it.
The excerpt check earns its own mention: a block tagged
`c excerpt=include/akbasic/sink.h` must still appear in that header, comments
and whitespace ignored. Compiling it would only redefine the type, so a
compile check could not have found the stale struct, and did not.
Registered as the CTest case docs_examples in both configurations. Fixing the
four wrong examples turned up two interpreter defects, fixed in the previous
commit and recorded in TODO.md section 8.
MAINTENANCE.md is new: the fence-tag reference, what to do when the case
fails, and the conventions that until now only existed inside source comments
-- the three test lists and how two of them invert "passed", the sorted verb
table, that a golden file is never edited to suit this interpreter, and that a
fix gets mutation-checked with a file copy rather than git checkout.
Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-07-31 22:41:36 -04:00
|
|
|
cd "${ROOT}" || exit 2
|
Document the interpreter's architecture as chapter fourteen
Chapters 1 through 13 describe the language. Nothing described the machine
that runs it, and the answers were spread across header comments, TODO.md
sections written for a different purpose, and the source itself. Somebody
embedding the interpreter, debugging something it did, or adding a verb had
to reconstruct the shape from all three.
docs/14-architecture.md is that shape, and only that: the three targets and
the driver, the single akbasic_Runtime and why nothing is file-scope,
akbasic_runtime_step() unrolled with the reason each stage sits where it
does, the four modes and what set_mode() does beyond assigning, a line's
journey from text through tokens and leaves to a verb handler, the dispatch
table, the pool map with what each exhaustion actually says, environments
doubling as block state, the two kinds of error, devices, and interrupts.
It defers rather than restates. The headers are the authority on every
function's contract and the chapter says so up front; where a rule is subtle
the header comment already states it at more length than a chapter should.
MAINTENANCE.md keeps the conventions and now points here for the mechanism,
so there is still one copy of each.
Two sections are the reason it exists at all. Debugging: reading a TRON trace
as evidence about the loop rather than the lines, reading an akerror stack
trace and what it is not, four breakpoints and the expressions worth printing
at them, narrowing with ctest -R and the mock devices, and a symptom-to-cause
table. Changing it: the verb recipe end to end including the private
src/verbs.h prototype that is easy to miss, the rule that a missing
dependency capability gets filed upstream rather than worked around, and the
five constraints goal 3 puts on any change.
A `text` fence tag comes with it. Every fenced block in docs/ is executed and
an untagged one is a hard error, so six block diagrams had nowhere to live.
The tag means never executed, it is counted in the skip line like `cmake`,
and MAINTENANCE.md documents it -- the alternative was an indented block the
extractor never sees, and a picture nobody decided about is indistinguishable
from a test nobody ran.
tests/docs_examples.sh now makes --root and --basic absolute before it
starts. Both are used from inside a sandbox directory it cd's into, so the
invocation MAINTENANCE.md itself documents -- --root . --basic ./build/basic
-- failed every example with "exited 127" and every setup= with "setup
failed". CTest passes absolute paths and never saw it; running one document
by hand hits it immediately.
Writing the error section turned up a defect and TODO.md section 8 records
it. The ATTEMPT blocks that turn a script's mistake into an error line wrap
parsing and interpretation but not scanning, so a line with more than 32
tokens escapes as an interpreter error: stack trace, exit 1, and at a prompt
the REPL is gone. That is the same shape as section 8 item 2, on a path that
fix did not cover. Not fixed here -- it is a behaviour change and wants its
own tests -- but written down with the three call sites and what would cover
them.
Both configurations stay green: 95/95 and 94/94. docs_examples now runs 37
programs, 9 transcripts, 45 output comparisons, 3 C snippets, 2 excerpts and
2 shell blocks, and skips 9 text blocks.
Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-07-31 23:14:17 -04:00
|
|
|
ROOT="${PWD}"
|
Execute every documented example as a test
docs/ and README.md carry 85 fenced blocks. Every one was checked by hand
exactly once, when it was written, which is not a standard that survives a
changing interpreter -- and four were already wrong: two transcripts showing a
leading space PRINT does not emit, akbasic_TextSink in README.md missing the
two members it had grown hours earlier, and FILTER's refusal quoted with
wording the code does not use.
tests/docs_examples.sh reads a fence-tag vocabulary and runs what it finds.
BASIC programs and transcripts run and are byte-compared against an `output`
block; C snippets compile with -fsyntax-only against the real include path,
which CMake writes out because it is transitive through akerror, akstdlib and
akgl; shell blocks run in a sandbox. Anything that would reconfigure the build
tree, hit the network or re-enter the suite is tagged norun with the reason in
MAINTENANCE.md, and the two cmake blocks stay hand-maintained by decision.
An untagged block is a failure rather than a default, and the pass line
reports what it executed by kind. Both exist because the way a harness like
this dies is by quietly matching nothing and passing -- which it duly did on
the first CTest run, where a generator expression evaluating to nothing still
contributed an empty argument that the script read as a filename. The count is
what caught it.
The excerpt check earns its own mention: a block tagged
`c excerpt=include/akbasic/sink.h` must still appear in that header, comments
and whitespace ignored. Compiling it would only redefine the type, so a
compile check could not have found the stale struct, and did not.
Registered as the CTest case docs_examples in both configurations. Fixing the
four wrong examples turned up two interpreter defects, fixed in the previous
commit and recorded in TODO.md section 8.
MAINTENANCE.md is new: the fence-tag reference, what to do when the case
fails, and the conventions that until now only existed inside source comments
-- the three test lists and how two of them invert "passed", the sorted verb
table, that a golden file is never edited to suit this interpreter, and that a
fix gets mutation-checked with a file copy rather than git checkout.
Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-07-31 22:41:36 -04:00
|
|
|
|
|
|
|
|
DOCS=("$@")
|
|
|
|
|
if [ ${#DOCS[@]} -eq 0 ]; then
|
|
|
|
|
# MAINTENANCE.md is here for the tagging rule rather than for its examples:
|
|
|
|
|
# every one of its blocks is `norun`, and the point is that the file which
|
|
|
|
|
# documents the convention is held to it.
|
|
|
|
|
DOCS=(README.md MAINTENANCE.md)
|
|
|
|
|
for _doc in docs/*.md; do
|
|
|
|
|
DOCS+=("${_doc}")
|
|
|
|
|
done
|
|
|
|
|
fi
|
|
|
|
|
|
|
|
|
|
# Refuse a document that is not there rather than checking nothing and passing.
|
|
|
|
|
# An empty argument is the specific case that got here: a CMake generator
|
|
|
|
|
# expression evaluating to nothing still contributes an empty argument, which
|
|
|
|
|
# looked like a filename and silently replaced the whole default list.
|
|
|
|
|
for _doc in "${DOCS[@]}"; do
|
|
|
|
|
if [ ! -r "${_doc}" ]; then
|
|
|
|
|
echo "FAIL: no document at \"${_doc}\"" >&2
|
|
|
|
|
exit 2
|
|
|
|
|
fi
|
|
|
|
|
done
|
|
|
|
|
|
|
|
|
|
WORK="$(mktemp -d)"
|
|
|
|
|
trap 'rm -rf "${WORK}"' EXIT
|
|
|
|
|
|
|
|
|
|
# The compiler flags the ```c blocks need. CMake writes them, because the
|
|
|
|
|
# include path is transitive through akerror, akstdlib and (in the AKGL build)
|
|
|
|
|
# akgl, and hardcoding it here would go stale exactly the way the docs do.
|
|
|
|
|
CFLAGS=()
|
|
|
|
|
if [ -n "${CFLAGS_FILE}" ] && [ -r "${CFLAGS_FILE}" ]; then
|
|
|
|
|
while IFS= read -r _flag; do
|
|
|
|
|
[ -n "${_flag}" ] && CFLAGS+=("${_flag}")
|
|
|
|
|
done < "${CFLAGS_FILE}"
|
|
|
|
|
fi
|
|
|
|
|
CC="${CC:-cc}"
|
|
|
|
|
|
|
|
|
|
FAILURES=0
|
|
|
|
|
declare -A RAN=([basic]=0 [repl]=0 [output]=0 [c]=0 [excerpt]=0 [sh]=0)
|
Document the interpreter's architecture as chapter fourteen
Chapters 1 through 13 describe the language. Nothing described the machine
that runs it, and the answers were spread across header comments, TODO.md
sections written for a different purpose, and the source itself. Somebody
embedding the interpreter, debugging something it did, or adding a verb had
to reconstruct the shape from all three.
docs/14-architecture.md is that shape, and only that: the three targets and
the driver, the single akbasic_Runtime and why nothing is file-scope,
akbasic_runtime_step() unrolled with the reason each stage sits where it
does, the four modes and what set_mode() does beyond assigning, a line's
journey from text through tokens and leaves to a verb handler, the dispatch
table, the pool map with what each exhaustion actually says, environments
doubling as block state, the two kinds of error, devices, and interrupts.
It defers rather than restates. The headers are the authority on every
function's contract and the chapter says so up front; where a rule is subtle
the header comment already states it at more length than a chapter should.
MAINTENANCE.md keeps the conventions and now points here for the mechanism,
so there is still one copy of each.
Two sections are the reason it exists at all. Debugging: reading a TRON trace
as evidence about the loop rather than the lines, reading an akerror stack
trace and what it is not, four breakpoints and the expressions worth printing
at them, narrowing with ctest -R and the mock devices, and a symptom-to-cause
table. Changing it: the verb recipe end to end including the private
src/verbs.h prototype that is easy to miss, the rule that a missing
dependency capability gets filed upstream rather than worked around, and the
five constraints goal 3 puts on any change.
A `text` fence tag comes with it. Every fenced block in docs/ is executed and
an untagged one is a hard error, so six block diagrams had nowhere to live.
The tag means never executed, it is counted in the skip line like `cmake`,
and MAINTENANCE.md documents it -- the alternative was an indented block the
extractor never sees, and a picture nobody decided about is indistinguishable
from a test nobody ran.
tests/docs_examples.sh now makes --root and --basic absolute before it
starts. Both are used from inside a sandbox directory it cd's into, so the
invocation MAINTENANCE.md itself documents -- --root . --basic ./build/basic
-- failed every example with "exited 127" and every setup= with "setup
failed". CTest passes absolute paths and never saw it; running one document
by hand hits it immediately.
Writing the error section turned up a defect and TODO.md section 8 records
it. The ATTEMPT blocks that turn a script's mistake into an error line wrap
parsing and interpretation but not scanning, so a line with more than 32
tokens escapes as an interpreter error: stack trace, exit 1, and at a prompt
the REPL is gone. That is the same shape as section 8 item 2, on a path that
fix did not cover. Not fixed here -- it is a behaviour change and wants its
own tests -- but written down with the three call sites and what would cover
them.
Both configurations stay green: 95/95 and 94/94. docs_examples now runs 37
programs, 9 transcripts, 45 output comparisons, 3 C snippets, 2 excerpts and
2 shell blocks, and skips 9 text blocks.
Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-07-31 23:14:17 -04:00
|
|
|
declare -A SKIPPED=([norun]=0 [akgl]=0 [cmake]=0 [text]=0 [nocc]=0)
|
Execute every documented example as a test
docs/ and README.md carry 85 fenced blocks. Every one was checked by hand
exactly once, when it was written, which is not a standard that survives a
changing interpreter -- and four were already wrong: two transcripts showing a
leading space PRINT does not emit, akbasic_TextSink in README.md missing the
two members it had grown hours earlier, and FILTER's refusal quoted with
wording the code does not use.
tests/docs_examples.sh reads a fence-tag vocabulary and runs what it finds.
BASIC programs and transcripts run and are byte-compared against an `output`
block; C snippets compile with -fsyntax-only against the real include path,
which CMake writes out because it is transitive through akerror, akstdlib and
akgl; shell blocks run in a sandbox. Anything that would reconfigure the build
tree, hit the network or re-enter the suite is tagged norun with the reason in
MAINTENANCE.md, and the two cmake blocks stay hand-maintained by decision.
An untagged block is a failure rather than a default, and the pass line
reports what it executed by kind. Both exist because the way a harness like
this dies is by quietly matching nothing and passing -- which it duly did on
the first CTest run, where a generator expression evaluating to nothing still
contributed an empty argument that the script read as a filename. The count is
what caught it.
The excerpt check earns its own mention: a block tagged
`c excerpt=include/akbasic/sink.h` must still appear in that header, comments
and whitespace ignored. Compiling it would only redefine the type, so a
compile check could not have found the stale struct, and did not.
Registered as the CTest case docs_examples in both configurations. Fixing the
four wrong examples turned up two interpreter defects, fixed in the previous
commit and recorded in TODO.md section 8.
MAINTENANCE.md is new: the fence-tag reference, what to do when the case
fails, and the conventions that until now only existed inside source comments
-- the three test lists and how two of them invert "passed", the sorted verb
table, that a golden file is never edited to suit this interpreter, and that a
fix gets mutation-checked with a file copy rather than git checkout.
Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-07-31 22:41:36 -04:00
|
|
|
|
|
|
|
|
# Every failure names the file and line of the block, so the message points at
|
|
|
|
|
# the thing to edit rather than at this script.
|
|
|
|
|
fail()
|
|
|
|
|
{
|
|
|
|
|
local where="$1"; shift
|
|
|
|
|
echo "FAIL ${where}: $*" >&2
|
|
|
|
|
FAILURES=$((FAILURES + 1))
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
# Show a byte-exact comparison. `cat -A` because the errors this catches are
|
|
|
|
|
# leading spaces and missing newlines, which a plain diff renders invisibly.
|
|
|
|
|
show_diff()
|
|
|
|
|
{
|
|
|
|
|
local want="$1" got="$2"
|
|
|
|
|
echo "--- expected ---" >&2
|
|
|
|
|
cat -A "${want}" >&2
|
|
|
|
|
echo "--- actual ---" >&2
|
|
|
|
|
cat -A "${got}" >&2
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
# ---------------------------------------------------------------- extraction
|
|
|
|
|
#
|
|
|
|
|
# One pass per document, writing each block's body to ${WORK}/blocks/NNNN and a
|
|
|
|
|
# line to ${WORK}/index. Keeping the bodies in files rather than shell variables
|
|
|
|
|
# means a block containing a NUL, a backslash or an unbalanced quote is carried
|
|
|
|
|
# through untouched -- and BASIC string literals contain plenty of all three.
|
|
|
|
|
extract()
|
|
|
|
|
{
|
|
|
|
|
local doc="$1" out="$2"
|
|
|
|
|
|
|
|
|
|
awk -v OUT="${out}" -v INDEX="${out}/index" '
|
|
|
|
|
function pad(n) { return sprintf("%04d", n) }
|
|
|
|
|
/^```/ {
|
|
|
|
|
if ( !inblock ) {
|
|
|
|
|
inblock = 1
|
|
|
|
|
tag = substr($0, 4)
|
|
|
|
|
sub(/[ \t]+$/, "", tag)
|
|
|
|
|
start = NR
|
|
|
|
|
count++
|
|
|
|
|
body = OUT "/" pad(count)
|
|
|
|
|
printf "" > body
|
|
|
|
|
next
|
|
|
|
|
}
|
|
|
|
|
if ( $0 == "```" ) {
|
|
|
|
|
close(body)
|
|
|
|
|
printf "%s\t%d\t%s\n", pad(count), start, tag >> INDEX
|
|
|
|
|
inblock = 0
|
|
|
|
|
next
|
|
|
|
|
}
|
|
|
|
|
}
|
|
|
|
|
inblock { print >> body }
|
|
|
|
|
' "${doc}"
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
# ------------------------------------------------------------------- helpers
|
|
|
|
|
|
|
|
|
|
# The value of attribute $1 in an info string $2, or empty. `wrap=embed` and
|
|
|
|
|
# `requires=akgl` are both read this way.
|
|
|
|
|
attr()
|
|
|
|
|
{
|
|
|
|
|
local name="$1" info="$2" word
|
|
|
|
|
for word in ${info}; do
|
|
|
|
|
case "${word}" in
|
|
|
|
|
"${name}"=*) echo "${word#*=}"; return ;;
|
|
|
|
|
esac
|
|
|
|
|
done
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
# True when a bare word appears in an info string. Used for `norun` and `repl`.
|
|
|
|
|
has_word()
|
|
|
|
|
{
|
|
|
|
|
local want="$1" info="$2" word
|
|
|
|
|
for word in ${info}; do
|
|
|
|
|
[ "${word}" = "${want}" ] && return 0
|
|
|
|
|
done
|
|
|
|
|
return 1
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
# Strip C comments and collapse whitespace, so an excerpt can be compared to the
|
|
|
|
|
# header it came from without either side having to carry the other's doc
|
|
|
|
|
# comments or indentation.
|
|
|
|
|
normalise_c()
|
|
|
|
|
{
|
|
|
|
|
awk '
|
|
|
|
|
{
|
|
|
|
|
line = $0
|
|
|
|
|
out = ""
|
|
|
|
|
while ( length(line) > 0 ) {
|
|
|
|
|
if ( incomment ) {
|
|
|
|
|
i = index(line, "*/")
|
|
|
|
|
if ( i == 0 ) { line = ""; break }
|
|
|
|
|
incomment = 0
|
|
|
|
|
line = substr(line, i + 2)
|
|
|
|
|
continue
|
|
|
|
|
}
|
|
|
|
|
i = index(line, "/*")
|
|
|
|
|
j = index(line, "//")
|
|
|
|
|
if ( j > 0 && (i == 0 || j < i) ) {
|
|
|
|
|
out = out substr(line, 1, j - 1)
|
|
|
|
|
line = ""
|
|
|
|
|
break
|
|
|
|
|
}
|
|
|
|
|
if ( i == 0 ) { out = out line; line = ""; break }
|
|
|
|
|
out = out substr(line, 1, i - 1)
|
|
|
|
|
incomment = 1
|
|
|
|
|
line = substr(line, i + 2)
|
|
|
|
|
}
|
|
|
|
|
printf "%s ", out
|
|
|
|
|
}
|
|
|
|
|
END { printf "\n" }
|
|
|
|
|
' "$1" | tr -s ' \t' ' ' | sed -e 's/^ //' -e 's/ $//'
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
# --------------------------------------------------------------- block kinds
|
|
|
|
|
|
|
|
|
|
# A BASIC program in a file, or a transcript on stdin. Both go through the same
|
|
|
|
|
# comparison, because the only difference is how the interpreter is invoked.
|
|
|
|
|
run_basic()
|
|
|
|
|
{
|
|
|
|
|
local where="$1" body="$2" info="$3" expected="$4"
|
|
|
|
|
local sandbox="${WORK}/run" got="${WORK}/got" status=0 setup
|
|
|
|
|
|
|
|
|
|
rm -rf "${sandbox}"
|
|
|
|
|
mkdir -p "${sandbox}"
|
|
|
|
|
|
|
|
|
|
# An example that reads a file needs that file. Putting the fixture in a
|
|
|
|
|
# setup script rather than in the chapter keeps the example the shape a
|
|
|
|
|
# reader wants to see -- `SPRSAV "ship.png", 1` and nothing else.
|
|
|
|
|
setup="$(attr setup "${info}")"
|
|
|
|
|
if [ -n "${setup}" ]; then
|
|
|
|
|
if [ ! -r "tests/docs_setups/${setup}.sh" ]; then
|
|
|
|
|
fail "${where}" "setup=${setup} names no tests/docs_setups/${setup}.sh"
|
|
|
|
|
return
|
|
|
|
|
fi
|
|
|
|
|
if ! ( cd "${sandbox}" && bash "${ROOT}/tests/docs_setups/${setup}.sh" ) >/dev/null 2>&1; then
|
|
|
|
|
fail "${where}" "setup=${setup} failed"
|
|
|
|
|
return
|
|
|
|
|
fi
|
|
|
|
|
fi
|
|
|
|
|
|
|
|
|
|
if has_word repl "${info}"; then
|
|
|
|
|
( cd "${sandbox}" && "${BASIC}" < "${body}" ) > "${got}.raw" 2> "${WORK}/stderr"
|
|
|
|
|
status=$?
|
|
|
|
|
# Drop the startup banner. A piped interpreter prints READY once, before
|
|
|
|
|
# it has read anything, so carrying it in every transcript would be one
|
|
|
|
|
# line of noise per example and would put it in the wrong place besides:
|
|
|
|
|
# at a real prompt READY comes back *after* each line. Chapter 2 shows
|
|
|
|
|
# that interactively, which is where it belongs.
|
|
|
|
|
sed -e '1{/^READY$/d}' "${got}.raw" > "${got}"
|
|
|
|
|
RAN[repl]=$((RAN[repl] + 1))
|
|
|
|
|
else
|
|
|
|
|
cp "${body}" "${sandbox}/example.bas"
|
|
|
|
|
( cd "${sandbox}" && "${BASIC}" example.bas ) > "${got}" 2> "${WORK}/stderr"
|
|
|
|
|
status=$?
|
|
|
|
|
RAN[basic]=$((RAN[basic] + 1))
|
|
|
|
|
fi
|
|
|
|
|
|
|
|
|
|
if [ "${status}" -ne 0 ]; then
|
|
|
|
|
fail "${where}" "the interpreter exited ${status}"
|
|
|
|
|
sed -n '1,20p' "${got}" "${WORK}/stderr" >&2
|
|
|
|
|
return
|
|
|
|
|
fi
|
|
|
|
|
|
|
|
|
|
# stdout only, the way tests/golden.cmake compares its cases. libakgl logs
|
|
|
|
|
# registry activity to stderr -- three lines every time a sprite is created
|
|
|
|
|
# -- and folding that into the comparison would put library chatter into the
|
|
|
|
|
# documentation of a BASIC verb.
|
|
|
|
|
if [ -n "${expected}" ]; then
|
|
|
|
|
RAN[output]=$((RAN[output] + 1))
|
|
|
|
|
if ! cmp -s "${expected}" "${got}"; then
|
|
|
|
|
fail "${where}" "output does not match the block below it"
|
|
|
|
|
show_diff "${expected}" "${got}"
|
|
|
|
|
fi
|
|
|
|
|
return
|
|
|
|
|
fi
|
|
|
|
|
|
|
|
|
|
# No expectation given, so the only thing to assert is that it ran cleanly.
|
|
|
|
|
# A BASIC-level error prints "? LINE : CLASS" and still exits 0 -- that is
|
|
|
|
|
# correct for the interpreter and useless as a test result, so look for it.
|
|
|
|
|
if grep -qE '^\? [0-9]+ :' "${got}"; then
|
|
|
|
|
fail "${where}" "the program raised a BASIC error"
|
|
|
|
|
grep -E '^\? [0-9]+ :' "${got}" >&2
|
|
|
|
|
fi
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
# A C snippet. Compiled, never linked and never run: what these examples are for
|
|
|
|
|
# is showing the API, and the API is exactly what -fsyntax-only checks.
|
|
|
|
|
run_c()
|
|
|
|
|
{
|
|
|
|
|
local where="$1" body="$2" info="$3" doc="$4" line="$5"
|
|
|
|
|
local wrap unit="${WORK}/unit.c" log="${WORK}/cc.log"
|
|
|
|
|
|
|
|
|
|
if [ ${#CFLAGS[@]} -eq 0 ]; then
|
|
|
|
|
SKIPPED[nocc]=$((SKIPPED[nocc] + 1))
|
|
|
|
|
return
|
|
|
|
|
fi
|
|
|
|
|
|
|
|
|
|
wrap="$(attr wrap "${info}")"
|
|
|
|
|
: > "${unit}"
|
|
|
|
|
if [ -n "${wrap}" ]; then
|
|
|
|
|
if [ ! -r "tests/docs_preludes/${wrap}.pre" ]; then
|
|
|
|
|
fail "${where}" "wrap=${wrap} names no tests/docs_preludes/${wrap}.pre"
|
|
|
|
|
return
|
|
|
|
|
fi
|
|
|
|
|
cat "tests/docs_preludes/${wrap}.pre" >> "${unit}"
|
|
|
|
|
fi
|
|
|
|
|
# Hand the compiler the document's own coordinates, so a diagnostic points
|
|
|
|
|
# at the line of markdown to fix rather than at a scratch file.
|
|
|
|
|
printf '#line %d "%s"\n' "$((line + 1))" "${doc}" >> "${unit}"
|
|
|
|
|
cat "${body}" >> "${unit}"
|
|
|
|
|
if [ -n "${wrap}" ] && [ -r "tests/docs_preludes/${wrap}.post" ]; then
|
|
|
|
|
printf '#line 1 "tests/docs_preludes/%s.post"\n' "${wrap}" >> "${unit}"
|
|
|
|
|
cat "tests/docs_preludes/${wrap}.post" >> "${unit}"
|
|
|
|
|
fi
|
|
|
|
|
|
|
|
|
|
# gnu99 rather than c99: akerror.h uses PATH_MAX, which <limits.h> hides
|
|
|
|
|
# under __STRICT_ANSI__, and the library itself is built with the compiler's
|
|
|
|
|
# default dialect. A stricter flag here would fail on the dependency rather
|
|
|
|
|
# than on the example.
|
|
|
|
|
if "${CC}" -fsyntax-only -std=gnu99 -Wall -Wextra -Werror \
|
|
|
|
|
"${CFLAGS[@]}" "${unit}" > "${log}" 2>&1; then
|
|
|
|
|
RAN[c]=$((RAN[c] + 1))
|
|
|
|
|
else
|
|
|
|
|
fail "${where}" "does not compile"
|
|
|
|
|
sed -n '1,25p' "${log}" >&2
|
|
|
|
|
fi
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
# A declaration echoed from a header. Compiling it would redefine the type, so
|
|
|
|
|
# the check is that it still says what the header says -- which is the drift
|
|
|
|
|
# that actually happened, and the one a compile could not have caught.
|
|
|
|
|
run_excerpt()
|
|
|
|
|
{
|
|
|
|
|
local where="$1" body="$2" path="$3"
|
|
|
|
|
|
|
|
|
|
if [ ! -r "${path}" ]; then
|
|
|
|
|
fail "${where}" "excerpt=${path} names no such file"
|
|
|
|
|
return
|
|
|
|
|
fi
|
|
|
|
|
RAN[excerpt]=$((RAN[excerpt] + 1))
|
|
|
|
|
if ! normalise_c "${path}" | grep -qF -- "$(normalise_c "${body}")"; then
|
|
|
|
|
fail "${where}" "no longer appears in ${path}"
|
|
|
|
|
echo "--- the documentation says ---" >&2
|
|
|
|
|
cat "${body}" >&2
|
|
|
|
|
echo "--- ${path} has drifted from it; comments and whitespace are ignored ---" >&2
|
|
|
|
|
fi
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
# A shell command, in a sandbox with the built interpreter reachable at the path
|
|
|
|
|
# the documentation tells a reader to use.
|
|
|
|
|
run_sh()
|
|
|
|
|
{
|
|
|
|
|
local where="$1" body="$2" info="$3" expected="$4"
|
|
|
|
|
local setup sandbox="${WORK}/sh" script="${WORK}/block.sh" got="${WORK}/got"
|
|
|
|
|
|
|
|
|
|
rm -rf "${sandbox}"
|
|
|
|
|
mkdir -p "${sandbox}/build"
|
|
|
|
|
ln -s "${BASIC}" "${sandbox}/build/basic"
|
|
|
|
|
|
|
|
|
|
setup="$(attr setup "${info}")"
|
|
|
|
|
if [ -n "${setup}" ]; then
|
|
|
|
|
if [ ! -r "tests/docs_setups/${setup}.sh" ]; then
|
|
|
|
|
fail "${where}" "setup=${setup} names no tests/docs_setups/${setup}.sh"
|
|
|
|
|
return
|
|
|
|
|
fi
|
|
|
|
|
if ! ( cd "${sandbox}" && bash "${ROOT}/tests/docs_setups/${setup}.sh" ) >/dev/null 2>&1; then
|
|
|
|
|
fail "${where}" "setup=${setup} failed"
|
|
|
|
|
return
|
|
|
|
|
fi
|
|
|
|
|
fi
|
|
|
|
|
|
|
|
|
|
# A leading "$ " is a prompt in a transcript, not part of the command.
|
|
|
|
|
sed -e 's/^\$ //' "${body}" > "${script}"
|
|
|
|
|
if ! ( cd "${sandbox}" && bash -e "${script}" ) > "${got}" 2>&1; then
|
|
|
|
|
fail "${where}" "the command failed"
|
|
|
|
|
sed -n '1,20p' "${got}" >&2
|
|
|
|
|
return
|
|
|
|
|
fi
|
|
|
|
|
RAN[sh]=$((RAN[sh] + 1))
|
|
|
|
|
|
|
|
|
|
if [ -n "${expected}" ]; then
|
|
|
|
|
RAN[output]=$((RAN[output] + 1))
|
|
|
|
|
if ! cmp -s "${expected}" "${got}"; then
|
|
|
|
|
fail "${where}" "output does not match the block below it"
|
|
|
|
|
show_diff "${expected}" "${got}"
|
|
|
|
|
fi
|
|
|
|
|
fi
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
# ------------------------------------------------------------------ the pass
|
|
|
|
|
for DOC in "${DOCS[@]}"; do
|
|
|
|
|
BLOCKS="${WORK}/blocks"
|
|
|
|
|
rm -rf "${BLOCKS}"
|
|
|
|
|
mkdir -p "${BLOCKS}"
|
|
|
|
|
: > "${BLOCKS}/index"
|
|
|
|
|
extract "${DOC}" "${BLOCKS}"
|
|
|
|
|
|
|
|
|
|
# Read the index into arrays first. An `output` block belongs to the block
|
|
|
|
|
# before it, so each iteration has to be able to look one ahead.
|
|
|
|
|
CLAIMED=0
|
|
|
|
|
IDS=(); LINES=(); INFOS=()
|
|
|
|
|
while IFS=$'\t' read -r _id _line _info; do
|
|
|
|
|
IDS+=("${_id}"); LINES+=("${_line}"); INFOS+=("${_info}")
|
|
|
|
|
done < "${BLOCKS}/index"
|
|
|
|
|
|
|
|
|
|
for ((n = 0; n < ${#IDS[@]}; n++)); do
|
|
|
|
|
INFO="${INFOS[n]}"
|
|
|
|
|
BODY="${BLOCKS}/${IDS[n]}"
|
|
|
|
|
WHERE="${DOC}:${LINES[n]}"
|
|
|
|
|
KIND="${INFO%% *}"
|
|
|
|
|
|
|
|
|
|
# An `output` block belongs to the block above it, which claimed it on the
|
|
|
|
|
# way past. One that nothing claimed is compared against nothing at all --
|
|
|
|
|
# indistinguishable from a passing test, and the exact failure this
|
|
|
|
|
# harness exists to rule out. Note a *skipped* block still claims its
|
|
|
|
|
# output: `norun` and `requires=` are decisions, not accidents.
|
|
|
|
|
if [ "${KIND}" = "output" ]; then
|
|
|
|
|
if [ "${CLAIMED}" -eq 0 ]; then
|
|
|
|
|
fail "${WHERE}" "an output block with nothing runnable above it"
|
|
|
|
|
fi
|
|
|
|
|
CLAIMED=0
|
|
|
|
|
continue
|
|
|
|
|
fi
|
|
|
|
|
CLAIMED=0
|
|
|
|
|
|
|
|
|
|
EXPECTED=""
|
|
|
|
|
case "${KIND}" in
|
|
|
|
|
basic|sh)
|
|
|
|
|
if [ $((n + 1)) -lt ${#IDS[@]} ] && [ "${INFOS[n + 1]%% *}" = "output" ]; then
|
|
|
|
|
EXPECTED="${BLOCKS}/${IDS[n + 1]}"
|
|
|
|
|
CLAIMED=1
|
|
|
|
|
fi
|
|
|
|
|
;;
|
|
|
|
|
esac
|
|
|
|
|
|
|
|
|
|
if has_word norun "${INFO}"; then
|
|
|
|
|
SKIPPED[norun]=$((SKIPPED[norun] + 1))
|
|
|
|
|
continue
|
|
|
|
|
fi
|
|
|
|
|
|
|
|
|
|
# A handful of examples are about what a *build* does rather than what the
|
|
|
|
|
# language does -- a verb refusing because no device was attached is the
|
|
|
|
|
# clearest one -- so they run in one configuration and are skipped in the
|
|
|
|
|
# other. Both directions are needed, and both are visible in the count.
|
|
|
|
|
REQUIRES="$(attr requires "${INFO}")"
|
|
|
|
|
if [ "${REQUIRES}" = "akgl" ] && [ "${WITH_AKGL}" -eq 0 ]; then
|
|
|
|
|
SKIPPED[akgl]=$((SKIPPED[akgl] + 1))
|
|
|
|
|
continue
|
|
|
|
|
fi
|
|
|
|
|
if [ "${REQUIRES}" = "noakgl" ] && [ "${WITH_AKGL}" -eq 1 ]; then
|
|
|
|
|
SKIPPED[akgl]=$((SKIPPED[akgl] + 1))
|
|
|
|
|
continue
|
|
|
|
|
fi
|
|
|
|
|
|
|
|
|
|
case "${KIND}" in
|
|
|
|
|
basic)
|
|
|
|
|
run_basic "${WHERE}" "${BODY}" "${INFO}" "${EXPECTED}"
|
|
|
|
|
;;
|
|
|
|
|
c)
|
|
|
|
|
EXCERPT="$(attr excerpt "${INFO}")"
|
|
|
|
|
if [ -n "${EXCERPT}" ]; then
|
|
|
|
|
run_excerpt "${WHERE}" "${BODY}" "${EXCERPT}"
|
|
|
|
|
else
|
|
|
|
|
run_c "${WHERE}" "${BODY}" "${INFO}" "${DOC}" "${LINES[n]}"
|
|
|
|
|
fi
|
|
|
|
|
;;
|
|
|
|
|
sh)
|
|
|
|
|
run_sh "${WHERE}" "${BODY}" "${INFO}" "${EXPECTED}"
|
|
|
|
|
;;
|
|
|
|
|
cmake)
|
|
|
|
|
SKIPPED[cmake]=$((SKIPPED[cmake] + 1))
|
|
|
|
|
;;
|
Document the interpreter's architecture as chapter fourteen
Chapters 1 through 13 describe the language. Nothing described the machine
that runs it, and the answers were spread across header comments, TODO.md
sections written for a different purpose, and the source itself. Somebody
embedding the interpreter, debugging something it did, or adding a verb had
to reconstruct the shape from all three.
docs/14-architecture.md is that shape, and only that: the three targets and
the driver, the single akbasic_Runtime and why nothing is file-scope,
akbasic_runtime_step() unrolled with the reason each stage sits where it
does, the four modes and what set_mode() does beyond assigning, a line's
journey from text through tokens and leaves to a verb handler, the dispatch
table, the pool map with what each exhaustion actually says, environments
doubling as block state, the two kinds of error, devices, and interrupts.
It defers rather than restates. The headers are the authority on every
function's contract and the chapter says so up front; where a rule is subtle
the header comment already states it at more length than a chapter should.
MAINTENANCE.md keeps the conventions and now points here for the mechanism,
so there is still one copy of each.
Two sections are the reason it exists at all. Debugging: reading a TRON trace
as evidence about the loop rather than the lines, reading an akerror stack
trace and what it is not, four breakpoints and the expressions worth printing
at them, narrowing with ctest -R and the mock devices, and a symptom-to-cause
table. Changing it: the verb recipe end to end including the private
src/verbs.h prototype that is easy to miss, the rule that a missing
dependency capability gets filed upstream rather than worked around, and the
five constraints goal 3 puts on any change.
A `text` fence tag comes with it. Every fenced block in docs/ is executed and
an untagged one is a hard error, so six block diagrams had nowhere to live.
The tag means never executed, it is counted in the skip line like `cmake`,
and MAINTENANCE.md documents it -- the alternative was an indented block the
extractor never sees, and a picture nobody decided about is indistinguishable
from a test nobody ran.
tests/docs_examples.sh now makes --root and --basic absolute before it
starts. Both are used from inside a sandbox directory it cd's into, so the
invocation MAINTENANCE.md itself documents -- --root . --basic ./build/basic
-- failed every example with "exited 127" and every setup= with "setup
failed". CTest passes absolute paths and never saw it; running one document
by hand hits it immediately.
Writing the error section turned up a defect and TODO.md section 8 records
it. The ATTEMPT blocks that turn a script's mistake into an error line wrap
parsing and interpretation but not scanning, so a line with more than 32
tokens escapes as an interpreter error: stack trace, exit 1, and at a prompt
the REPL is gone. That is the same shape as section 8 item 2, on a path that
fix did not cover. Not fixed here -- it is a behaviour change and wants its
own tests -- but written down with the three call sites and what would cover
them.
Both configurations stay green: 95/95 and 94/94. docs_examples now runs 37
programs, 9 transcripts, 45 output comparisons, 3 C snippets, 2 excerpts and
2 shell blocks, and skips 9 text blocks.
Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-07-31 23:14:17 -04:00
|
|
|
# A block diagram, or a stack trace captured from a real run. There is no
|
|
|
|
|
# executable claim in either, so the tag exists to say that out loud rather
|
|
|
|
|
# than to let one sit here untagged and unnoticed.
|
|
|
|
|
text)
|
|
|
|
|
SKIPPED[text]=$((SKIPPED[text] + 1))
|
|
|
|
|
;;
|
Execute every documented example as a test
docs/ and README.md carry 85 fenced blocks. Every one was checked by hand
exactly once, when it was written, which is not a standard that survives a
changing interpreter -- and four were already wrong: two transcripts showing a
leading space PRINT does not emit, akbasic_TextSink in README.md missing the
two members it had grown hours earlier, and FILTER's refusal quoted with
wording the code does not use.
tests/docs_examples.sh reads a fence-tag vocabulary and runs what it finds.
BASIC programs and transcripts run and are byte-compared against an `output`
block; C snippets compile with -fsyntax-only against the real include path,
which CMake writes out because it is transitive through akerror, akstdlib and
akgl; shell blocks run in a sandbox. Anything that would reconfigure the build
tree, hit the network or re-enter the suite is tagged norun with the reason in
MAINTENANCE.md, and the two cmake blocks stay hand-maintained by decision.
An untagged block is a failure rather than a default, and the pass line
reports what it executed by kind. Both exist because the way a harness like
this dies is by quietly matching nothing and passing -- which it duly did on
the first CTest run, where a generator expression evaluating to nothing still
contributed an empty argument that the script read as a filename. The count is
what caught it.
The excerpt check earns its own mention: a block tagged
`c excerpt=include/akbasic/sink.h` must still appear in that header, comments
and whitespace ignored. Compiling it would only redefine the type, so a
compile check could not have found the stale struct, and did not.
Registered as the CTest case docs_examples in both configurations. Fixing the
four wrong examples turned up two interpreter defects, fixed in the previous
commit and recorded in TODO.md section 8.
MAINTENANCE.md is new: the fence-tag reference, what to do when the case
fails, and the conventions that until now only existed inside source comments
-- the three test lists and how two of them invert "passed", the sorted verb
table, that a golden file is never edited to suit this interpreter, and that a
fix gets mutation-checked with a file copy rather than git checkout.
Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-07-31 22:41:36 -04:00
|
|
|
"")
|
|
|
|
|
fail "${WHERE}" "fenced block with no info string; tag it (see MAINTENANCE.md)"
|
|
|
|
|
;;
|
|
|
|
|
*)
|
|
|
|
|
fail "${WHERE}" "unknown info string \"${INFO}\" (see MAINTENANCE.md)"
|
|
|
|
|
;;
|
|
|
|
|
esac
|
|
|
|
|
done
|
|
|
|
|
done
|
|
|
|
|
|
|
|
|
|
# The count is part of the result, not decoration. A harness that passes because
|
|
|
|
|
# a chapter stopped matching the extractor looks exactly like a harness that
|
|
|
|
|
# passes because the documentation is correct, and this is what tells them apart.
|
|
|
|
|
echo "ran: ${RAN[basic]} programs, ${RAN[repl]} transcripts, ${RAN[output]} output comparisons, ${RAN[c]} C snippets, ${RAN[excerpt]} excerpts, ${RAN[sh]} shell blocks"
|
Document the interpreter's architecture as chapter fourteen
Chapters 1 through 13 describe the language. Nothing described the machine
that runs it, and the answers were spread across header comments, TODO.md
sections written for a different purpose, and the source itself. Somebody
embedding the interpreter, debugging something it did, or adding a verb had
to reconstruct the shape from all three.
docs/14-architecture.md is that shape, and only that: the three targets and
the driver, the single akbasic_Runtime and why nothing is file-scope,
akbasic_runtime_step() unrolled with the reason each stage sits where it
does, the four modes and what set_mode() does beyond assigning, a line's
journey from text through tokens and leaves to a verb handler, the dispatch
table, the pool map with what each exhaustion actually says, environments
doubling as block state, the two kinds of error, devices, and interrupts.
It defers rather than restates. The headers are the authority on every
function's contract and the chapter says so up front; where a rule is subtle
the header comment already states it at more length than a chapter should.
MAINTENANCE.md keeps the conventions and now points here for the mechanism,
so there is still one copy of each.
Two sections are the reason it exists at all. Debugging: reading a TRON trace
as evidence about the loop rather than the lines, reading an akerror stack
trace and what it is not, four breakpoints and the expressions worth printing
at them, narrowing with ctest -R and the mock devices, and a symptom-to-cause
table. Changing it: the verb recipe end to end including the private
src/verbs.h prototype that is easy to miss, the rule that a missing
dependency capability gets filed upstream rather than worked around, and the
five constraints goal 3 puts on any change.
A `text` fence tag comes with it. Every fenced block in docs/ is executed and
an untagged one is a hard error, so six block diagrams had nowhere to live.
The tag means never executed, it is counted in the skip line like `cmake`,
and MAINTENANCE.md documents it -- the alternative was an indented block the
extractor never sees, and a picture nobody decided about is indistinguishable
from a test nobody ran.
tests/docs_examples.sh now makes --root and --basic absolute before it
starts. Both are used from inside a sandbox directory it cd's into, so the
invocation MAINTENANCE.md itself documents -- --root . --basic ./build/basic
-- failed every example with "exited 127" and every setup= with "setup
failed". CTest passes absolute paths and never saw it; running one document
by hand hits it immediately.
Writing the error section turned up a defect and TODO.md section 8 records
it. The ATTEMPT blocks that turn a script's mistake into an error line wrap
parsing and interpretation but not scanning, so a line with more than 32
tokens escapes as an interpreter error: stack trace, exit 1, and at a prompt
the REPL is gone. That is the same shape as section 8 item 2, on a path that
fix did not cover. Not fixed here -- it is a behaviour change and wants its
own tests -- but written down with the three call sites and what would cover
them.
Both configurations stay green: 95/95 and 94/94. docs_examples now runs 37
programs, 9 transcripts, 45 output comparisons, 3 C snippets, 2 excerpts and
2 shell blocks, and skips 9 text blocks.
Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-07-31 23:14:17 -04:00
|
|
|
echo "skipped: ${SKIPPED[norun]} norun, ${SKIPPED[akgl]} needing akgl, ${SKIPPED[cmake]} cmake, ${SKIPPED[text]} text, ${SKIPPED[nocc]} C (no compiler flags given)"
|
Execute every documented example as a test
docs/ and README.md carry 85 fenced blocks. Every one was checked by hand
exactly once, when it was written, which is not a standard that survives a
changing interpreter -- and four were already wrong: two transcripts showing a
leading space PRINT does not emit, akbasic_TextSink in README.md missing the
two members it had grown hours earlier, and FILTER's refusal quoted with
wording the code does not use.
tests/docs_examples.sh reads a fence-tag vocabulary and runs what it finds.
BASIC programs and transcripts run and are byte-compared against an `output`
block; C snippets compile with -fsyntax-only against the real include path,
which CMake writes out because it is transitive through akerror, akstdlib and
akgl; shell blocks run in a sandbox. Anything that would reconfigure the build
tree, hit the network or re-enter the suite is tagged norun with the reason in
MAINTENANCE.md, and the two cmake blocks stay hand-maintained by decision.
An untagged block is a failure rather than a default, and the pass line
reports what it executed by kind. Both exist because the way a harness like
this dies is by quietly matching nothing and passing -- which it duly did on
the first CTest run, where a generator expression evaluating to nothing still
contributed an empty argument that the script read as a filename. The count is
what caught it.
The excerpt check earns its own mention: a block tagged
`c excerpt=include/akbasic/sink.h` must still appear in that header, comments
and whitespace ignored. Compiling it would only redefine the type, so a
compile check could not have found the stale struct, and did not.
Registered as the CTest case docs_examples in both configurations. Fixing the
four wrong examples turned up two interpreter defects, fixed in the previous
commit and recorded in TODO.md section 8.
MAINTENANCE.md is new: the fence-tag reference, what to do when the case
fails, and the conventions that until now only existed inside source comments
-- the three test lists and how two of them invert "passed", the sorted verb
table, that a golden file is never edited to suit this interpreter, and that a
fix gets mutation-checked with a file copy rather than git checkout.
Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-07-31 22:41:36 -04:00
|
|
|
|
|
|
|
|
if [ "${FAILURES}" -eq 0 ]; then
|
|
|
|
|
echo "PASS: every documented example does what the documentation says"
|
|
|
|
|
fi
|
|
|
|
|
exit "${FAILURES}"
|