MONUMENTAL SYSTEMS
Harmonic GPT · Architecture research

Language models
built from geometry.

Spectral recurrence. Clifford rotors. Oscillator dynamics. Explore our open checkpoints and try the models in their native research demos.

Geometric language models

Different sequence mechanisms, native byte vocabularies, and explicit checkpoint provenance.

Spectral recurrence · Spherical dynamics

Clean SpectralKAN 128M

Interactive demo

An attention-free recurrent model with bounded state. The clean release completed one corpus pass, with no chat or instruction fine-tuning.

128.26M parameters · Raw UTF-8 bytes · CC BY-NC 4.0
SpectralKAN · Instruction preview

Maxine

Interactive demo

The spherical recurrent architecture with partial instruction tuning. Uses its native Instruction / Response format and a trained response terminator.

128.26M parameters · Task-family specialization · CC BY-NC 4.0

Benchmark-family-directed tuning; its scores are not a clean general-purpose evaluation.

Clifford algebra · Rotor dynamics

Rotor 25M

Interactive demo

A byte language model built around bivector coupling, Cayley rotors, and sphere-valued dynamics. The demo serves the Annealed mixed-domain checkpoint.

25M family · 20 layers · 256-byte training sequences · MIT
Native oscillators · Clifford dynamics

WIRE 9M

Downloadable research checkpoint

A small, from-scratch oscillator language model whose sequence mixing uses Clifford algebra and harmonic dynamics. Explore the tensors and configuration.

8.89M parameters · 64 harmonics · 8 layers · MIT

The public release contains weights and configuration; it has no bundled standalone inference runtime.

Dialogue experiments & controls

Conventional Transformer checkpoints help study behavior alongside the geometric architectures.

Conventional Transformer control

Harmonic Byte Chat

Interactive demo · Mac-hosted generation

The 127.6M raw-byte chat model used as a conventional Transformer control. Sampling controls include temperature, top-p, top-k, and byte limits.

Participant-aware dialogue

Multiparty Byte Agent

Downloadable research checkpoint

Dialogue represented as a room of peer agents, with explicit speaker, addressee, audience, and participant registry. A 127.6M Transformer dialogue experiment.

These are small experimental models. Outputs can be incorrect, repetitive, or malformed. Training and within-run metrics are documented on each model card; they should not be compared across different corpora or evaluation protocols.

Research lineage, preserved

Raw checkpoint archives preserve experiments and provenance. Supported inference releases are identified separately.

Browse archives ↗