A phone-sized model, built from nothing on one desk
In progressSept 2026Qwen 4-class MoE · iPhone Air
A mixture-of-experts language model with the Qwen3.8-Flash-Next architecture family (Gated DeltaNet and sparse attention, gated residual, an n-gram table, a multi-token-prediction head), sized to the iPhone Air's 2.5 GB safe memory tier, started from random weights, taught by distillation from Qwen3.8 27B, with DSpark and MTP speculation measured on the phone with reasoning on. Every decision pre-registered; the journal is the deliverable.
Follow the journal →
Governed AI-agent platform
Production202633 client organizations
Technicians build and run AI agents against real business systems under tiered least-privilege skills. A person approves every operation before the agent runs unattended; a supervising agent halts anything outside the approved plan. Five inference tiers under U.S.-residency rules; every call attributed for cost. 3,277 automated tests.
Architecture and security posture →
Melon Code: a Claude-Code-class agent on a local model
Daily use2026TypeScript · llama.cpp · NVIDIA NIM
The full coding-agent loop, with tools, a four-mode permission engine, subagents, compaction, and rewind, driving a 284-billion-parameter model on one workstation. An Anthropic-compatible endpoint lets Claude Code itself run on local or hosted open models. KV-cache prefix work cut a warm turn from 36 seconds to 1.3.
What was built and measured →
Local inference at the edge of one GPU
Research2026284B mixture-of-experts · RTX 4090
Decode raised from 7.3 to about 20 tokens per second at a stated fidelity floor. Three speculative-decoding routes (a DSpark confidence-scheduled drafter, a multi-token-prediction head, DFlash) each closed with numbers from derived break-even math; the DSpark paper's prefix-survival gate implemented in llama.cpp for a measured 7.1% gain. 190+ journal entries, pre-registered decisions.
The research list →
MelonStudio: splitting a model across GPU and CPU by hand
Complete · negative result2025–26C# · ONNX Runtime GenAI
ONNX Runtime won't offload layers the way llama.cpp does, so this built it: graph partitioning at layer boundaries, two orchestrated sessions, pinned memory, a stateful KV cache. Measured honestly (4.4 tokens per second hybrid against 93 GPU-only), the result was to stop and move to llama.cpp.
Design, benchmarks, and the negative result →
County AI and AI-governance roadmap
In progress2026Georgia county government
Working alongside a county IT and network team on systems, network, and security operations while helping them write an AI roadmap they can actually follow: where sensitive data is exposed today, tiered guardrails, and the staff-augmentation uses worth doing first.
Ask about this engagement →
Engineering with people and agents
In daily use2026process + ledger
The written operating model behind the platform: audit-first work packets, isolated worktrees, worker, verifier, and adversarial-reviewer roles, a test gate on every pull request, and a reservation ledger so concurrent agent sessions share one machine without collisions.
The process, and the ledger's source →