Gadsby-4B: A Language Model Barred From Common Word Pairs Develops a Distinctive Voice
A 4-billion-parameter model, Gadsby-4B, was built by developer Erin by banning every two-word combination found in Simple Wikipedia. Derived from Google's Gemma 3 4B, it was first constrained during decoding and then fine-tuned on its own coherent outputs. The result is a model that writes in a casual, chat-style register, with misspellings and a noticeably informal personality. The project takes its name from Ernest Vincent Wright's 1939 novel Gadsby, written without the letter E, and draws on the constrained-writing tradition of the Oulipo group. The developer describes it as an experiment in how a model's voice changes when ordinary semantic patterns are removed.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)
Log in to join the discussion and vote.
Log in