One vocabulary, four sequence formats

Halcyon is a single decoder-only Transformer trained with next-token prediction over text and image tokens.

Joint vocabulary · 80,640 tokens

A black and white dog sitting on concrete, looking up