Batch Size 16
From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-07-18.)
Batch Size 16 has 3 facts recorded in Dontopedia across 1 reference.
3 facts·3 predicates·1 sources
From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-07-18.)
Batch Size 16 has 3 facts recorded in Dontopedia across 1 reference.
rdf:typeRdf:type(1)ex:batch-size-16relatedToBatchSizeRelated to Batch Size(1)ex:tokens-per-stepTimeline axis is valid_time — when each source says the fact was true in the world, not when Dontopedia learned about it. Retracted rows are kept for provenance; coloured stripes indicate the context kind.
discord:convmsg/11763xenonfun: ``` At step 2K with batch=16 and seq_len=256: - Tokens per step: 16 × 256 = 4,096 - Total tokens through 2K steps: 2,000 × 4,096 = 8,192,000 tokens = ~8.2 MB of data The training corpus was 35 MB total, so at step 2K…
Dontopedia is in a read-only public launch. Follow the references and disputed branches now; contributions will open after durable identity and moderation are in place.