Chunk Mask
From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-06-09.)
Chunk Mask has 11 facts recorded in Dontopedia across 4 references, with 2 live disagreements.
Mostly:extracted from(2), rdf:type(2), receives(1)
From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-06-09.)
Chunk Mask has 11 facts recorded in Dontopedia across 4 references, with 2 live disagreements.
Mostly:extracted from(2), rdf:type(2), receives(1)
slicedFromindexedFromderivedFromrdfs:labelextractedViaOther subjects in dontopedia point AT this entity as a value. These are inverse relationships — e.g. “X motherOf this subject” — and answer questions the forward facts can't. Grouped by predicate.
assignsAssigns(1)ex:chunkingLoopconstructedFromConstructed From(1)ex:tuplecontainsContains(1)ex:tuplederivedFromDerived From(1)ex:attention_maskrequiresRequires(1)ex:chunk_processing_stepslicesSlices(1)ex:segment-methodunpacksUnpacks(1)ex:segmentTimeline axis is valid_time — when each source says the fact was true in the world, not when Dontopedia learned about it. Retracted rows are kept for provenance; coloured stripes indicate the context kind.
doc:beam/e30c9b5a-0f4a-42ec-a48a-5900c9820befself.tokenizer = AutoTokenizer.from_pretrained(model_name) self.max_tokens = max_tokens self.cache = OrderedDict() # Using OrderedDict to maintain LRU behavior self.logger = logging.getLogger(__name__) …
doc:beam/569b322c-a60c-41e9-bdbf-4a38fed922cbhandler.setFormatter(formatter) self.logger.addHandler(handler) def segment(self, input_text): # Tokenize input text inputs = self.tokenizer(input_text, return_tensors='pt', truncation=True, max_length=s…
Dontopedia is in a read-only public launch. Follow the references and disputed branches now; contributions will open after durable identity and moderation are in place.