Dontopedia

DoReMi

From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-06-06.)

DoReMi has 78 facts recorded in Dontopedia across 24 references, with 5 live disagreements.

78 facts·44 predicates·24 sources·5 in dispute

Mostly:has training step(18), uses dataset(6), processes dataset(6)

Maturity scale raw canonical shape-checked rule-derived certified

Has Training Stepin disputehasTrainingStep

Inbound mentions (15)

Other subjects in dontopedia point AT this entity as a value. These are inverse relationships — e.g. "X motherOf this subject" — and answer questions the forward facts can't. Grouped by predicate.

partOfRunPart of Run(2)

basedOnBased on(1)

capsDoReMiByDomainSizeCaps Do Re Mi by Domain Size(1)

combinesCombines(1)

concernsConcerns(1)

involvesFeatureInvolves Feature(1)

letsDoReMiReweightLets Do Re Mi Reweight(1)

mentionsSubjectMentions Subject(1)

reportsProgressOfReports Progress of(1)

restoredCleanlyRestored Cleanly(1)

restoredStateRestored State(1)

signalsHigherLossSignals Higher Loss(1)

usesMethodUses Method(1)

worksAsDesignedWorks As Designed(1)

Other facts (57)

The long tail: predicates that appear too rarely to warrant their own section. Filter or scroll to find a specific one. Each row links to its source.

57 facts
PredicateValueRef
Uses DatasetClassics Literature[17]
Uses DatasetGeneral Knowledge[17]
Uses DatasetPractical Texts[17]
Uses DatasetProfessional Benchmark[17]
Uses DatasetReference Web[17]
Uses DatasetSpeculative Fiction[17]
Processes DatasetGeneral Knowledge[24]
Processes DatasetReference Web[24]
Processes DatasetClassics Literature[24]
Processes DatasetProfessional Benchmark[24]
Processes DatasetPractical Texts[24]
Processes DatasetSpeculative Fiction[24]
Rdf:typeSoftware Component[20]
Rdf:typeTraining Module[21]
Rdf:typeAlgorithm[22]
Rdf:typeWeighting Algorithm[23]
Rdf:typeModel Run[24]
Is Known TechniqueCurriculum Training[1]
Included inItem 4[2]
Is Known Methodtrue[3]
Is Weight Update MethodDomain Adaptation[4]
References Optimization TechniqueDoremi Weights[5]
Bets on Domain Sensitivitynull[6]
Referenced in Contextnull[6]
Reweighted After Step1000[7]
Has Designed FunctionalityDataset Weighting[8]
Heavily Weighted on Hard Domainstrue[9]
Up Weights Harder Onestrue[10]
Creates Feedback Looptrue[10]
Presupposed As Training Methodtrue[10]
Deontically Required for Hard Domain Handlingtrue[10]
Sees More Per Domain Losstrue[10]
Restorable CleanlyTrue[11]
Causes Tiny Domain OverexposureTiny Domains[12]
Adaptive Weightingtrue[12]
Reweights DomainsDomains[12]
Is Integrated Componentnull[13]
Indicates Trend UpPoetry Dataset[14]
Indicates Trend DownSimple Educational Dataset[14]
Reacts toOverexposure[15]
Prioritizes Harder Datatrue[15]
Has Started LoweringProfessional Benchmark[15]
Correctly Adjusts Weightstrue[15]
References Domain Reweighting Methodprior technique[16]
Presupposes Existencetrue[16]
ComputesRaw Domain Weights[16]
Maintains Constant Learning Rate0.34[17]
Can UpweightHard Domains[18]
Handles Domain WeightingTrue[18]
Is Sampling MethodTrue[18]
Prediction Hypothesisdomain-sensitive AND fluent[19]
Can Upweight Hard Domainstrue[22]
Capable ofnoticing hard/noisy tiny domains[23]
Limited byExposure Governor[23]
Has Training Start Step1750[24]
Has Training End Step1920[24]
Uses Exposure GovernorSampling Weights After Exposure Governor[24]

Timeline

Timeline axis is valid_time — when each source says the fact was true in the world, not when Dontopedia learned about it. Retracted rows are kept for provenance; coloured stripes indicate the context kind.

isKnownTechniqueblah/watt-activation/part-634
ex:curriculum-training
includedInblah/watt-activation/part-640
ex:item-4
isKnownMethodblah/watt-activation/part-645
true
isWeightUpdateMethodblah/watt-activation/part-662
ex:domain-adaptation
referencesOptimizationTechniqueblah/watt-activation/part-668
ex:doremi-weights
betsOnDomainSensitivityblah/watt-activation/part-670
null
referencedInContextblah/watt-activation/part-670
null
reweightedAfterStepblah/watt-activation/part-680
1000
hasDesignedFunctionalityblah/watt-activation/part-682
ex:dataset-weighting
heavilyWeightedOnHardDomainsblah/watt-activation/part-687
true
upWeightsHarderOnesblah/watt-activation/part-686
true
createsFeedbackLoopblah/watt-activation/part-686
true
presupposedAsTrainingMethodblah/watt-activation/part-686
true
deonticallyRequiredForHardDomainHandlingblah/watt-activation/part-686
true
seesMorePerDomainLossblah/watt-activation/part-686
true
restorableCleanlyblah/watt-activation/part-702
ex:true
causesTinyDomainOverexposureblah/watt-activation/part-703
ex:tiny-domains
adaptiveWeightingblah/watt-activation/part-703
true
reweightsDomainsblah/watt-activation/part-703
ex:domains
isIntegratedComponentblah/watt-activation/part-704
null
indicatesTrendUpblah/watt-activation/part-701
ex:poetry-dataset
indicatesTrendDownblah/watt-activation/part-701
ex:simple-educational-dataset
reactsToblah/watt-activation/part-705
ex:overexposure
prioritizesHarderDatablah/watt-activation/part-705
true
hasStartedLoweringblah/watt-activation/part-705
ex:professional_benchmark
correctlyAdjustsWeightsblah/watt-activation/part-705
true
referencesDomainReweightingMethodblah/watt-activation/part-707
prior technique
presupposesExistenceblah/watt-activation/part-707
true
computesblah/watt-activation/part-707
ex:raw-domain-weights
hasTrainingStepblah/watt-activation/part-711
ex:training-step-1900
hasTrainingStepblah/watt-activation/part-711
ex:step-1750
hasTrainingStepblah/watt-activation/part-711
ex:training-step-1760
hasTrainingStepblah/watt-activation/part-711
ex:training-step-1770
hasTrainingStepblah/watt-activation/part-711
ex:training-step-1780
hasTrainingStepblah/watt-activation/part-711
ex:training-step-1790
hasTrainingStepblah/watt-activation/part-711
ex:training-step-1800
hasTrainingStepblah/watt-activation/part-711
ex:training-step-1810
hasTrainingStepblah/watt-activation/part-711
ex:training-step-1820
hasTrainingStepblah/watt-activation/part-711
ex:training-step-1830
hasTrainingStepblah/watt-activation/part-711
ex:training-step-1840
hasTrainingStepblah/watt-activation/part-711
ex:training-step-1850
hasTrainingStepblah/watt-activation/part-711
ex:training-step-1860
hasTrainingStepblah/watt-activation/part-711
ex:training-step-1870
hasTrainingStepblah/watt-activation/part-711
ex:training-step-1880
hasTrainingStepblah/watt-activation/part-711
ex:training-step-1890
hasTrainingStepblah/watt-activation/part-711
ex:training-step-1910
hasTrainingStepblah/watt-activation/part-711
ex:training-step-1920
maintainsConstantLearningRateblah/watt-activation/part-711
0.34
usesDatasetblah/watt-activation/part-711
ex:classics-literature
usesDatasetblah/watt-activation/part-711
ex:general-knowledge
usesDatasetblah/watt-activation/part-711
ex:practical-texts
usesDatasetblah/watt-activation/part-711
ex:professional-benchmark
usesDatasetblah/watt-activation/part-711
ex:reference-web
usesDatasetblah/watt-activation/part-711
ex:speculative-fiction
canUpweightblah/watt-activation/part-706
ex:hard-domains
handlesDomainWeightingblah/watt-activation/part-706
ex:true
isSamplingMethodblah/watt-activation/part-706
ex:true
predictionHypothesisblah/watt-activation/667
domain-sensitive AND fluent
typeblah/watt-activation/699
ex:SoftwareComponent
typeblah/watt-activation/698
ex:TrainingModule
labelblah/watt-activation/703
DoReMi
typeblah/watt-activation/703
ex:Algorithm
canUpweightHardDomainsblah/watt-activation/703
true
labelblah/watt-activation/706
DoReMi
typeblah/watt-activation/706
ex:WeightingAlgorithm
capableOfblah/watt-activation/706
noticing hard/noisy tiny domains
limitedByblah/watt-activation/706
ex:exposure-governor
typeblah/watt-activation/708
ex:ModelRun
labelblah/watt-activation/708
doremi
hasTrainingStartStepblah/watt-activation/708
1750
hasTrainingEndStepblah/watt-activation/708
1920
usesExposureGovernorblah/watt-activation/708
ex:sampling-weights-after-exposure-governor
processesDatasetblah/watt-activation/708
ex:general_knowledge
processesDatasetblah/watt-activation/708
ex:reference_web
processesDatasetblah/watt-activation/708
ex:classics_literature
processesDatasetblah/watt-activation/708
ex:professional_benchmark
processesDatasetblah/watt-activation/708
ex:practical_texts
processesDatasetblah/watt-activation/708
ex:speculative_fiction

References (24)

24 references
  1. [1]Part 6341 fact
    ctx:discord/blah/watt-activation/part-634
  2. [2]Part 6401 fact
    ctx:discord/blah/watt-activation/part-640
  3. [3]Part 6451 fact
    ctx:discord/blah/watt-activation/part-645
  4. [4]Part 6621 fact
    ctx:discord/blah/watt-activation/part-662
  5. [5]Part 6681 fact
    ctx:discord/blah/watt-activation/part-668
  6. [6]Part 6702 facts
    ctx:discord/blah/watt-activation/part-670
  7. [7]Part 6801 fact
    ctx:discord/blah/watt-activation/part-680
  8. [8]Part 6821 fact
    ctx:discord/blah/watt-activation/part-682
  9. [9]Part 6871 fact
    ctx:discord/blah/watt-activation/part-687
  10. [10]Part 6865 facts
    ctx:discord/blah/watt-activation/part-686
  11. [11]Part 7021 fact
    ctx:discord/blah/watt-activation/part-702
  12. [12]Part 7033 facts
    ctx:discord/blah/watt-activation/part-703
  13. [13]Part 7041 fact
    ctx:discord/blah/watt-activation/part-704
  14. [14]Part 7012 facts
    ctx:discord/blah/watt-activation/part-701
  15. [15]Part 7054 facts
    ctx:discord/blah/watt-activation/part-705
  16. [16]Part 7073 facts
    ctx:discord/blah/watt-activation/part-707
  17. [17]Part 71125 facts
    ctx:discord/blah/watt-activation/part-711
  18. [18]Part 7063 facts
    ctx:discord/blah/watt-activation/part-706
  19. [19]6671 fact
    ctx:discord/blah/watt-activation/667
  20. [20]6991 fact
    ctx:discord/blah/watt-activation/699
    • full textwatt-activation-699
      text/plain3 KBdoc:agent/watt-activation-699/23eaed18-1273-410e-98e4-c3f03fb91004
      Show excerpt
      [2026-05-01 05:43] xenonfun: ``` The universal shaft of the state was the most empty object in the next step. The explanatory phenomenon itself is associated with the physical-phenomenon of the two thin fibrosis residues of the theoretical
  21. [21]6981 fact
    ctx:discord/blah/watt-activation/698
    • full textwatt-activation-698
      text/plain3 KBdoc:agent/watt-activation-698/f8b43921-7946-4fa9-adc2-3852b2c781f2
      Show excerpt
      [2026-05-01 04:58] xenonfun: ``` Checked it out. My take: the handoff is strong and mostly accurate, but there are two path mismatches worth fixing. e23 training is healthy and still running. Latest metric I saw was step `4350 / 25000`, ab
  22. [22]7033 facts
    ctx:discord/blah/watt-activation/703
    • full textwatt-activation-703
      text/plain3 KBdoc:agent/watt-activation-703/c2aff1b4-7f23-419c-b531-687b267a9440
      Show excerpt
      [2026-05-01 20:40] xenonfun: 1K smoke finished and inference is done. Run: `/home/ms/data/clifford_ssm/checkpoints/e24_chinchilla_from_e23_best_prefetch_1k/latest.pt` Final training stats: - step `1000` - loss / BPB: `0.9332 / 1.3463` - t
  23. [23]7064 facts
    ctx:discord/blah/watt-activation/706
    • full textwatt-activation-706
      text/plain2 KBdoc:agent/watt-activation-706/6633be5c-fab3-495f-b5b5-8dadec7f0fbb
      Show excerpt
      [2026-05-01 23:01] xenonfun: Yes. The 5K gate run is launched and behaving well so far. Current run: `e24_chinchilla_latest_governed_5k` It is warm-started from e23 best with: - `B=20`, `T=2048` - updated Chinchilla dataset, `6,123,670` t
  24. [24]70811 facts
    ctx:discord/blah/watt-activation/708
    • full textwatt-activation-708
      text/plain1 KBdoc:agent/watt-activation-708/43ecf53f-d65d-4ffb-8caf-9d1e36a76aea
      Show excerpt
      [2026-05-02 01:01] xenonfun: ``` [doremi] step=1750 sampling weights after exposure governor ↑ general_knowledge w=0.162 raw=0.094 ema_loss=1.087 ↑ reference_web w=0.158 raw=0.091 ema_loss=1.059 ↑

See also

Keep researching

Missing something or suspicious of what's here? Kick off a research session — a Claude agent will investigate, cite its sources, and file new facts into a dedicated context you can review before accepting into the shared view.