Dontopedia

robots.txt

From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-06-06.)

robots.txt has 24 facts recorded in Dontopedia across 13 references, with 1 live disagreement.

24 facts·21 predicates·13 sources·1 in dispute

Mostly:has rules matched(2), is allowed(2), is standard for(1)

Maturity scale raw canonical shape-checked rule-derived certified

Inbound mentions (15)

Other subjects in dontopedia point AT this entity as a value. These are inverse relationships — e.g. "X motherOf this subject" — and answer questions the forward facts can't. Grouped by predicate.

respectsRespects(2)

causedByCaused by(1)

compliesWithComplies With(1)

containsRobotsTxtDataContains Robots Txt Data(1)

hasRestrictionHas Restriction(1)

hasRobotsTxtDataHas Robots Txt Data(1)

impliesEthicalComplianceImplies Ethical Compliance(1)

mentionsMentions(1)

policyCompliantPolicy Compliant(1)

requestedComplianceWithRequested Compliance With(1)

requiresComplianceWithRequires Compliance With(1)

respectsPolicyRespects Policy(1)

usesRobotsTxtUses Robots Txt(1)

wasCompliantWithWas Compliant With(1)

Other facts (23)

The long tail: predicates that appear too rarely to warrant their own section. Filter or scroll to find a specific one. Each row links to its source.

23 facts
PredicateValueRef
Has Rules Matched["Default: Allow (no matching rules)"][7]
Has Rules MatchedDefault: Allow (no matching rules)[9]
Is Allowedtrue[7]
Is Allowedtrue[9]
Is Standard forweb scraping rules[1]
Defines Policies forsite access[1]
Referenced inGithub Issue Url Lookup Tool[2]
Is Web StandardCompliance[3]
Normatively Authoritativetrue[4]
Cultural StandardWeb Crawling Ethics[4]
ProhibitsDirect Fetching[5]
Permits CrawlingTrue[6]
Has NoteThis fetch respects robots.txt. Some resources may be omitted if disallowed by the site's robots.txt rules.[7]
Permits FetchWeb Fetch Invocation[8]
Lacks Matching Rulestrue[8]
Default Allow Rule Appliedtrue[9]
Has Respect NoteThis fetch respects robots.txt. Some resources may be omitted if disallowed by the site's robots.txt rules.[9]
Part of Fetch ResultFetch Result[9]
Rules MatchedDefault: Allow (no matching rules)[10]
Allowed Truetrue[10]
Respects Robots Txttrue[10]
Allowedtrue[12]
Allows AccessAllow True[13]

Timeline

Timeline axis is valid_time — when each source says the fact was true in the world, not when Dontopedia learned about it. Retracted rows are kept for provenance; coloured stripes indicate the context kind.

24 undated
—
isStandardForblah/omega/part-7
web scraping rules
—
definesPoliciesForblah/omega/part-7
site access
—
referencedInblah/omega/part-9
ex:github-issue-url-lookup-tool
—
isWebStandardblah/omega/part-76
ex:compliance
—
normativelyAuthoritativeblah/omega/part-126
true
—
culturalStandardblah/omega/part-126
ex:web-crawling-ethics
—
prohibitsblah/omega/part-522
ex:direct-fetching
—
permitsCrawlingblah/omega/part-737
ex:true
—
hasNoteblah/omega/part-788
This fetch respects robots.txt. Some resources may be omitted if disallowed by the site's robots.txt rules.
—
hasRulesMatchedblah/omega/part-788
["Default: Allow (no matching rules)"]
—
isAllowedblah/omega/part-788
true
—
permitsFetchblah/omega/part-819
ex:web-fetch-invocation
—
lacksMatchingRulesblah/omega/part-819
true
—
hasRulesMatchedblah/omega/part-1056
Default: Allow (no matching rules)
—
defaultAllowRuleAppliedblah/omega/part-1056
true
—
hasRespectNoteblah/omega/part-1056
This fetch respects robots.txt. Some resources may be omitted if disallowed by the site's robots.txt rules.
—
partOfFetchResultblah/omega/part-1056
ex:fetch-result
—
isAllowedblah/omega/part-1056
true
—
rulesMatchedblah/omega/part-1182
Default: Allow (no matching rules)
—
allowedTrueblah/omega/part-1182
true
—
respectsRobotsTxtblah/omega/part-1182
true
—
labelblah/omega/7
robots.txt
—
allowedblah/omega/195
true
—
allowsAccessblah/omega/1173
ex:allow-true

References (13)

13 references
  1. [1]Part 72 facts
    ctx:discord/blah/omega/part-7
  2. [2]Part 91 fact
    ctx:discord/blah/omega/part-9
  3. [3]Part 761 fact
    ctx:discord/blah/omega/part-76
  4. [4]Part 1262 facts
    ctx:discord/blah/omega/part-126
  5. [5]Part 5221 fact
    ctx:discord/blah/omega/part-522
  6. [6]Part 7371 fact
    ctx:discord/blah/omega/part-737
  7. [7]Part 7883 facts
    ctx:discord/blah/omega/part-788
  8. [8]Part 8192 facts
    ctx:discord/blah/omega/part-819
  9. [9]Part 10565 facts
    ctx:discord/blah/omega/part-1056
  10. [10]Part 11823 facts
    ctx:discord/blah/omega/part-1182
  11. [11]71 fact
    ctx:discord/blah/omega/7
    • full textomega-7
      text/plain3 KBdoc:agent/omega-7/1794ae33-ecfc-4877-8642-7a55c1672b12
      Show excerpt
      [2025-11-14 16:32] omega [bot]: I've created the GitHub issue to give me the ability to look up URLs and retrieve their page contents. You can check it out [here](https://github.com/thomasdavis/omega/issues/13). If you have more ideas or ne…
  12. [12]1951 fact
    ctx:discord/blah/omega/195
    • full textomega-195
      text/plain3 KBdoc:agent/omega-195/c9eccb48-1c65-43ac-b1bd-9881b588b638
      Show excerpt
      [2025-11-20 13:25] omega [bot]: ✅ **Decision:** Respond | **Confidence:** 98% | **Reason:** AI: User directly addressed Omega with clear tasks (fetch URL and create a detailed issue for TypeScript TTS play-button integration). Per the conve…
  13. [13]11731 fact
    ctx:discord/blah/omega/1173
    • full textomega-1173
      text/plain2 KBdoc:agent/omega-1173/bf9200be-e1c6-4457-b4f8-83be397db330
      Show excerpt
      [2026-02-28 19:41] omega [bot]: 🔧 1/1: webFetch ✅ Success **Args:** ```json { "url": "https://git.unturf.com/engineering/unturf/uncloseai.com/-/blob/master/public/src/ago.js", "userAgent": "OmegaBot/1.0", "mode": "parsed", "maxRedir…

See also

Keep researching

Missing something or suspicious of what's here? Kick off a research session — a Claude agent will investigate, cite its sources, and file new facts into a dedicated context you can review before accepting into the shared view.

↑