context

Part 133

ctx:discord/blah/general/part-133

kind: custommode: permissive152 statements21 distinct subjects

No external document is attached to this context. (Many contexts are pure organisational labels.)

Facts in this context

Grouped by subject. Each subject links to its full article.

Engine Metrics Report 114 facts`ex:engine-metrics-report-1`

hasAvgGenerationThroughput	41
hasAvgPromptThroughput	27.5
hasConstantGpuKvCacheUsage	Engine Metrics Report 5
hasConstantPrefixCacheHitRate	Engine Metrics Report 5
hasConstantRunningRequests	Engine Metrics Report 5
hasConstantWaitingRequests	Engine Metrics Report 5
hasGpuKvCacheUsage	1.9
hasPrefixCacheHitRate	0
hasRunningRequests	1
hasWaitingRequests	0
loggedBy	Apiserver Pid 1
occurredAt	04-15 22:53:57
originatesFromFileLine	loggers.py:259
reportsFor	Engine 000

Specdec Metrics Report 113 facts`ex:specdec-metrics-report-1`

hasAcceptedThroughput	0.92
hasAcceptedTokens	258
hasAvgDraftAcceptanceRate	86
hasDraftedThroughput	1.07
hasDraftedTokens	300
hasMeanAcceptanceLength	2.72
hasPerPositionAcceptanceRatePosition1	0.913
hasPerPositionAcceptanceRatePosition2	0.807
indicatesSpecDecodingEnabled	Engine 000
loggedBy	Apiserver Pid 1
occurredAt	04-15 22:53:57
originatesFromFileLine	metrics.py:101
showsHighAcceptanceRate	86

Engine Metrics Report 211 facts`ex:engine-metrics-report-2`

hasAvgGenerationThroughput	45.3
hasAvgPromptThroughput	0
hasGpuKvCacheUsage	1.9
hasPrefixCacheHitRate	0
hasRunningRequests	1
hasWaitingRequests	0
loggedBy	Apiserver Pid 1
occurredAt	04-15 22:54:07
originatesFromFileLine	loggers.py:259
reportsFor	Engine 000
temporallyFollows	Engine Metrics Report 1

Engine Metrics Report 311 facts`ex:engine-metrics-report-3`

hasAvgGenerationThroughput	47.8
hasAvgPromptThroughput	0
hasGpuKvCacheUsage	1.9
hasPrefixCacheHitRate	0
hasRunningRequests	1
hasWaitingRequests	0
loggedBy	Apiserver Pid 1
occurredAt	04-15 22:54:17
originatesFromFileLine	loggers.py:259
reportsFor	Engine 000
temporallyFollows	Engine Metrics Report 2

Engine Metrics Report 411 facts`ex:engine-metrics-report-4`

hasAvgGenerationThroughput	46
hasAvgPromptThroughput	33.5
hasGpuKvCacheUsage	1.9
hasPrefixCacheHitRate	0
hasRunningRequests	1
hasWaitingRequests	0
loggedBy	Apiserver Pid 1
occurredAt	04-15 22:54:27
originatesFromFileLine	loggers.py:259
reportsFor	Engine 000
temporallyFollows	Engine Metrics Report 3

Engine Metrics Report 511 facts`ex:engine-metrics-report-5`

hasAvgGenerationThroughput	44.5
hasAvgPromptThroughput	0
hasGpuKvCacheUsage	1.9
hasPrefixCacheHitRate	0
hasRunningRequests	1
hasWaitingRequests	0
loggedBy	Apiserver Pid 1
occurredAt	04-15 22:54:37
originatesFromFileLine	loggers.py:259
reportsFor	Engine 000
temporallyFollows	Engine Metrics Report 4

Specdec Metrics Report 211 facts`ex:specdec-metrics-report-2`

hasAcceptedThroughput	27.7
hasAcceptedTokens	277
hasAvgDraftAcceptanceRate	78.7
hasDraftedThroughput	35.2
hasDraftedTokens	352
hasMeanAcceptanceLength	2.57
hasPerPositionAcceptanceRatePosition1	0.869
hasPerPositionAcceptanceRatePosition2	0.705
loggedBy	Apiserver Pid 1
occurredAt	04-15 22:54:07
originatesFromFileLine	metrics.py:101

Specdec Metrics Report 311 facts`ex:specdec-metrics-report-3`

hasAcceptedThroughput	30.1
hasAcceptedTokens	301
hasAvgDraftAcceptanceRate	85
hasDraftedThroughput	35.4
hasDraftedTokens	354
hasMeanAcceptanceLength	2.7
hasPerPositionAcceptanceRatePosition1	0.915
hasPerPositionAcceptanceRatePosition2	0.785
loggedBy	Apiserver Pid 1
occurredAt	04-15 22:54:17
originatesFromFileLine	metrics.py:101

Specdec Metrics Report 411 facts`ex:specdec-metrics-report-4`

hasAcceptedThroughput	29.2
hasAcceptedTokens	292
hasAvgDraftAcceptanceRate	86.9
hasDraftedThroughput	33.6
hasDraftedTokens	336
hasMeanAcceptanceLength	2.74
hasPerPositionAcceptanceRatePosition1	0.905
hasPerPositionAcceptanceRatePosition2	0.833
loggedBy	Apiserver Pid 1
occurredAt	04-15 22:54:27
originatesFromFileLine	metrics.py:101

Specdec Metrics Report 511 facts`ex:specdec-metrics-report-5`

hasAcceptedThroughput	27
hasAcceptedTokens	270
hasAvgDraftAcceptanceRate	77.1
hasDraftedThroughput	35
hasDraftedTokens	350
hasMeanAcceptanceLength	2.54
hasPerPositionAcceptanceRatePosition1	0.851
hasPerPositionAcceptanceRatePosition2	0.691
loggedBy	Apiserver Pid 1
occurredAt	04-15 22:54:37
originatesFromFileLine	metrics.py:101

Http Log Entry9 facts`ex:http-log-entry`

indicatesSuccessfulRequest	200
loggedBy	Apiserver Pid 1
occurredAfter	Engine Metrics Report 3
reportsEndpoint	/v1/chat/completions
reportsHttpMethod	POST
reportsHttpVersion	HTTP/1.1
reportsRequestFrom	Ip 192 168 0 246 Port 57923
reportsStatusCode	200
reportsStatusMessage	OK

Girvo8 facts`ex:girvo`

authoredMessage	First Message
authoredMessage	Second Message
claimsPerformanceImprovementWithPi	Mtp 2
describesMemoryBandwidthAsRough	The Machine
expressesEnthusiasmFor	Mtp 2
impliesBandwidthNotLimitingFactor	Mtp 2
performsBenchmarking	Mtp 2
reportsObservedThroughputMatchesLogs	Engine Metrics Report 1

Second Message4 facts`ex:second-message`

containsText	And with Pi connected its even better!
hasAttachment	Image Png
occurredAt	2026-04-15T23:06:00
referencesPreviousMessage	First Message

Engine 0003 facts`ex:engine-000`

exhibitsGenerationThroughputImprovement	Engine Metrics Report 1
isAssociatedWith	Mtp 2
utilizesSpeculativeDecoding	Specdec Metrics Report 1

The Machine3 facts`ex:the-machine`

hasMemoryBandwidth	280
hasRoughPerformanceExpectation	Girvo
hosts	Apiserver Pid 1

Apiserver Pid 12 facts`ex:apiserver-pid-1`

handlesChatCompletionsRequest	Http Log Entry
isProcessId	1

First Message2 facts`ex:first-message`

containsText	MTP: 2 is great, getting ~40tk/s despite this machine having kind of rough memory bandwidth (only 280GB/s)
occurredAt	2026-04-15T22:59:00

Mtp 22 facts`ex:mtp-2`

achievesGenerationThroughputApproximately	40
describedAsGreat	Girvo

Pi Device2 facts`ex:pi-device`

enhancesPerformance	Mtp 2
isConnectedTo	The Machine

Image Png1 fact`ex:image-png`

depictsImprovedPerformance

Mtp 2

Ip 192 168 0 246 Port 579231 fact`ex:ip-192-168-0-246-port-57923`

isLocalNetworkAddress

The Machine

Part 133

Facts in this context

Engine Metrics Report 114 factsex:engine-metrics-report-1

Specdec Metrics Report 113 factsex:specdec-metrics-report-1

Engine Metrics Report 211 factsex:engine-metrics-report-2

Engine Metrics Report 311 factsex:engine-metrics-report-3

Engine Metrics Report 411 factsex:engine-metrics-report-4

Engine Metrics Report 511 factsex:engine-metrics-report-5

Specdec Metrics Report 211 factsex:specdec-metrics-report-2

Specdec Metrics Report 311 factsex:specdec-metrics-report-3

Specdec Metrics Report 411 factsex:specdec-metrics-report-4

Specdec Metrics Report 511 factsex:specdec-metrics-report-5

Http Log Entry9 factsex:http-log-entry

Girvo8 factsex:girvo

Second Message4 factsex:second-message

Engine 0003 factsex:engine-000

The Machine3 factsex:the-machine

Apiserver Pid 12 factsex:apiserver-pid-1

First Message2 factsex:first-message

Mtp 22 factsex:mtp-2

Pi Device2 factsex:pi-device

Image Png1 factex:image-png

Ip 192 168 0 246 Port 579231 factex:ip-192-168-0-246-port-57923