source context

Part 365

ctx:discord/blah/watt-activation/part-365

kind: custommode: permissive83 statements42 distinct subjects

No external document is attached to this context. (Many contexts are pure organisational labels.)

Facts in this context

Grouped by subject. Each subject links to its full article.

Recv Bug Fix6 facts`ex:recv-bug-fix`

changed	U Right Equals Shift U Now
describedAs	correctness
improves	Correctness
locatedIn	Fast Path Recv Computation
matchesSemanticsOf	Propagate Causal
presupposesExistenceOf	Fast Path Recv Computation

Strict Norm6 facts`ex:strict-norm`

deemedUnnecessary	Below
makesNoDifference	Parity
noReasonToPrefer	Production
setTo	true
testedViaBenchmark
unnecessaryInProduction

Changes5 facts`ex:changes`

includesNext	Conv1d Default Fast Path
includesNext	Training Scripts Updated
includesNext	Conv1d Depthwise Propagation
includesNext	Normalization Finding
orderedSequentially	Recv Bug Fix

Conv1d Depthwise Propagation5 facts`ex:conv1d-depthwise-propagation`

deviatesFrom	Shift Path
hasParityDeviation	2e-7
maintainsParity	Shift Path
replaced	Concat Shift Plus Kappa U Right Minus U Now Plus 2 Gamma U Now
uses	Mx Conv1d Groups C

Summary4 facts`ex:summary`

listsActions	Changes
postedTwice	2026-03-17 21:21
providesSummaryOf	Done Actions
timestamped	2026-03-17 21:21

Build Fast Forward3 facts`ex:build-fast-forward`

hasParam	propagation=conv1d
hasParam	dtype=mx.bfloat16
hasParam	model

Config D24 D3843 facts`ex:config-d24-d384`

baselineTokensPerSecond	86K
fastConv1dBf16TokensPerSecond	105K
speedup	1.23×

Config D24 D7683 facts`ex:config-d24-d768`

baselineTokensPerSecond	77K
fastConv1dBf16TokensPerSecond	88K
speedup	1.14×

Config D48 D3843 facts`ex:config-d48-d384`

baselineTokensPerSecond	43K
fastConv1dBf16TokensPerSecond	52K
speedup	1.22×

Conv1d3 facts`ex:conv1d`

assumesMxFramework
isDefault	Fast Path
preferredOver	Shift

Gap3 facts`ex:gap`

causedBy	Code Path Structure Difference
compoundsFrom	Different Code Path Structure
notFrom	Rsqrt Vs Sqrt Div

Kernel3 facts`ex:kernel`

builtFrom	Physics Params
hasValue	[κ, 2-γ-κ]
reusedFor	K Steps

Benchmark2 facts`ex:benchmark`

demonstrates	Speedup
showed	Strict Norm Zero Difference to Parity

Benchmark Results2 facts`ex:benchmark-results`

forRegime	Thin Deep
presentedInTable

Propagation2 facts`ex:propagation`

hasLegacyFallback	shift
hasOption	conv1d

Propagation Conv1d2 facts`ex:propagation-conv1d`

enablesSpeedup	Benchmark Results
resultsIn	Fewer Metal Dispatches

Train Antenna Py2 facts`ex:train-antenna-py`

acceptsFlag	Compiled
updated	Training Scripts

Xenonfun2 facts`ex:xenonfun`

informsAudience	Changes
posted	Summary

Backward Compat Aliases1 fact`ex:backward-compat-aliases`

preservedFor

Imports

Bfloat161 fact`ex:bfloat16`

usedIn

Fast Forward

Bug Fix1 fact`ex:bug-fix`

restoresOriginalSemantics

Compiled1 fact`ex:--compiled`

uses	Build Fast Forward

Curriculum Handling1 fact`ex:curriculum-handling`

preserved

Fast Conv1d Bf161 fact`ex:fast-conv1d-bf16`

speedupOverBaseline

~1.2x

Fast Path1 fact`ex:fast-path`

optimizedForSpeed

Fast Path Variants1 fact`ex:fast-path-variants`

show	Identical Max Delta Vs Baseline

Fp321 fact`ex:fp32`

usedIn

Deviation Measure

Kernel Reuse1 fact`ex:kernel-reuse`

optimizesPerformance

Metal Dispatches1 fact`ex:metal-dispatches`

reducedBy

Conv1d

Mx Conv1d Groups C1 fact`ex:mx-conv1d-groups-c`

calledPer

Propagation Step

Nan Guards1 fact`ex:nan-guards`

preserved

Original Forward1 fact`ex:original-forward`

provides

Unbiased Metrics

Production1 fact`ex:production`

avoidsStrictNorm

Propagate Causal1 fact`ex:_propagate_causal`

computes

Spatial Gradient

Spatial Gradient1 fact`ex:spatial-gradient`

computedOn

Field Input to Last Propagation

Thin Deep1 fact`ex:thin-deep`

describedAs

best regime

Thin Deep Regime1 fact`ex:thin-deep-regime`

evaluatedAsBest

Train Antenna Long Py1 fact`ex:train-antenna-long-py`

updated

Training Scripts

Training Scripts1 fact`ex:training-scripts`

supportsCompiledMode

Unbiased Metrics1 fact`ex:unbiased-metrics`

achievedBy

Original Forward

U Right Equals Shift U Now1 fact`ex:u-right-equals-shift-u-now`

replacedBy

U Right Equals Shift U Prev

Validation1 fact`ex:validation`

uses	Original Forward

Part 365

Facts in this context

Recv Bug Fix6 factsex:recv-bug-fix

Strict Norm6 factsex:strict-norm

Changes5 factsex:changes

Conv1d Depthwise Propagation5 factsex:conv1d-depthwise-propagation

Summary4 factsex:summary

Build Fast Forward3 factsex:build-fast-forward

Config D24 D3843 factsex:config-d24-d384

Config D24 D7683 factsex:config-d24-d768

Config D48 D3843 factsex:config-d48-d384

Conv1d3 factsex:conv1d

Gap3 factsex:gap

Kernel3 factsex:kernel

Benchmark2 factsex:benchmark

Benchmark Results2 factsex:benchmark-results

Propagation2 factsex:propagation

Propagation Conv1d2 factsex:propagation-conv1d

Train Antenna Py2 factsex:train-antenna-py

Xenonfun2 factsex:xenonfun

Backward Compat Aliases1 factex:backward-compat-aliases

Bfloat161 factex:bfloat16

Bug Fix1 factex:bug-fix

Compiled1 factex:--compiled

Curriculum Handling1 factex:curriculum-handling

Fast Conv1d Bf161 factex:fast-conv1d-bf16

Fast Path1 factex:fast-path

Fast Path Variants1 factex:fast-path-variants

Fp321 factex:fp32

Kernel Reuse1 factex:kernel-reuse

Metal Dispatches1 factex:metal-dispatches

Mx Conv1d Groups C1 factex:mx-conv1d-groups-c

Nan Guards1 factex:nan-guards

Original Forward1 factex:original-forward

Production1 factex:production

Propagate Causal1 factex:_propagate_causal

Spatial Gradient1 factex:spatial-gradient

Thin Deep1 factex:thin-deep

Thin Deep Regime1 factex:thin-deep-regime

Train Antenna Long Py1 factex:train-antenna-long-py

Training Scripts1 factex:training-scripts

Unbiased Metrics1 factex:unbiased-metrics

U Right Equals Shift U Now1 factex:u-right-equals-shift-u-now

Validation1 factex:validation