Correctness: why is the result wrong?Reducesmall reproducerComparevs CPU referenceWalk the stackfind divergenceReplayat the contractFix+ regression testPerformance: where did the time go?Boundthe timed regionSplitkernel vs DMACompareto compiler idealAttributebytes per levelRe-measureone change a runPyTorchprogramFXgraphLoop /tiled IRLayout,work splitOpSpeccontractBackendcompileRuntime,DMADeviceexecutionfrontendbackendFirst divergenceCompiler and runtime stack