Causal Volterra Dynamics of Mamba

Transformers admit continuum descriptions based on mean-field interactions, but selective state space models fall into a different class. We show that the many-token limit of an input-conditioned, single-head SISO Mamba-3 block is a \emph{causal Volterra equation} on the sphere with an explicit exponential memory kernel. The key reason is that Mamba's causal mask is chain-dependent: the influence of one token on another is transmitted through the full sequence of intermediate gates rather than a single pairwise weight. Under a constant-horizon scaling, we prove convergence to this limit, validate it numerically, and show that the same framework covers the SISO Mamba-3 rotation, with Mamba-2 as a special case. We also characterize the resulting memory-horizon interpolation and relate the kernel scale to pretrained Mamba-2 heads.