We propose the Structured State Space sequence model (S4) based on a new parameterization for the SSM, and show that it can be computed much more efficiently than prior approaches while preserving their theoretical strengths. Our technique involves conditioning A with a low-rank correction, ...
Yin1∗1 University of Manchester 2 Mettler Toledo Safeline† Joint First Author ∗ Project LeadAbstractStructured State Space Models (SSMs) have emerged ascompelling alternatives to Transformer architectures, of-fering linear-time complexity and superior performance invarious sequence modeling tasks. ...