We propose a non-autonomous architecture where each block is derived from a time-invariant non-autonomous dynamical system. Each block is asymptotically stable and can be unrolled indefinitely upon convergence to an input-dependent attractor.