Deep Learning/ML (Review)1 HiPPO / Structured State Space sequence model (S4) Based on the talk HiPPO: Recurrent Memory with Optimal Polynomial ProjectionsTL;DR: Proposes a structured matrix that compresses the history.BackgroundChallenge: Continuous data which isGenerated from underlying continuous physical process (i.e. signal)Require long range contexte.g. Most method (attention / convolution) cannot perform EMA because of limited context window!→ Can we compress the .. 2024. 7. 11. 이전 1 다음
