Memorilla: Latent Semantic Memory for LLMs

github.com

6 points by tomislavpet a day ago


tomislavpet - a day ago

Memorilla, a memory system that gathers information from an entire document collection into a fixed number of query-dependent memory tokens for a frozen LLM.