{"author":"roseway4","children":[{"author":"williamstein","children":[{"author":"roseway4","children":[{"author":"williamstein","children":[],"created_at":"2023-05-11T17:48:31.000Z","created_at_i":1683827311,"id":35905659,"options":[],"parent_id":35901600,"points":null,"story_id":35889826,"text":"Thanks for the clarification about what makes Zep unique.  Very cool!","title":null,"type":"comment","url":null}],"created_at":"2023-05-11T13:18:46.000Z","created_at_i":1683811126,"id":35901600,"options":[],"parent_id":35895749,"points":null,"story_id":35889826,"text":"Many of the &quot;long-term memory&quot; services focus on vector search over a corpus of documents to offer the LLM domain context. Where Zep is different, is we focus on the conversation history, offering the stateless LLM a long-term state component (alongside enriching the message history with summaries, metadata, token counts etc).","title":null,"type":"comment","url":null}],"created_at":"2023-05-11T00:43:26.000Z","created_at_i":1683765806,"id":35895749,"options":[],"parent_id":35889826,"points":null,"story_id":35889826,"text":"I can&#x27;t believe how many distinct &quot;longterm memory for LLM&quot; libraries have launched in the last month or so!  It&#x27;s intense.","title":null,"type":"comment","url":null}],"created_at":"2023-05-10T16:40:20.000Z","created_at_i":1683736820,"id":35889826,"options":[],"parent_id":null,"points":7,"story_id":35889826,"text":"Zep is a long-term memory store designed for conversational AI applications built using modern LLMs. It handles the storage, summarization, embedding, indexing, and enrichment of chat histories, and offers developers a simple, low-latency API to this data. Chat history storage is an infrastructure challenge all developers and enterprises face as they look to move from prototypes to deploying conversational AI applications that provide rich and intimate experiences to users.<p>Key features include long-term memory persistence, auto-summarization, vector search, auto-token counting, and Python and JavaScript SDKs. Upcoming features include Langchain Memory and Retrievers, integrations with other conversational AI frameworks, entity extraction, and much more.<p>Github repo: https:&#x2F;&#x2F;github.com&#x2F;getzep&#x2F;zep<p>Long-term memory persistence enables a variety of use cases, including:<p>- Personalized re-engagement of users based on their chat history.<p>- Prompt evaluation based on historical data.<p>- Training of new models and evaluation of existing models.<p>- Analysis of historical data to understand user behavior and preferences.<p>However:<p>- Most AI chat history or memory implementations run in-memory and are not designed for stateless deployments or long-term persistence.<p>- Standing up and managing low-latency infrastructure to store, manage, and enrich memories is non-trivial.<p>- When storing messages long-term, developers are exposed to privacy and regulatory obligations around PII, retention, and deletion of user data.<p>Zep aims to solve these challenges.<p>Zep and its Python and Javascript client libraries have been open-sourced under the Apache License.<p>Learn more and contribute:<p>- Zep server: https:&#x2F;&#x2F;github.com&#x2F;getzep&#x2F;zep<p>- Python SDK: https:&#x2F;&#x2F;github.com&#x2F;getzep&#x2F;zep-python<p>- Javascript SDK: https:&#x2F;&#x2F;github.com&#x2F;getzep&#x2F;zep-js<p>Daniel &amp; Sharath","title":"Show HN: Zep \u2013 Long-Term Memory Store for LLM Apps","type":"story","url":null}