Knowledge & Context

Retrieval, memory, indexing, knowledge organization, and data connectivity.

102Projects6Subcategory78Tags
TrackedUnavailableArchivedInactive

Memory layers, context compression, and state management for AI systems.

Acontext

A context data platform for self-learning agents to store, observe, and distill experiences.

Stars --Last Commit --

Agentic Context Engine

Agentic Context Engine (ACE) is a framework and implementation for enabling agents to learn from experience through structured context engineering.

Stars --Last Commit --

AgentMemory

Persistent memory layer for AI coding agents, enabling cross-session context retention based on real-world benchmarks.

Stars --Last Commit --

Basic Memory

A local-first knowledge-as-Markdown system that lets LLMs read and write your memory via the Model Context Protocol (MCP).

Stars --Last Commit --

Claude Mem

A Claude Code plugin that captures coding-session context, compresses it with AI, and injects relevant memory into future sessions.

Stars --Last Commit --

cognee

Open-source AI memory platform that gives agents persistent long-term memory across sessions, backed by a self-hosted knowledge graph engine.

Stars --Last Commit --

Dexio

Dexio is a wiki that AI agents read and write over MCP, so several agents on different machines share one set of linked markdown pages instead of each keeping its own notes. Every change is recorded with the agent and the person behind it, writes can require the version last read so agents never silently overwrite each other, and a web app shows the link graph, every page, and its full history. Self-hostable from one Docker Compose file or available hosted.

Stars --Last Commit --

headroom

A context compression layer that shrinks tool outputs, logs, files, RAG chunks, and conversation history before they reach the LLM — 20% fewer tokens for coding agents, 60–95% fewer for JSON, same answers. Library, proxy, and MCP server.

Stars --Last Commit --

Letta

Platform for building stateful agents with advanced memory and self-improvement capabilities, supporting both local and cloud deployments.

Stars --Last Commit --

LocalRecall

LocalRecall provides a local memory layer and knowledge base management API for agents and RAG scenarios.

Stars --Last Commit --

Mem0

Mem0 is a scalable memory layer for AI agents that provides long-term, personalized, and efficient memory storage and retrieval.

Stars --Last Commit --

Memanto

An open-source memory layer for AI agents featuring a 7-layer memory architecture that supports short-term, long-term, and semantic memory with RAG-based retrieval.

Stars --Last Commit --

MemOS

MemOS is an open-source Memory OS that provides long-term memory capabilities for large language models (LLMs), improving context awareness and long-term consistency.

Stars --Last Commit --

mempalace

Local-first AI memory that stores conversation history verbatim and retrieves it with semantic search — 96.6% Recall@5 raw on LongMemEval with zero API calls — over a pluggable retrieval backend.

Stars --Last Commit --

MemT-1.0

MemT-1.0 is a memory foundation model family that makes persistent, dynamically evolving memory an intrinsic part of model computation, retaining and leveraging historical information without re-reading original context at inference.

Stars --Last Commit --

memU

memU is an open-source memory framework for AI companions, offering high accuracy, fast retrieval, and low cost for personalized AI experiences.

Stars --Last Commit --

OpenHuman

OpenHuman is an open-source personal AI super intelligence assistant focused on privacy, simplicity, and power, featuring 118+ third-party integrations, local memory trees, an Obsidian wiki, and native voice interaction.

Stars --Last Commit --

Supermemory

A high-performance, scalable memory engine and app providing a Memory API for storing, retrieving, and interacting with content in the AI era.

Stars --Last Commit --

TencentDB Agent Memory

Tencent's local long-term memory system for AI agents, powered by a 4-tier progressive pipeline with zero external API dependencies.

Stars --Last Commit --

Tree Ring Memory

A framework-agnostic, local-first memory lifecycle framework for AI agents with a Rust CLI, SQLite/FTS recall, forgetting, audit, consolidation, and multi-agent write coordination.

Stars --Last Commit --

Vector stores, ANN engines, and similarity search.

Deep Lake

A database for AI optimized for storing, querying and versioning vectors and multimodal data (images, video, audio, text) for LLM and deep learning workflows.

Stars --Last Commit --

Faiss

A high-performance library for similarity search and clustering of dense vectors, suitable for large-scale vector retrieval.

Stars --Last Commit --

Infinity

An AI-native database that delivers hybrid search over dense vectors, sparse vectors, tensors, full-text and structured data.

Stars --Last Commit --

Milvus

Milvus is a high-performance vector database designed for large-scale unstructured data processing.

Stars --Last Commit --

pgvector

pgvector is an open-source PostgreSQL extension that adds vector data types and similarity search, supporting exact and approximate search (HNSW, IVFFlat) inside Postgres.

Stars --Last Commit --

Qdrant

Discover Qdrant, a high-performance vector search engine that enhances similarity search and scalable deployment for efficient data retrieval.

Stars --Last Commit --

SeekDB

An AI-native search database that unifies vector, text, and structured data in a single engine to enable hybrid search and in-database AI workflows.

Stars --Last Commit --

sqlite-vector

Integrates embedding storage and vector search into SQLite, providing a cross-platform lightweight vector database extension.

Stars --Last Commit --

turbovec

An in-process vector index for Python and Rust built on Google Research's TurboQuant — 2 or 4 bits per dimension, searched directly with SIMD kernels: 7.8× smaller than float32 and up to 4.4× faster than FAISS at matching recall.

Stars --Last Commit --

Chunking, retrieval, reranking, and indexing pipelines.

Airweave

Airweave lets agents search any app by connecting to apps, productivity tools, databases and document stores and turning their contents into searchable knowledge bases.

Stars --Last Commit --

BISHENG

An open-source LLM DevOps platform for enterprise scenarios, offering workflows, RAG, model management and observability.

Stars --Last Commit --

Chroma

Chroma is an open-source embedding database for AI applications, enabling efficient search, storage, and retrieval for intelligent RAG systems.

Stars --Last Commit --

CocoIndex

A high-performance data processing and indexing framework for AI, supporting incremental processing and semantic indexing.

Stars --Last Commit --

DB-GPT

DB-GPT is an open-source framework focused on data-native applications, integrating RAG, Text2SQL, and multi-backend adapters to simplify building intelligent database-driven apps.

Stars --Last Commit --

DocsGPT

An open-source enterprise document agent platform combining RAG and multi-model support to provide citation-backed answers.

Stars --Last Commit --

Embedding Atlas

A tool that provides interactive visualizations for large embeddings, allowing you to visualize, cross-filter, and search embeddings and metadata.

Stars --Last Commit --

FastGPT

Discover FastGPT: a powerful platform for seamless data processing and AI workflow orchestration, enabling easy development of advanced question-answering systems.

Stars --Last Commit --

FinGPT

Open-source financial large language models with data pipelines, instruction tuning datasets, benchmarks and RAG toolkits.

Stars --Last Commit --

Firecrawl

The Web Data API for AI that turns entire websites into clean markdown or structured data for RAG and knowledge pipelines.

Stars --Last Commit --

Generative AI on Google Cloud

Sample code and notebooks demonstrating how to build and deploy generative AI workflows on Vertex AI and Gemini.

Stars --Last Commit --

GraphRAG

Discover GraphRAG, an open-source project by Microsoft Research for extracting structured knowledge from text, enhancing retrieval and enabling advanced temporal queries.

Stars --Last Commit --

Haystack

Haystack is an open-source framework for building retrieval-augmented generation (RAG) and semantic search applications by combining document stores, vector search, and LLMs.

Stars --Last Commit --

Khoj

A self-hostable 'second brain' platform that turns web pages and documents into a searchable knowledge base and supports custom agents and automations.

Stars --Last Commit --

LanceDB

Developer-friendly, embedded retrieval engine for multimodal AI. Search More; Manage Less.

Stars --Last Commit --

LangChain

A framework for building LLM-powered applications with composable components and rich integrations.

Stars --Last Commit --

LangChain4j

An open-source Java library that provides a unified API for integrating large language models and vector databases into enterprise Java applications.

Stars --Last Commit --

LEANN

Discover LEANN, the innovative AI platform that transforms your laptop into a powerful semantic search tool with zero cloud costs and full privacy.

Stars --Last Commit --

LightRAG

LightRAG is a lightweight Retrieval-Augmented Generation toolkit that supports document indexing, graph extraction, and deployable server/core modes.

Stars --Last Commit --

LlamaFarm

LlamaFarm is an open-source platform for deploying AI models, agents, vector databases, and RAG pipelines locally or remotely in minutes.

Stars --Last Commit --

LlamaIndex

LlamaIndex is a data framework for LLM applications that helps structure and connect private data sources to models for retrieval-augmented generation.

Stars --Last Commit --

LocalGPT

A private, on-premise document intelligence platform that combines hybrid retrieval and multi-model inference while keeping all data local.

Stars --Last Commit --

Marker

Converts PDF, image, PPTX, DOCX, XLSX, HTML, EPUB files to markdown, JSON, chunks, and HTML quickly and accurately.

Stars --Last Commit --

Memori

An open-source SQL-native memory engine that provides persistent, queryable context for Large Language Models.

Stars --Last Commit --

Memvid

Encode millions of text chunks into portable MP4 files for millisecond semantic search and offline-first AI memory.

Stars --Last Commit --

mgrep

A CLI-native semantic search tool for code, documents and media, with background indexing and agent integrations.

Stars --Last Commit --

MineContext

MineContext is a proactive, context-aware AI partner combining Context-Engineering with ChatGPT Pulse to improve dialogue coherence and retrieval in RAG scenarios.

Stars --Last Commit --

OpenViking

OpenViking is an open-source context database for AI Agents that unifies memories, resources, and skills with a filesystem paradigm for hierarchical retrieval and observability.

Stars --Last Commit --

PageIndex

PageIndex (by Vectify AI) is an open-source reasoning-based document index designed for high-accuracy retrieval over long documents.

Stars --Last Commit --

PandaWiki

PandaWiki is an open-source knowledge base system driven by large models, enabling fast building of intelligent documentation, FAQ and blog centers.

Stars --Last Commit --

Pathway LLM App

Production-ready templates for RAG and AI pipelines that support live data synchronization and large-scale document indexing.

Stars --Last Commit --

Perplexica

Perplexica is an open source AI-powered search engine positioned as an alternative to Perplexity AI.

Stars --Last Commit --

RAG-Anything

A multimodal document processing and Retrieval-Augmented Generation (RAG) system supporting unified parsing and intelligent retrieval of text, images, tables, formulas, and more.

Stars --Last Commit --

RAGFlow

An open-source RAG engine based on deep document understanding, supporting complex document parsing and knowledge Q&A

Stars --Last Commit --

SearXNG

A free, privacy-preserving internet metasearch engine that aggregates results from multiple search services and databases without user tracking.

Stars --Last Commit --

SemTools

A command-line toolkit for semantic search, embedding generation, and document parsing for local and CI workflows.

Stars --Last Commit --

text-embeddings-inference

Hugging Face's text-embeddings-inference provides an out-of-the-box text vectorization inference service, making it easy to build similarity search and semantic search applications.

Stars --Last Commit --

Tongyi DeepResearch

An open research agent and toolset for long-horizon information-seeking and agentic tasks, developed by Tongyi Lab (Alibaba-NLP).

Stars --Last Commit --

UltraRAG

A low-code RAG framework based on MCP, emphasizing visual orchestration and reproducible evaluation workflows.

Stars --Last Commit --

Unstructured

An open-source ETL solution to convert complex documents into clean, structured formats for language-model workflows.

Stars --Last Commit --

Vanna

Vanna is an open-source RAG framework that converts natural language questions into executable SQL and runs them against local databases.

Stars --Last Commit --

Vespa

Vespa is a distributed engine designed for online AI and big-data workloads. It excels at low-latency retrieval and inference, supporting vector search, custom scoring, and near-real-time indexing.

Stars --Last Commit --

Weaviate

Weaviate is an open-source, cloud-native vector database for storing objects and vectors, enabling scalable semantic search and structured filtering for AI applications.

Stars --Last Commit --

WeKnora

WeKnora — an open-source document understanding and retrieval framework from Tencent that combines LLMs and RAG for multimodal document search and knowledge graph construction.

Stars --Last Commit --

Wren AI

Open-source GenBI agent for querying databases in natural language and producing SQL, charts and AI-generated insights.

Stars --Last Commit --

OCR, parsing, extraction, and document understanding.

Docling

Docling: an open-source framework for document understanding and conversion, supporting PDFs, DOCX, images, audio and more.

Stars --Last Commit --

LangExtract

A Python library that uses LLMs to extract structured information from unstructured text and provides interactive visualization for review.

Stars --Last Commit --

light-ocr

A fast, fully offline OCR toolkit for Node.js and C++ built on PP-OCRv6 and ONNX Runtime, returning text, confidence scores, and coordinates with CoreML and WebGPU acceleration.

Stars --Last Commit --

MinerU

MinerU is a high-precision PDF document parsing tool that converts complex PDFs into machine-readable Markdown and JSON formats, supporting formula, table, image extraction and multilingual OCR.

Stars --Last Commit --

pdfly

A command-line tool to extract (meta)data from PDFs and manipulate PDF files at scale.

Stars --Last Commit --

pdfplumber

An open-source Python library built on pdfminer.six that exposes detailed PDF objects, table extraction, and visual debugging features.

Stars --Last Commit --

PyMuPDF

A high-performance Python library for data extraction, analysis, conversion, and manipulation of PDF and other documents.

Stars --Last Commit --

spaCy

A high-performance, production-ready open-source natural language processing library providing pretrained pipelines, training tools, and extensible language components.

Stars --Last Commit --

Stirling PDF

An open-source, self-hosted web PDF editor and processing platform that supports a wide range of PDF operations.

Stars --Last Commit --

Tesseract OCR

Tesseract is a powerful open-source Optical Character Recognition (OCR) engine supporting over 100 languages, widely used for text extraction and document digitization.

Stars --Last Commit --

Entity graphs, relationship modeling, and graph retrieval.

CodeGraph

Pre-indexed code knowledge graph for AI coding agents, supporting Claude Code, Codex, Cursor, and OpenCode with 100% local execution.

Stars --Last Commit --

DeepTutor

A multi-agent personalized learning system integrating RAG, knowledge graphs, and interactive visualizations.

Stars --Last Commit --

graphify

A skill that turns any codebase — with its docs, SQL schemas, configs, and PDFs — into a queryable knowledge graph for Claude Code, Cursor, Codex, and Gemini CLI. Local deterministic AST parsing, every edge explained, no vector store.

Stars --Last Commit --

Understand Anything

Turn any code into an interactive knowledge graph you can explore, search, and ask questions about, with native support for Claude Code, Codex, Cursor, Copilot, and Gemini CLI.

Stars --Last Commit --

Data ingestion, connectors, and synchronization pipelines.

Agent-Reach

A CLI that gives AI agents access to platforms they cannot reach on their own — Twitter/X, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu, Xueqiu and more — returning clean structured data with zero API fees.

Stars --Last Commit --

Airbyte

Open-source data movement platform for ELT pipelines and AI agents, moving data from APIs, databases, and files to warehouses, lakes, and AI applications.

Stars --Last Commit --

Bright Data MCP

MCP server providing an all-in-one solution for public web access — crawling, scraping, and structured data extraction for AI agents.

Stars --Last Commit --

Crawl4AI

An open-source web crawler and scraper optimized for large language model workflows, producing clean Markdown and structured data with browser control and Docker deployment.

Stars --Last Commit --

Data Prep Kit

Data Prep Kit accelerates unstructured data preparation for LLM applications.

Stars --Last Commit --

DataTrove

DataTrove provides composable, platform-agnostic pipelines for large-scale text data processing, including extraction, filtering, deduplication and saving.

Stars --Last Commit --

Gravitino

A high-performance, geo-distributed and federated metadata lake for unified metadata access and governance of data and AI assets.

Stars --Last Commit --

MindsDB

AI's query engine - Platform for building AI that can answer questions over large scale federated data - The only MCP Server you'll ever need.

Stars --Last Commit --

OpenMetadata

A unified metadata platform for data discovery, observability and governance with rich connectors and collaboration features.

Stars --Last Commit --

pandas

pandas is an open-source Python library for structured data manipulation and analysis, a core dependency in ML and AI data preprocessing workflows.

Stars --Last Commit --

Pixeltable

A declarative data infrastructure for multimodal AI workloads that simplifies storage, indexing, and inference.

Stars --Last Commit --

Unity Catalog

An open, multimodal catalog for data and AI that provides unified governance, metadata management, and access control.

Stars --Last Commit --