LLMs, local agents, and orchestration
Graph Memory Transformer (GMT)
Co-authored language model architecture research around graph-structured memory.
PreprintPublic code
Overview
Graph Memory Transformer is co-authored research on language model architecture. The idea is to study decoder-only Transformer variants where a graph-structured memory mechanism takes the role normally occupied by the feed-forward block.