LLMs, local agents, and orchestration

Graph Memory Transformer (GMT)

Co-authored language model architecture research around graph-structured memory.

PreprintPublic code

Overview

Graph Memory Transformer is co-authored research on language model architecture. The idea is to study decoder-only Transformer variants where a graph-structured memory mechanism takes the role normally occupied by the feed-forward block.