I have a few immature questions after reading your plugin.
- How about using
EmptyTapeStore for the internal LLM for extracting semantics so its size won't grow indefinitely?
context.select will be called at the start of each turn, and the LLM extraction will also be called multiple times. I think you can cache the snapshot and reuse it for the whole loop
I have a few immature questions after reading your plugin.
EmptyTapeStorefor the internal LLM for extracting semantics so its size won't grow indefinitely?context.selectwill be called at the start of each turn, and the LLM extraction will also be called multiple times. I think you can cache the snapshot and reuse it for the whole loop