feat: real-time tool call display and faster streaming - #35
Open
twpark wants to merge 1 commit into
Open
Conversation
- Show tool name + elapsed time instead of spinner during AI processing (e.g. "⚙️ Bash... 8s" instead of "🕘 Processing...") - Add shared_rate_limit_wait_ms() for custom rate limit gaps - Use 500ms rate limit during streaming (down from 2500ms default) - Use 500ms polling interval during streaming for responsive updates - Reduce initial placeholder delay from 2500ms to 500ms Closes kstost#33
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
⚙️ Bash... 8s)shared_rate_limit_wait_ms()for custom rate limit gapsMotivation
When AI executes multiple tool calls, the Telegram chat shows only a generic "Processing..." spinner for minutes. Users can't tell if the bot is working or stuck. Terminal logs show tool activity but Telegram doesn't.
With this change, tool calls are visible in real-time with elapsed time, and text responses stream faster.
Test plan
cargo checkpassesCloses #33