Add download preflight and stuck-pull guidance to local-ai-use - #106
Add download preflight and stuck-pull guidance to local-ai-use#106sreeram-11 wants to merge 2 commits into
Conversation
|
@sreeram-11 Were you able to validate that your changes resolve the issue in the affected scenarios (e.g., downloading a model when the system is out of disk space, lacks write permissions, or uses a read-only mount)? If so, which agent/model did you use? |
|
The changes are doc-only (two additions: a preflight step in What's verified: The mechanisms the guidance relies on are real and correct.
So the core of the fix (check One useful finding while testing the failure paths:
To reproduce the three failure states (full disk / no write permission / read-only mount) as genuine live pulls, they need to be created where the lemond service actually writes, that is, a disposable environment with lemond configured to write to a small/locked/read-only volume.
|
When a model download targets a bad path (out of space, no write permission, quota, read-only mount), the pull fails slowly and silently, but the console keeps printing
Progress: NN%while the real error only shows up in the server log. This adds guidance so the agent catches that up front and diagnoses a stuck pull instead of waiting through silent retries.Details
GET /api/v1/system-info, which reportsmodels_dir(where the download lands) and amodel_storageblock withfree_bytes/total_bytes. If free space is short of the model size, tell the user the path and stop rather than starting a doomed pull.Progress: NN%while the write error surfaces only in the server log. If a pull stalls, read the server log (typicallylemonade-server.login the OS temp dir) for the real error (e.g. a write failure likeCURL code 23, or an out-of-space message) and surface it to the user.Why