This repository was archived by the owner on Jul 4, 2025. It is now read-only.
File tree Expand file tree Collapse file tree 2 files changed +3
-1
lines changed
Expand file tree Collapse file tree 2 files changed +3
-1
lines changed Original file line number Diff line number Diff line change @@ -127,6 +127,7 @@ Table of parameters
127127| ` clean_cache_threshold ` | Integer | Number of chats that will trigger clean cache action|
128128| ` grp_attn_n ` | Integer| Group attention factor in self-extend|
129129| ` grp_attn_w ` | Integer| Group attention width in self-extend|
130+ | ` mlock ` | Boolean| Prevent system swapping of the model to disk in macOS|
130131
131132*** OPTIONAL*** : You can run Nitro on a different port like 5000 instead of 3928 by running it manually in terminal
132133``` zsh
Original file line number Diff line number Diff line change @@ -79,4 +79,5 @@ In case you got error while loading models. Please check for the correct model p
7979| ` pre_prompt ` | String | The prompt to use for internal configuration. |
8080| ` clean_cache_threshold ` | Integer| Number of chats that will trigger clean cache action.|
8181| ` grp_attn_n ` | Integer| Group attention factor in self-extend|
82- | ` grp_attn_w ` | Integer| Group attention width in self-extend|
82+ | ` grp_attn_w ` | Integer| Group attention width in self-extend|
83+ | ` mlock ` | Boolean| Prevent system swapping of the model to disk in macOS|
You can’t perform that action at this time.
0 commit comments