Skip to content
This repository was archived by the owner on Jul 4, 2025. It is now read-only.

Commit a4df116

Browse files
Update function calling note
1 parent 75d44ac commit a4df116

File tree

1 file changed

+12
-0
lines changed

1 file changed

+12
-0
lines changed

docs/docs/guides/function-calling.md

Lines changed: 12 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -437,3 +437,15 @@ User can also specify the function with enum field to the tool definition to mak
437437
```
438438

439439
(*) Note that the accuracy of function calling heavily depends on the quality of the model. For small models like 8B or 12B, we should only use function calling with simple cases.
440+
441+
442+
443+
<!--
444+
Note: The function calling feature from cortex.cpp is primarily an application of prompt engineering. When tools are specified, we inject a system prompt into the conversation to facilitate this functionality.
445+
446+
Compatibility: This feature works best with models like llama3.1 and its derivatives, such as mistral-nemo or qwen.
447+
448+
Customization: Users have the option to manually update the system prompt to fine-tune it for specific problems or use cases. The detail implementation is in this [PR](https://github.com/janhq/cortex.cpp/pull/1472/files).
449+
450+
The full steps to mimic the function calling feature in Python using openai lib can be found [here](https://github.com/janhq/models/issues/16#issuecomment-2381129322)
451+
-->

0 commit comments

Comments
 (0)