823e8ef490
Implement streaming tool call implementation for Anthropic and Open AI.
When calling:
llm.generate(..., partial_tool_calls: true) do ...
Partials may contain ToolCall instances with partial: true, These tool calls are partially populated with json partially parsed.
So for example when performing a search you may get:
ToolCall(..., {search: "hello" })
ToolCall(..., {search: "hello world" })
The library used to parse json is:
https://github.com/dgraham/json-stream
We use a fork cause we need access to the internal buffer.
This prepares internals to perform partial tool calls, but does not implement it yet.
|
||
|---|---|---|
| .. | ||
| jobs/regular | ||
| personas | ||
| tools | ||
| bot_spec.rb | ||
| entry_point_spec.rb | ||
| playground_spec.rb | ||
| question_consolidator_spec.rb | ||
| site_setting_extension_spec.rb | ||