Sam 823e8ef490 FEATURE: partial tool call support for OpenAI and Anthropic (#908) ... Implement streaming tool call implementation for Anthropic and Open AI. When calling: llm.generate(..., partial_tool_calls: true) do ... Partials may contain ToolCall instances with partial: true, These tool calls are partially populated with json partially parsed. So for example when performing a search you may get: ToolCall(..., {search: "hello" }) ToolCall(..., {search: "hello world" }) The library used to parse json is: https://github.com/dgraham/json-stream We use a fork cause we need access to the internal buffer. This prepares internals to perform partial tool calls, but does not implement it yet.		2024-11-14 06:58:24 +11:00
..
assistant_controller_spec.rb	FEATURE: partial tool call support for OpenAI and Anthropic (#908)	2024-11-14 06:58:24 +11:00