mirror of
https://github.com/discourse/discourse-ai.git
synced 2025-03-08 18:29:32 +00:00
823e8ef490
Implement streaming tool call implementation for Anthropic and Open AI.
When calling:
llm.generate(..., partial_tool_calls: true) do ...
Partials may contain ToolCall instances with partial: true, These tool calls are partially populated with json partially parsed.
So for example when performing a search you may get:
ToolCall(..., {search: "hello" })
ToolCall(..., {search: "hello world" })
The library used to parse json is:
https://github.com/dgraham/json-stream
We use a fork cause we need access to the internal buffer.
This prepares internals to perform partial tool calls, but does not implement it yet.
38 lines
916 B
Ruby
38 lines
916 B
Ruby
# frozen_string_literal: true
|
|
|
|
module DiscourseAi
|
|
module Completions
|
|
class ToolCall
|
|
attr_reader :id, :name, :parameters
|
|
attr_accessor :partial
|
|
|
|
def initialize(id:, name:, parameters: nil)
|
|
@id = id
|
|
@name = name
|
|
self.parameters = parameters if parameters
|
|
@parameters ||= {}
|
|
@partial = false
|
|
end
|
|
|
|
def parameters=(parameters)
|
|
raise ArgumentError, "parameters must be a hash" unless parameters.is_a?(Hash)
|
|
@parameters = parameters.symbolize_keys
|
|
end
|
|
|
|
def ==(other)
|
|
id == other.id && name == other.name && parameters == other.parameters
|
|
end
|
|
|
|
def to_s
|
|
"#{name} - #{id} (\n#{parameters.map(&:to_s).join("\n")}\n)"
|
|
end
|
|
|
|
def dup
|
|
call = ToolCall.new(id: id, name: name, parameters: parameters.deep_dup)
|
|
call.partial = partial
|
|
call
|
|
end
|
|
end
|
|
end
|
|
end
|