discourse-ai/spec/shared/inference
Sam 6282b6d21f
FIX: implement tools framework for Anthropic (#307)
Previous to this changeset we used a custom system for tools/command
support for Anthropic.

We defined commands by using !command as a signal to execute it

Following Anthropic Claude 2.1, there is an official supported syntax (beta)
for tools execution.

eg:

```
+      <function_calls>
+      <invoke>
+      <tool_name>image</tool_name>
+      <parameters>
+      <prompts>
+      [
+      "an oil painting",
+      "a cute fluffy orange",
+      "3 apple's",
+      "a cat"
+      ]
+      </prompts>
+      </parameters>
+      </invoke>
+      </function_calls>
```

This implements the spec per Anthropic, it should be stable enough
to also work on other LLMs.

Keep in mind that OpenAI is not impacted here at all, as it has its
own custom system for function calls.

Additionally:

- Fixes the title system prompt so it works with latest Anthropic
- Uses new spec for "system" messages by Anthropic
- Tweak forum helper persona to guide Anthropic a tiny be better

Overall results are pretty awesome and Anthropic Claude performs
really well now on Discourse
2023-11-24 06:39:56 +11:00
..
anthropic_completions_spec.rb FEATURE: UI to update ai personas on admin page (#290) 2023-11-21 16:56:43 +11:00
function_list_spec.rb FIX: implement tools framework for Anthropic (#307) 2023-11-24 06:39:56 +11:00
openai_completions_spec.rb FEATURE: UI to update ai personas on admin page (#290) 2023-11-21 16:56:43 +11:00
openai_embeddings_spec.rb FEATURE: Add Azure cognitive service support (#93) 2023-06-21 10:39:51 +10:00
stability_generator_spec.rb FEATURE: add support for final stable diffusion xl model (#122) 2023-08-02 16:53:28 -03:00