Go to file
Sam 181113159b
FIX: setting explorer was exceeding token budget
This refactor changes it so we only include minimal data in the
system prompt which leaves us lots of tokens for specific searches

The new search command allows us to pull in settings on demand

Descriptions are include in short search results, and names only
in longer results

Also: 

* In dev it is important to tell when calls are made to open ai
this adds a console log to increase awareness around token usage

* PERF: stop counting tokens so often

This changes it so we only count tokens once per response

Previously each time we heard back from open ai we would count
tokens, leading to uneeded delays

* bug fix, commands may reach in for tokenizer

* add logging to console for anthropic calls as well

* Update lib/shared/inference/openai_completions.rb

Co-authored-by: Martin Brennan <mjrbrennan@gmail.com>
2023-09-01 11:48:51 +10:00
.github/workflows Initial commit 2023-02-17 11:33:47 -03:00
app FEATURE: StableBeluga2 support for AiHelper (#162) 2023-08-25 15:54:51 -03:00
assets DEV: rename ai_helper_add_ai_pm_to_header -> ai_bot_add_to_header (#177) 2023-08-31 14:42:28 +10:00
config FIX: setting explorer was exceeding token budget 2023-09-01 11:48:51 +10:00
db DEV: rename ai_helper_add_ai_pm_to_header -> ai_bot_add_to_header (#177) 2023-08-31 14:42:28 +10:00
lib FIX: setting explorer was exceeding token budget 2023-09-01 11:48:51 +10:00
spec FIX: setting explorer was exceeding token budget 2023-09-01 11:48:51 +10:00
svg-icons UX: add a custom sparkles icon for AI action buttons (#44) 2023-04-20 20:41:24 +05:30
test/javascripts Initial commit 2023-02-17 11:33:47 -03:00
tokenizers FEATURE: Support for locally infered embeddings in 100 languages (#115) 2023-07-27 15:50:03 -03:00
.discourse-compatibility DEV: Pin plugin for Discourse 3.1 stable (#143) 2023-08-21 14:46:54 -03:00
.eslintrc Initial commit 2023-02-17 11:33:47 -03:00
.gitignore Initial commit 2023-02-17 11:33:47 -03:00
.prettierrc Initial commit 2023-02-17 11:33:47 -03:00
.rubocop.yml Initial commit 2023-02-17 11:33:47 -03:00
.streerc Initial commit 2023-02-17 11:33:47 -03:00
.template-lintrc.js Initial commit 2023-02-17 11:33:47 -03:00
Gemfile Initial commit 2023-02-17 11:33:47 -03:00
Gemfile.lock Initial commit 2023-02-17 11:33:47 -03:00
LICENSE Initial commit 2023-02-17 11:33:47 -03:00
README.md Initial commit 2023-02-17 11:33:47 -03:00
package.json DEV: Update ESLint config version (#166) 2023-08-28 12:21:52 -07:00
plugin.rb FEATURE: implement command framework for non Open AI (#147) 2023-08-23 07:49:36 +10:00
translator.yml DEV: Add Crowdin support (#108) 2023-07-15 00:56:15 +02:00
yarn.lock DEV: Update ESLint config version (#166) 2023-08-28 12:21:52 -07:00

README.md

Plugin Name Plugin

Plugin Summary

For more information, please see: url to meta topic