Go to file
Roman Rizzi ec97996905
FIX/REFACTOR: FoldContent revamp (#866)
* FIX/REFACTOR: FoldContent revamp

We hit a snag with our hot topic gist strategy: the regex we used to split the content didn't work, so we cannot send the original post separately. This was important for letting the model focus on what's new in the topic.

The algorithm doesn’t give us full control over how prompts are written, and figuring out how to format the content isn't straightforward. This means we're having to use more complicated workarounds, like regex.

To tackle this, I'm suggesting we simplify the approach a bit. Let's focus on summarizing as much as we can upfront, then gradually add new content until there's nothing left to summarize.

Also, the "extend" part is mostly for models with small context windows, which shouldn't pose a problem 99% of the time with the content volume we're dealing with.

* Fix fold docs

* Use #shift instead of #pop to get the first elem, not the last
2024-10-25 11:51:17 -03:00
.github/workflows Initial commit 2023-02-17 11:33:47 -03:00
admin/assets/javascripts/discourse FEATURE: improve visibility of AI usage in LLM page (#845) 2024-10-22 11:16:02 +11:00
app FIX/REFACTOR: FoldContent revamp (#866) 2024-10-25 11:51:17 -03:00
assets FIX: testing tool was not showing rag results (#867) 2024-10-25 16:01:25 +11:00
config FIX: testing tool was not showing rag results (#867) 2024-10-25 16:01:25 +11:00
db FEATURE: better logging for automation reports (#853) 2024-10-23 16:49:56 +11:00
discourse_automation FEATURE: better logging for automation reports (#853) 2024-10-23 16:49:56 +11:00
lib FIX/REFACTOR: FoldContent revamp (#866) 2024-10-25 11:51:17 -03:00
public/ai-share UX: improve appearance of attributed quote when sharing (#665) 2024-06-11 12:06:57 -04:00
spec FIX/REFACTOR: FoldContent revamp (#866) 2024-10-25 11:51:17 -03:00
test/javascripts DEV: Improve `ai-streamer` API (#851) 2024-10-22 10:55:35 -07:00
tokenizers FEATURE: Set endpoint credentials directly from LlmModel. (#625) 2024-05-16 09:50:22 -03:00
.discourse-compatibility DEV: `IMAGE_MARKDOWN_REGEX` import available in core (#847) 2024-10-21 14:48:10 -07:00
.eslintrc.cjs DEV: Update linting configs (#280) 2023-11-03 11:30:09 +00:00
.gitignore FEATURE: Discord Bot integration (#831) 2024-10-16 12:41:18 -03:00
.npmrc DEV: Switch to use pnpm (#833) 2024-10-14 13:37:20 +02:00
.prettierignore FEATURE: UI to update ai personas on admin page (#290) 2023-11-21 16:56:43 +11:00
.prettierrc.cjs DEV: Update linting configs (#280) 2023-11-03 11:30:09 +00:00
.rubocop.yml DEV: Update linting configs (#280) 2023-11-03 11:30:09 +00:00
.streerc DEV: Update linting configs (#280) 2023-11-03 11:30:09 +00:00
.template-lintrc.cjs DEV: Update linting (#326) 2023-11-29 23:01:48 +01:00
Gemfile DEV: Update linting configs (#280) 2023-11-03 11:30:09 +00:00
Gemfile.lock Build(deps-dev): Bump rexml from 3.3.3 to 3.3.6 (#768) 2024-09-01 12:23:09 +02:00
LICENSE Initial commit 2023-02-17 11:33:47 -03:00
README.md CHORE: Update Readme (#185) 2023-09-04 15:46:35 -03:00
package.json DEV: Switch to use pnpm (#833) 2024-10-14 13:37:20 +02:00
plugin.rb FEATURE: Generate topic gists for the hot topics list. (#837) 2024-10-18 18:01:39 -03:00
pnpm-lock.yaml DEV: Switch to use pnpm (#833) 2024-10-14 13:37:20 +02:00
translator.yml UX: Display the indexing progress for RAG uploads (#557) 2024-04-09 11:03:07 -03:00

README.md

Discourse AI Plugin

Plugin Summary

For more information, please see: https://meta.discourse.org/t/discourse-ai/259214?u=falco