discourse-ai/spec
Roman Rizzi ec97996905
FIX/REFACTOR: FoldContent revamp (#866)
* FIX/REFACTOR: FoldContent revamp

We hit a snag with our hot topic gist strategy: the regex we used to split the content didn't work, so we cannot send the original post separately. This was important for letting the model focus on what's new in the topic.

The algorithm doesn’t give us full control over how prompts are written, and figuring out how to format the content isn't straightforward. This means we're having to use more complicated workarounds, like regex.

To tackle this, I'm suggesting we simplify the approach a bit. Let's focus on summarizing as much as we can upfront, then gradually add new content until there's nothing left to summarize.

Also, the "extend" part is mostly for models with small context windows, which shouldn't pose a problem 99% of the time with the content volume we're dealing with.

* Fix fold docs

* Use #shift instead of #pop to get the first elem, not the last
2024-10-25 11:51:17 -03:00
..
configuration FIX: Correctly display errors when parent module needs to be disabled first (#788) 2024-08-30 17:16:11 -03:00
fabricators UX: Improve seeded LLM edit page (#856) 2024-10-23 13:58:27 -07:00
fixtures FIX: Load categories from search response (#612) 2024-05-14 17:13:25 +03:00
jobs FIX: Don't regenerate up to date gists (#843) 2024-10-18 18:49:01 -03:00
lib FIX/REFACTOR: FoldContent revamp (#866) 2024-10-25 11:51:17 -03:00
models FEATURE: smarter persona tethering (#832) 2024-10-16 07:20:31 +11:00
requests FIX: testing tool was not showing rag results (#867) 2024-10-25 16:01:25 +11:00
serializers DEV: Fix new Rubocop offenses 2024-03-06 15:23:29 +01:00
services/discourse_ai REFACTOR: Support of different summarization targets/prompts. (#835) 2024-10-15 13:53:26 -03:00
shared FIX/REFACTOR: FoldContent revamp (#866) 2024-10-25 11:51:17 -03:00
support FIX: typo causing text_embedding_3_large to fail (#460) 2024-02-05 11:16:36 +11:00
system FIX: testing tool was not showing rag results (#867) 2024-10-25 16:01:25 +11:00
tasks FIX: Filter soft-deleted topics when backfilling sentiment (#527) 2024-03-12 21:01:24 -03:00
plugin_helper.rb FEATURE: smarter persona tethering (#832) 2024-10-16 07:20:31 +11:00
plugin_spec.rb DEV: Clearly separate post/composer helper settings (#747) 2024-08-12 15:40:23 -07:00