Go to file
Roman Rizzi ddf2bf7034
DEV: Backfill embeddings concurrently. (#941)
We are adding a new method for generating and storing embeddings in bulk, which relies on `Concurrent::Promises::Future`. Generating an embedding consists of three steps:

Prepare text
HTTP call to retrieve the vector
Save to DB.
Each one is independently executed on whatever thread the pool gives us.

We are bringing a custom thread pool instead of the global executor since we want control over how many threads we spawn to limit concurrency. We also avoid firing thousands of HTTP requests when working with large batches.
2024-11-26 14:12:32 -03:00
.github/workflows Initial commit 2023-02-17 11:33:47 -03:00
admin/assets/javascripts/discourse FEATURE: improve visibility of AI usage in LLM page (#845) 2024-10-22 11:16:02 +11:00
app DEV: Backfill embeddings concurrently. (#941) 2024-11-26 14:12:32 -03:00
assets FEATURE: Add links to filtered emotion view on emotion dashboard table (#953) 2024-11-25 15:51:01 -03:00
config FEATURE: Calculate gists from non hot topics too (#958) 2024-11-26 13:44:12 -03:00
db FEATURE: Calculate gists from non hot topics too (#958) 2024-11-26 13:44:12 -03:00
discourse_automation FEATURE: better logging for automation reports (#853) 2024-10-23 16:49:56 +11:00
lib DEV: Backfill embeddings concurrently. (#941) 2024-11-26 14:12:32 -03:00
public/ai-share UX: improve artifact styling add direct share link (#930) 2024-11-20 13:13:03 +11:00
spec DEV: Backfill embeddings concurrently. (#941) 2024-11-26 14:12:32 -03:00
svg-icons UX: update gist toggle styles (#926) 2024-11-19 15:33:34 -05:00
test/javascripts DEV: Update linting (#933) 2024-11-20 15:43:28 +01:00
tokenizers FEATURE: Set endpoint credentials directly from LlmModel. (#625) 2024-05-16 09:50:22 -03:00
.discourse-compatibility DEV: `IMAGE_MARKDOWN_REGEX` import available in core (#847) 2024-10-21 14:48:10 -07:00
.gitignore FEATURE: Discord Bot integration (#831) 2024-10-16 12:41:18 -03:00
.npmrc DEV: Switch to use pnpm (#833) 2024-10-14 13:37:20 +02:00
.prettierignore FEATURE: UI to update ai personas on admin page (#290) 2023-11-21 16:56:43 +11:00
.prettierrc.cjs DEV: Update linting configs (#280) 2023-11-03 11:30:09 +00:00
.rubocop.yml DEV: Update linting configs (#280) 2023-11-03 11:30:09 +00:00
.streerc DEV: Update linting configs (#280) 2023-11-03 11:30:09 +00:00
.template-lintrc.cjs DEV: Update linting (#326) 2023-11-29 23:01:48 +01:00
Gemfile DEV: Update linting configs (#280) 2023-11-03 11:30:09 +00:00
Gemfile.lock Build(deps-dev): Bump rexml from 3.3.6 to 3.3.9 (#874) 2024-10-28 20:44:39 +01:00
LICENSE Initial commit 2023-02-17 11:33:47 -03:00
README.md CHORE: Update Readme (#185) 2023-09-04 15:46:35 -03:00
eslint.config.mjs DEV: Update eslint config (#917) 2024-11-19 11:57:40 +01:00
package.json DEV: Update linting (#935) 2024-11-20 18:50:50 +01:00
plugin.rb FIX: automatically bust cache for share ai assets (#942) 2024-11-22 11:23:15 +11:00
pnpm-lock.yaml DEV: Update linting (#935) 2024-11-20 18:50:50 +01:00
translator.yml UX: Display the indexing progress for RAG uploads (#557) 2024-04-09 11:03:07 -03:00

README.md

Discourse AI Plugin

Plugin Summary

For more information, please see: https://meta.discourse.org/t/discourse-ai/259214?u=falco