discourse-ai/db/migrate
Rafael dos Santos Silva eb93b21769
FEATURE: Add BGE-M3 embeddings support (#569)
BAAI/bge-m3 is an interesting model, that is multilingual and with a
context size of 8192. Even with a 16x larger context, it's only 4x slower
to compute it's embeddings on the worst case scenario.

Also includes a minor refactor of the rake task, including setting model
and concurrency levels when running the backfill task.
2024-04-10 17:24:01 -03:00
..
20230224165056_create_classification_results_table.rb DEV: Dedicated table for saving classification results (#1) 2023-02-27 16:21:40 -03:00
20230307125342_created_model_accuracy_table.rb FEATURE: Use dedicated reviewables for AI flags. (#4) 2023-03-07 15:39:28 -03:00
20230316160714_create_completion_prompt_table.rb REFACTOR: Store prompts in a dedicated table. (#14) 2023-03-17 15:14:19 -03:00
20230320122645_delete_duplicated_seeded_prompts.rb FIX: Remove old seeded prompts. (#17) 2023-03-20 12:55:38 -03:00
20230320185619_multi_message_completion_prompts.rb FIX: Allow null messages to migrate existing rows (#22) 2023-03-21 12:33:30 -03:00
20230322142028_make_dropped_value_column_nullable.rb FIX: Remove `null: false` from dropped column (#24) 2023-03-22 11:40:20 -03:00
20230406135943_add_provider_to_completion_prompts.rb FEATURE: Anthropic Claude for AIHelper and Summarization modules (#39) 2023-04-10 11:04:42 -03:00
20230424055354_create_ai_api_audit_logs.rb FEATURE: add a table to audit OpenAI usage (#45) 2023-04-26 11:44:29 +10:00
20230519003106_post_custom_prompts.rb FEATURE: add support for GPT <-> Forum integration 2023-05-20 17:45:54 +10:00
20230710171141_enable_pg_vector_extension.rb FEATURE: Support for locally infered embeddings in 100 languages (#115) 2023-07-27 15:50:03 -03:00
20230710171142_create_ai_topic_embeddings_table.rb DEV: Migrations shouldn't rely on the app (#253) 2023-10-16 18:50:37 -03:00
20230710171143_migrate_embeddings_from_dedicated_database.rb FEATURE: Per post embeddings (#387) 2023-12-29 12:28:45 -03:00
20230727170222_create_multilingual_topic_embeddings_table.rb DEV: Migrations shouldn't rely on the app (#253) 2023-10-16 18:50:37 -03:00
20230831033812_rename_ai_helper_add_ai_pm_to_header_setting.rb DEV: rename ai_helper_add_ai_pm_to_header -> ai_bot_add_to_header (#177) 2023-08-31 14:42:28 +10:00
20231003155701_create_bge_topic_embeddings_table.rb DEV: Migrations shouldn't rely on the app (#253) 2023-10-16 18:50:37 -03:00
20231031050538_add_topic_id_post_id_to_ai_audit_log.rb FEATURE: support topic_id and post_id logging in ai audit log (#274) 2023-11-01 08:41:31 +11:00
20231109011155_create_ai_personas.rb FEATURE: basic infrastructure for custom personas (#288) 2023-11-10 11:39:49 +11:00
20231117050928_add_system_and_priority_to_ai_personas.rb FEATURE: UI to update ai personas on admin page (#290) 2023-11-21 16:56:43 +11:00
20231120033747_remove_site_settings.rb FEATURE: UI to update ai personas on admin page (#290) 2023-11-21 16:56:43 +11:00
20231202013850_convert_ai_personas_commands_to_json.rb DEV: Fix various typos (#434) 2024-01-19 12:51:26 +01:00
20231227223301_create_gemini_topic_embeddings_table.rb FEATURE: Support for Gemini Embeddings (#382) 2023-12-28 10:28:01 -03:00
20231228213036_create_ai_post_embeddings_tables.rb FEATURE: Per post embeddings (#387) 2023-12-29 12:28:45 -03:00
20240104013944_add_params_to_completion_prompt.rb FIX: AI helper not working correctly with mixtral (#399) 2024-01-04 09:53:47 -03:00
20240126013358_create_openai_text_embedding_tables.rb FEATURE: add support for new OpenAI embedding models (#445) 2024-01-29 13:24:30 -03:00
20240202010752_add_temperature_top_p_to_ai_personas.rb FEATURE: allow personas to supply top_p and temperature params (#459) 2024-02-03 07:09:34 +11:00
20240209044519_add_user_id_mentionable_default_llm_to_ai_personas.rb FEATURE: mentionable personas and random picker tool, context limits (#466) 2024-02-15 16:37:59 +11:00
20240213051213_add_limits_to_ai_persona.rb FEATURE: mentionable personas and random picker tool, context limits (#466) 2024-02-15 16:37:59 +11:00
20240309034751_add_shared_ai_conversations.rb FEATURE: Share conversations with AI via a URL (#521) 2024-03-12 16:51:41 +11:00
20240309034752_create_rag_document_fragment_table.rb FEATURE: AI Bot RAG support. (#537) 2024-04-01 13:43:34 -03:00
20240313165121_embedding_tables_for_rag_uploads.rb FEATURE: AI Bot RAG support. (#537) 2024-04-01 13:43:34 -03:00
20240322035907_add_images_to_ai_personas.rb FEATURE: Add vision support to AI personas (Claude 3) (#546) 2024-03-27 14:30:11 +11:00
20240404000838_add_metadata_to_rag_document_frament.rb FEATURE: Add metadata support for RAG (#553) 2024-04-04 11:02:16 -03:00
20240410170000_add_embeddings_tablesfor_bge_m3.rb FEATURE: Add BGE-M3 embeddings support (#569) 2024-04-10 17:24:01 -03:00