discourse-ai/db/migrate/20240404000838_add_metadata_to_rag_document_frament.rb

# frozen_string_literal: true

class AddMetadataToRagDocumentFrament < ActiveRecord::Migration[7.0]
  def change
    # limit is purely for safety
    add_column :rag_document_fragments, :metadata, :text, null: true, limit: 100_000
  end
end
FEATURE: Add metadata support for RAG (#553) * FEATURE: Add metadata support for RAG You may include non indexed metadata in the RAG document by using [[metadata ....]] This information is attached to all the text below and provided to the retriever. This allows for RAG to operate within a rich amount of contexts without getting lost Also: - re-implemented chunking algorithm so it streams - moved indexing to background low priority queue * Baran gem no longer required. * tokenizers is on 4.4 ... upgrade it ... 2024-04-05 01:02:16 +11:00			`# frozen_string_literal: true`

			`class AddMetadataToRagDocumentFrament < ActiveRecord::Migration[7.0]`
			`def change`
			`# limit is purely for safety`
			`add_column :rag_document_fragments, :metadata, :text, null: true, limit: 100_000`
			`end`
			`end`