FIX: Lower truncation size for Gemini Embeddings (#493)

2024-02-27 18:52:53 -03:00 · 2024-02-27 18:52:53 -03:00 · a1f1067f69
parent 1414a91db4
commit a1f1067f69
1 changed files with 1 additions and 1 deletions
--- a/lib/embeddings/vector_representations/gemini.rb
+++ b/lib/embeddings/vector_representations/gemini.rb
@ -31,7 +31,7 @@ module DiscourseAi
        end

        def max_sequence_length
-          2048
+          1536 # Gemini has a max sequence length of 2048, but the API has a limit of 10000 bytes, hence the lower value
        end

        def pg_function