discourse-ai

Commit Graph

Author	SHA1	Message	Date
Rafael dos Santos Silva	cbfd8507b1	FIX: Update bedrock endpoint (#272 ) * FIX: Update bedrock endpoint AWS updated their endpoints per https://docs.aws.amazon.com/general/latest/gr/bedrock.html * lint	2023-10-30 19:27:50 -03:00
Rafael dos Santos Silva	102f47c1c4	FEATURE: Allow Anthropic inference via AWS Bedrock (#235 ) If a module LLM model is set to claude-2 and the ai_bedrock variables are all present we will use AWS Bedrock instead of Antrhopic own APIs. This is quite hacky, but will allow us to test the waters with AWS Bedrock early access with every module. This situation of "same module, completely different API" is quite a bit far from what we had in the OpenAI/Azure separation, so it's more food for thought for when we start working on the LLM abstraction layer soon this year.	2023-10-02 12:58:36 -03:00

Author

SHA1

Message

Date

Rafael dos Santos Silva

cbfd8507b1

FIX: Update bedrock endpoint (#272 )

* FIX: Update bedrock endpoint

AWS updated their endpoints per https://docs.aws.amazon.com/general/latest/gr/bedrock.html

* lint

2023-10-30 19:27:50 -03:00

Rafael dos Santos Silva

102f47c1c4

FEATURE: Allow Anthropic inference via AWS Bedrock (#235 )

If a module LLM model is set to claude-2 and the ai_bedrock variables are all present we will use AWS Bedrock instead of Antrhopic own APIs.

This is quite hacky, but will allow us to test the waters with AWS Bedrock early access with every module.

This situation of "same module, completely different API" is quite a bit far from what we had in the OpenAI/Azure separation, so it's more food for thought for when we start working on the LLM abstraction layer soon this year.

2023-10-02 12:58:36 -03:00

2 Commits