Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

add support for AWS Bedrock as LLM provider #61

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

add support for AWS Bedrock as LLM provider #61

wants to merge 1 commit into from

Commits on Oct 2, 2024

  1. - updated requirements to resolve dependency conflicts and allow the … 

    …project to build (it was not building on the main branch)

- pinned litellm at 1.48.2 until (BerriAI/litellm#6003) is solved
- introduced code for bedrock models. Not happy with this implementation, but I would need to rewrite the entire ai_handler module to make it right. Ideally, this should just pass everything to litellm and not get in the way. This was tested manually by running solve_my_problem example against both openai and aws bedrock
- updated readme with bedrock instructions
- left config in the same state as in main branch, so defaulting to openai
- added a couple of useful litellm switches to the config, although did not implement a full set of config options at this point
    @pslusarz
    pslusarz committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    f1e3155 View commit details
    Browse the repository at this point in the history