Maintained by deepset
Integration: Amazon Bedrock
Use Models from AI21 Labs, Anthropic, Cohere, Meta, and Amazon via Amazon Bedrock with Haystack
Authors
deepset
Table of Contents
Overview
Amazon Bedrock is a fully managed service that makes high-performing foundation models from leading AI startups and Amazon available for your use through a unified API. You can choose from various foundation models to find the one best suited for your use case. More information can be found on the documentation page.
Installation
Install the Amazon Bedrock integration:
pip install amazon-bedrock-haystack
Usage
Once installed, you will have access to an AmazonBedrockGenerator that supports models from various providers:
- Anthropic’s Claude
- AI21 Labs’ Jurassic-2
- Cohere’s Command
- Meta’s Llama 2
- Amazon Titan language models
AmazonBedrockGenerator
To use this integration for text generation, initialize a AmazonBedrockGenerator with the model name and aws credentials:
from amazon_bedrock_haystack import AmazonBedrockGenerator
aws_access_key_id="..."
aws_secret_access_key="..."
aws_region_name="eu-central-1"
generator = AmazonBedrockGenerator(model="anthropic.claude-v2", aws_access_key_id=aws_access_key_id, aws_secret_access_key=aws_secret_access_key, aws_region_name=aws_region_name)
result = generator.run("Who is the best American actor?")
for reply in result["replies"]:
print(reply)
Output:
'There is no definitive "best" American actor, as acting skill and talent a# re subjective. However, some of the most acclaimed and influential American act# ors include Tom Hanks, Daniel Day-Lewis, Denzel Washington, Meryl Streep, Rober# t De Niro, Al Pacino, Marlon Brando, Jack Nicholson, Leonardo DiCaprio and John# ny Depp. Choosing a single "best" actor comes down to personal preference.'