How to get a summary from a URL - AI21Labs

0

I have a customer request to test summarizing data from URL links and I believe AI21Labs can do that but cannot find an example with the model deployed via Jumstart. Is this possible?

AWS
EXPERT
asked a year ago364 views
2 Answers
0

There is a preloaded endpoint you can deploy using the AWS Marketplace: https://aws.amazon.com/marketplace/pp/prodview-dkwy6chb63hk2.

Otherwise, this link shows example to deploy on SageMaker: https://github.com/AI21Labs/SageMaker, specifically: https://github.com/AI21Labs/SageMaker/blob/main/AI21_Summarize_example_model_use.ipynb. And this blog post shows how to use AI21Labs with Jumpstart: https://aws.amazon.com/blogs/machine-learning/ai21-jurassic-1-foundation-model-is-now-available-on-amazon-sagemaker/

Hope this helps,

Jon

profile pictureAWS
EXPERT
answered a year ago
0

For this particular problem I recommend that you use additional strategies.

1.- Place the A21 model as an inference point

2.- It will be necessary to use additional libraries such as LangChain and LlamaIndex to manage the "Prompts" and feed the text. (It will be necessary use of "Embeddings")

3.- Adjust the Langchain (or LlamaIndex it is the same ) call to the model established in point 1

Works very well

The model is just the first step for this particular case.

profile picture
answered a year ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions