How to get a summary from a URL - AI21Labs

0

I have a customer request to test summarizing data from URL links and I believe AI21Labs can do that but cannot find an example with the model deployed via Jumstart. Is this possible?

AWS
ESPECIALISTA
feita há um ano378 visualizações
2 Respostas
0

There is a preloaded endpoint you can deploy using the AWS Marketplace: https://aws.amazon.com/marketplace/pp/prodview-dkwy6chb63hk2.

Otherwise, this link shows example to deploy on SageMaker: https://github.com/AI21Labs/SageMaker, specifically: https://github.com/AI21Labs/SageMaker/blob/main/AI21_Summarize_example_model_use.ipynb. And this blog post shows how to use AI21Labs with Jumpstart: https://aws.amazon.com/blogs/machine-learning/ai21-jurassic-1-foundation-model-is-now-available-on-amazon-sagemaker/

Hope this helps,

Jon

profile pictureAWS
ESPECIALISTA
respondido há um ano
0

For this particular problem I recommend that you use additional strategies.

1.- Place the A21 model as an inference point

2.- It will be necessary to use additional libraries such as LangChain and LlamaIndex to manage the "Prompts" and feed the text. (It will be necessary use of "Embeddings")

3.- Adjust the Langchain (or LlamaIndex it is the same ) call to the model established in point 1

Works very well

The model is just the first step for this particular case.

profile picture
respondido há um ano

Você não está conectado. Fazer login para postar uma resposta.

Uma boa resposta responde claramente à pergunta, dá feedback construtivo e incentiva o crescimento profissional de quem perguntou.

Diretrizes para responder a perguntas