Hi, I need to deploy Haystack model for question answering system. I followed below tutorial, but it is failing while making the session with sagemaker. I am getting below error
https://github.com/deepset-ai/haystack-sagemaker
provide custom invocation layer for jumpstart-dft-hf-llm-falcon-40b-instruct-bf16 by subclassing PromptModelInvocationLayer
Please help if someone has any idea about this.
You are not logged in. Log in to post an answer.
A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.