Description
Describe the bug
The AWS ChatBedrock node throws an error for image upload. Text input works but image upload seems to be calling the wrong inference profile and always defaults to anthropic.claude-3-haiku-20240307-v1:0.
2025-04-09 14:47:01 [ERROR]: [server]: Error: Invocation of model ID anthropic.claude-3-haiku-20240307-v1:0 with on-demand throughput isn’t supported. Retry your request with the ID or ARN of an inference profile that contains this model.
ValidationException: Invocation of model ID anthropic.claude-3-haiku-20240307-v1:0 with on-demand throughput isn’t supported. Retry your request with the ID or ARN of an inference profile that contains this model.
at de_ValidationExceptionRes (/Users/nick.wong/.nvm/versions/node/v20.17.0/lib/node_modules/flowise/node_modules/@langchain/aws/node_modules/@aws-sdk/client-bedrock-runtime/dist-cjs/index.js:1607:21)
at de_CommandError (/Users/nick.wong/.nvm/versions/node/v20.17.0/lib/node_modules/flowise/node_modules/@langchain/aws/node_modules/@aws-sdk/client-bedrock-runtime/dist-cjs/index.js:1424:19)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async /Users/nick.wong/.nvm/versions/node/v20.17.0/lib/node_modules/flowise/node_modules/@smithy/middleware-serde/dist-cjs/index.js:35:20
at async /Users/nick.wong/.nvm/versions/node/v20.17.0/lib/node_modules/flowise/node_modules/@smithy/core/dist-cjs/index.js:167:18
at async /Users/nick.wong/.nvm/versions/node/v20.17.0/lib/node_modules/flowise/node_modules/@smithy/middleware-retry/dist-cjs/index.js:320:38
at async /Users/nick.wong/.nvm/versions/node/v20.17.0/lib/node_modules/flowise/node_modules/@aws-sdk/middleware-logger/dist-cjs/index.js:33:22
at async BedrockChat._streamResponseChunks (/Users/nick.wong/.nvm/versions/node/v20.17.0/lib/node_modules/flowise/node_modules/@langchain/aws/dist/chat_models.cjs:695:26)
at async BedrockChat._streamIterator (/Users/nick.wong/.nvm/versions/node/v20.17.0/lib/node_modules/flowise/node_modules/@langchain/core/dist/language_models/chat_models.cjs:100:34)
at async BedrockChat.transform (/Users/nick.wong/.nvm/versions/node/v20.17.0/lib/node_modules/flowise/node_modules/@langchain/core/dist/runnables/base.cjs:402:9)
at async RunnableBinding.transform (/Users/nick.wong/.nvm/versions/node/v20.17.0/lib/node_modules/flowise/node_modules/@langchain/core/dist/runnables/base.cjs:912:9)
at async ToolCallingAgentOutputParser.transform (/Users/nick.wong/.nvm/versions/node/v20.17.0/lib/node_modules/flowise/node_modules/flowise-components/node_modules/@langchain/core/dist/runnables/base.cjs:391:26)
at async RunnableSequence._streamIterator (/Users/nick.wong/.nvm/versions/node/v20.17.0/lib/node_modules/flowise/node_modules/flowise-components/node_modules/@langchain/core/dist/runnables/base.cjs:1349:30)
To Reproduce
Create chatflow with AWS ChatBedrock and use the model claude 3.7 sonnet
Expected behavior
Image upload should work as well as text input.
Screenshots
Setup
- Flowise version 2.2.7-patch.1