Support other LLMs / OpenRouter / Azure etc
in progress
J
Jordan
In addition to planning to add other LLMs to choose from. I would personally love to see Straico integrated as well because they're so cheap and have a very wide range of LLMs to select from.
Rafal Zawadzki
hi all, we're hitting a small delay here - unfortunately still waiting for one dependency to progress with a bug fix.
will launch this when we're sure everything works as expected
Rafal Zawadzki
in progress
C
Chris Tucker
@Rafal Zawadzki OpenRouter is the best approach, under my current understanding (which could change). This would enable the integration of numerous LLMs at lightning speed, opening up a world of possibilities while minimizing constant development efforts related to this.
Rafal Zawadzki
Chris Tucker agreed! It's already implemented but we're waiting for OpenRouter team to help with some remaining details.
For now the list of models will be handpicked to meet our criteria (ie performance and function calling support).
C
Chris Tucker
Rafal Zawadzki Any luck with OpenRouter support?
Rafal Zawadzki
Chris Tucker yup, it's pretty much done but needs more testing before rollout (crucial part of the product)
C
Chris Tucker
Rafal Zawadzki Awesome. What an amazing product you have!
Rafal Zawadzki
Rafal Zawadzki
planned
Rafal Zawadzki
Rafal Zawadzki
hi Kevin, yes that makes sense, especially with emergence of very competitive models like Claude. I'll merge your feature request to another one that already has lots of upvotes.
Rafal Zawadzki
Merged in a post:
Enable Function Calling with LLMs like Claude, Gemini, and Lllama 3
C
Chris Tucker
Currently, Chatwith's bots rely solely on OpenAI models. While OpenAI offers excellent language capabilities, other LLMs like Claude, Gemini, and Lllama 3 are emerging as strong contenders with distinct advantages, particularly in areas like:
Function Calling: These models excel at executing external functions, enabling chatbots to perform actions beyond simply responding with text. This could involve accessing databases, retrieving information, generating images, or interacting with third-party services - all within the chatbot flow.
Cost-effectiveness: Compared to OpenAI's models, alternatives like Claude and Gemini often offer comparable performance at a lower cost, making them a more budget-friendly option for chatbot developers.
Real-world performance: Independent benchmarks and user feedback indicate that these LLMs often outperform OpenAI in terms of accuracy, responsiveness, and overall user experience in real-world scenarios.
Any additional details:
Integrating these LLMs with their function calling capabilities would offer immense value to Chatwith users:
Enhanced chatbot functionality: Chatbots could become more dynamic and interactive, performing real-world tasks and delivering more personalized and relevant responses.
Increased flexibility: Developers would have more options to tailor their chatbots to specific needs and budgets, choosing the LLM that best suits their requirements.
Competitive edge: Offering alternative LLMs would position Chatwith as a more robust and modern chatbot platform, attracting users seeking advanced capabilities.
Request:
We request that Chatwith expands its LLM support to include robust models with function calling features, like Claude, Gemini, and Lllama 3. This would unlock a new level of functionality, improve cost-effectiveness, and enhance the overall chatbot development experience within the Chatwith ecosystem.
Rafal Zawadzki
hi Chris Tucker thanks for adding a feature request.
Function Calling is already available on Chatwith. It's called Actions and you can learn how to use it here: https://chatwith.tools/help
Regarding the option to use alternative models, it's definitely on my radar, especially with emergence of competitive models like Claude.
If it's implemented it would most likely be enabled through OpenRouter. Therefore I'll merge your feature request into this ticket: https://chatwith.canny.io/feature-requests/p/openrouter-integration
C
Chris Tucker
Rafal Zawadzki I'm your biggest fan. :)
Load More
→