Using LLMs can improve conversation quality with fewer examples.
| Function | LLMs | Local Model | Remark |
|---|---|---|---|
| FAQ | ✅ | ✅ | |
| Flow | ✅ | ✅ | |
| Knowledge Base | ✅ | ❌ | Only support LLMs, using Retrieval-Augmented Generation (RAG) |
1、Before you enable LLMs on Flows, you need to enable LLMs on FAQ first.
2、You can config your OpenAI API Key on our platform or use the tokens we purchased from OpenAI. If you have other need, please contact us: info@promptai.us
LLMs Tokens
Tokens will be consumed during the training and conversations. Currently, 100,000 free tokens will be given to each registered user to start.
Where OpenAI tokens will be used:
- FAQ embedding
- Text embedding in Knowledge Bases
- User utterance embedding in Flows
- User utterance embedding during conversations
For more details please visit:Pricing Page
Enable LLMs
In the LLMs setting, you can enable the use of LLMs on FAQ and Flow. Please debug/run/re-publish your bot to make the new setting effective.
FAQ:
1.There are one option when activating LLMs on FAQ:
- When answering the FAQ, the bot will display other related questions.
Users can click on questions that might be related to view other possible answers.
Knowledge Base:
- When answering a question not in the FAQ, the bot could generate answers from the knowledge bases.
Based on the generation capability of LLMs, summarize and answer the user’s questions. A check source link will appear next to the answer to display the original source content.
Flow:
Pretrained LLMs such as ChatGPT and GPT-4 will dramatically improve conversation quality. In zero or few shot training, ChatGPT performs much better than the DIET algorithm in RASA in terms of intent classification and entity recognition.
Common Questions
1. Can the bot have a conversation after tokens are used up?
No, the conversation will not continue:
We're sorry, but due to insufficient funds in the merchant's account, we are unable to provide our services at this time.Before your tokens run short, we will send an alert to your registered email account.
2. Can I choose to use other LLMs besides ChatGPT/GPT-4?
Yes. Please contact us: info@promptai.us and we will add it.
3. What should I do if I am interested in obtaining more tokens?
Please contact us: info@promptai.us . We could purchase more with the same price offered by OpenAI.
4. Do I need to retrain after turning off the LLMs mode?
Yes. After enabling or disabling LLMs, debug/run/re-publish your project is required.
5. What’s a token?
You can think of tokens as pieces of words used for natural language processing. For English text, 1 token is approximately 4 characters or 0.75 words. As a point of reference, the collected works of Shakespeare are about 900,000 words or 1.2M tokens.
To learn more about how tokens work:
Experiment with OpenAI interactive Tokenizer tool.