Provide detailed instructions for incorrect answers with thumbs up/down
J
Jesco Verheijen
You want the AI agent to receive more detailed feedback than just a thumbs down. This would help the agent to improve further. With CHATGPT: When you give a thumbs down on an answer, the agent might ask you to provide more context about why you made that choice. You could indicate that the answer is factually incorrect, that you don't like the style, or that the instructions were not fully followed (see photo). This type of detailed feedback would enable the AI agent to better understand exactly what went wrong, and would ultimately improve the agent's strength and effectiveness.
J
Jesco Verheijen
With a thumbs down, you now have to add a completely new instruction.
Perhaps with defined feedback categories, you can train an AI agent faster because he now learns from the mistakes made?
We would love to hear about your experiences here.
I have additions or comments to many of the answers. Instead of constantly making substantive changes to the domain knowledge or adding new instructions, it might be more efficient to be able to provide the reason or explanation for each answer. This way, the AI agent knows better what the adjustment is based on and where to look specifically to improve/optimize the answer.
These will be the following 3 main pillars:
- Answer is wrong/factually incorrect
- The answer is incomplete/additional information needed
- I don't like the style (for example, the writing style, the length of the response, or the tone: too direct, too cumbersome, or not appropriate to the situation)
> In certain contexts or conversations, it is desirable to give a short, to-the-point answer, while in other cases, a more comprehensive and explanatory answer is needed. Instead of predetermining this with fixed instructions, as an employee, you can indicate what you prefer by using the thumb icon)
With ChatGPT, you have both defined feedback categories and the ability to write customized feedback. Only then does it become a bit more of an instruction. Perhaps good to have 3 to 5 in advance as they occur most often.
A
Alex prakken
Jesco Verheijen I totally agree, we're experiencing the same thing.
B
Brenda - Bioscoopbon
Jesco Verheijen I agree with this too!
Fleur Nouwens
Hello Jesco Verheijen! I have a few more questions for you:
- What specific types of feedback options would be most useful for your needs?
- How often do you find the need to provide detailed feedback beyond a simple thumbs up or down?
- Would you prefer predefined feedback categories or the ability to write custom feedback?