Ask the user in the end of the conversation, if the conversation was useful. They can then upvote an downvote. If they downvote there should be the option to provide more detailed feedback.
There should then be an analysis in the dashboard how many people upvoted and downvoted and there should be an option to also read the feedback.