While having all the notifications on for desktop, the pop-up doesn't show up in the browser.
When a new conversation is started, the sound notification does work. However, after receiving a second message it doesn't.