Add a bot to your server that reacts to every single message on a ~10 minute delay. Long enough for them to close the app and forget about the messages, then the reactions start rolling in. And the reaction notifications only get sent to the original sender.