If it makes you feel any better it doesn't detect activity well even if something is actually playing.

I regularly go to pause Apple Music and the play/pause button on my keyboard instead starts playing a YouTube video in some background tab/window.