I’m running into a similar issue in a thread I posted in Site Issues. Though, in my case the numbers go away if I refresh the forum (which Discourse calls a category) page. I’ve reported it as a bug.
They appear to be the same numbers you get when you actually follow a thread. But I have the “automatic follow” feature turned off.