It's not currently possible due to the architecture of the notification system. But you can click the inbox link to show just comment notifications and quickly delete all of those, and then whatever's left over will be the stuff you actually want to read.