Thanks Cahunt
I logged the case with support and eventually got my answer.
It was a problem in the way NPM 10.5 handled Multicast Monitoring, it filled up MSMQ and essentially blocked information from being passed into the DB.
I had to disable my Multicast monitoring to get the problem solved, I could immediately see the difference on the DB Server load as well.
Apparently it was fixed with hot fixes and updates, but I migrated to 10.6.1 now but have not yet tested the multicast monitoring yet.