That doesn't sound good. Do you use the 5GHz wireless frequency? As that can sometimes cause buzzing.
With regards to a new router, I've provided you with some info over here.
I hope this helps.
From 31st October 2022, I no longer have a regular presence here as I’ve moved on to a new role.