This is completely normal for our switching PSU. It's sounds more like a high pitched whine than buzzing.
The noise will go away when it's being loaded more (games, programs, charging.. etc) or when unplugged.
If your power adapter was faulty, you would be experiencing power related symptoms (turning on, staying on, system instability, extremely hot to the touch .. etc.)