That's really weird, but I remember in the past there were some older usb-a ports that did not send enough power to charge some stuff, perhaps your headset requires a higher current than the controller or something.

Here I can charge my laptop (although slowly) via the usb-c on my PC. All other devices work fine too.