Just curious what headphones are you using, because like others said I too have never seen such an issue.
On googling I read netflix doing this due to some DRM restriction, but then I am using a Shield TV with a 4K tv and never saw such a phenomenon.