Do you use a HDMI splitter? I had to go through like 5 of those before I found one that played nicely with my PS4, X, switch, 360. HDR, HDCP, 4k is all a big mess since HDR only activates on a game by game basis and takes up more bandwidth (afaik the PS4 and xbox dashboards themselves don't turn on HDR), and I went through 4-5 cables before I found ones I really liked. For what its worth here are the HDMI cables I ended up preferring
www.amazon.com/gp/product/B07FG14RJP
and the HDMI switch I find works really great
www.amazon.com/gp/product/B07DMH9XLZ
my X settings in general / TV and display are
4k UHD
60hz
advanced / video modes
allow 50,24hz uncheck Allow YCC
allow 4k, HDR10, Dolby Vision (LG OLED)
advanced / fidelity
auto detect, 30 bits per pixel, standard color space
You also have to fuck with your TV settings to ensure its got game mode turned on (motion smoothing, processing, etc all OFF) and usually turn on HDMI handshaking and most still require you to enable "yes, this HDMI source can do HDR".
Hopefully HDMI 2.1/2.2 are way better about that stuff, I think it even has some sort of "turn on game mode" flag that automatically turns off all the extra shit when it detects a console is connected.