The problem is muscle memory, particularly with the joy cons. If someone ever makes (good, comfortable, way better than the official Nintendo ones) joycons for the switch 2 with the Xbox layout we'll finally be able to just not worry about it