The reason so few ostensibly progressive people are actually for open borders is because if they erase the arbitrary line on the map they'd have to reckon with the fact that the wealth with which they plan to build their utopia is unjustly hoarded by 10% of the world's population from the other 90%
