"People should just be okay with an ambient level of antisocial behavior" people will not just! You can't build a society around "just let people do hard drugs in front of your children, it's fine!" They will turn to other people who don't think they should do that.
