In the safety engineering literature, we don't really believe in "accidents". You build a system, it does a thing, if you don't like what it does, that's on you for having built it, and you get to restructure the system to avoid such unacceptable losses in the future.
Mike IsaacsonI think people are very credulous to take OpenAI's claim that a major hack by their software was "accidental" at face value