Some people do, but it’s controversial whether or not oysters are vegan. They don’t have brains or nervous systems, which means they (likely) don’t feel pain. I don’t know how long they live, and I’ve found a few large ones nearby, so keeping them around just to filter water is a huge benefit
