I’ve set my iPhone to go directly to voicemail if they aren’t in my contacts. It’s much better. Before that I would answer but not say anything. It was weird for a second but most of the time I would just hear the disconnect.