There's something very vulnerable about him that he continuously reveals without knowing it (e.g., seeing someone who looks like Randazza calling other people goblins isn't exactly lovable, but it is oddly moving).
Responding to that with kindness isn't something you should feel bad about imo.