It is entirely possible, since Circe and all the other fantastical elements only appear in flashback, that Odysseus is an unreliable narrator. It is heavily implied that Athena herself is very not real