It must suck to be the guy Keri Russell was married to before Matthew Rhys