The Great Ace Attorney was actually more specific than that. iirc, Ryunosuke and Susato would also use honorifics if no one else was around, implying they'd default to speaking Japanese if English speakers weren't present.