Yes, that's a very good way of putting it! Fundamentally, you kind of have to trust/hope that your book will find its audience, and disregard people for whom it very clearly isn't