Good points. I had the same thoughts as far as getting out of dodge, perhaps even going to a foreign country.
It sounds like you may have hit the jackpot with the new neighbors. We also have a doctor nearby and have become friends them. Her husband is a very aware guy, and they are a real benefit to the neighborhood. One of the nice things is that being rich does not require you to be a jerk.