If someone moves in on you and it bothers you why not just say something to them. That sure sounds better than stewing about it and letting it ruin your day.
Now how close is to close? In a community hole 20′ may be good. On a wide open spot you better give me a little more room or I may mention it to you. You wont find me on a community hole to often.