No doubt, customers do know then can be very aggressive because there are so many providers to choose from; clearly if it's causing you or your employees stress then yes feel free to tell them nicely to search elsewhere.

No-one has to put up with it.