Like you said, body language can say a heck of alot, and they are obviously reading you like a book, and taking advantage of it.
Next time stand your ground, be confident (show it!) and make eye contact when speaking. You would be surprised at how quick and easy you can turn the coin around.
