I'm in Web Design business for years, so I have been transferring files for a living

Jokes aside, this has been a constant issue (three years now), but I wouldn't call it an issue because it's not really a problem, I just raised a question to see what could be the cause.
I'm using Dreamweaver, FileZilla and Total Commander for FTP.
ISP is not an issue I'm sure, because this server speed has been the same on two different providers.
I repeat, this is not an issue but I wanted to know what are the possibilities. I'm guessing the main factor is geographical distance? This is now a pickle because I'm pretty satisfied with this host and I don't want to change it, but hosts in my country are so damn fast.
