Well basically let me tell you it this way, sites that offer a lot of bandwidth for a little price usually have lower quality bandwidth and much slower download speeds vs sites that have lower bandwidth offerrings and only premium bandwidth will get you faster load times, etc.

Have you thought about splitting it up into 2 sections, one serving up pages with a premium host, and another serving up downloads at a cheap host so that it doesn't effect site load speeds?