Does google penalize you if you are using lets say some ad network where rotatable textlinks appear on your site, once you have placed their code?

I have found few people argue over Coop ads (Digitalpoint) and they have said that google penalized them by dropping them 3-4 pages in search results.

Don't know truth but is it so?

Does google penalize you?