You cannot justify your actions by saying that no one but the author can accuse you of content theft. Anyone can accuse you as long as the proof is valid. The owner is the only one who can take legal action though.
If you had some form of written permission from the original author to use his/her works, then it would be ok. Otherwise, you are fighting a losing battle.
Whether it's one sentence or an entire site, it's still wrong.