Yes absolutely, there is a fine line between the two. Therefore your E-mails must be really professional and must have good and useful content. Anything over the mark might create permanent damage to your reputation.

It is better to keep it optional, in the E-mail you must offer an option of unsubscribing.This can help you to retain your reputation.