I'd agree with keeping the information indefinitely, however, as a second option, I'd keep it as long as it's necessary for your taxing authority. US IRS requirements, if memory serves, would be 5 years at a minimum. You'd need to verify that though.