Keep invoice receipts or just original invoice?

[Jason Riddle]

When dealing with invoices, I always end up with atleast 2 documents, the first is the original invoice with the date and amount owed, the second is a receipt showing the invoice paid and the date it was paid on. Is it best to just hold on to both documents? Could I just keep one instead of the other?