Actually the other way as the science says they don't.When you're 80 you have twice as much to remember as someone who is 40 and four times as much to remember as someone who is 20, and eight times as much to remember as someone who is 10. Is it surprising that people who are older forget more?
That one of the things the Memory Code hits home with is just how impressive our ancestors must have been compared to us now.