Uh, your five year old can definitely remember and comprehend what they did during the day.

So can your four year old. And probably your three year old. Two might be pushing it, but why would you be punishing your two year old at the end of a day anyway?