Yep, that's correct! All of his memories don't come flooding back until he touches the Death Note again -- prior to that, memory-less Light thought that the idea of him being Kira was the most ridiculous notion ever.