Locked Out of the Memory Palace