He is curious. As a fireman he has burned thousands of books, but eventually, he becomes curious as to what is in them that could be all that bad....or good. He begins to stash some away. He also feels guilty about doing it, but does not turn himself or the books in.