Some of them are illiterate and have no knowledge of the Book except for what they know from legends and fantasy. They are only relying on conjecture.