


To generate name cloze passages for your own texts, see the generate_name_cloze folder. He put chips under it, blocks of various sorts, bits of pasteboard, and at last went so far as to attempt an exquisite adjustment by final pieces of folded blotting paper.ĭetailed results on all books can be found here: gpt4-books. Though of a very ingenious mechanical turn, could never get this table to suit him. This work probes what books GPT-4 and ChatGPT have memorized by assessing the degree to which models are able to predict the masked token (a proper name) in name cloze passages like the following: Chang, Mackenzie Cramer, Sandeep Soni and David Bamman (2023), " Speak, Memory: An Archaeology of Books Known to ChatGPT/GPT-4", ArXiv. Code and data to support the following paper:
