*You ask a language model to help draft a paragraph. It gives you something that feels exactly right. You lightly edit it and move on. What you don’t see is that the substance and flow of the paragraph closely track a paper you have never read, absorbed into the model during training and now influencing your work indirectly, through its influence on parameter weights.
That is the provenance probl…*