: The development of general-purpose AI models requires the creation of massive datasets, often built from publicly available data collected online. Website owners whose content is subject to such collection have a range of tools at their disposal to help them control the data being collected and the ways in which it may be used. The articles in this dossier first introduce the concepts related to online data scraping, before presenting the methods that website publishers can implement to manage and control the data collected by data extraction bots.
: Before examining the means available to website publishers to block the collection of theirdata, it is first necessary to define the practices implemented by search engines and companies developing generative artificial intelligence models. Several concepts are used in this context: crawling , scraping , and TDM (Text and Data Mining). Although these terms refer to similar practices, their exact scope varies depending on usage and interpretation. It is therefore essential to clarify the meaning of each of these terms in order to establish a precise framework for the discussion.