Update README.md

README.md

@@ -477,7 +477,7 @@ especially if the content originates from less-regulated sources or user-generat
 
 This dataset is constituted by combining several sources, whose acquisition methods can be classified into three groups:
 - Web-sourced datasets with some preprocessing available under permissive license (p.e. Common Crawl).
-- Domain-specific or language-specific raw crawls (p.e. Spanish Crawling).
+- Domain-specific or language-specific raw crawls, always respecting robots.txt (p.e. Spanish Crawling).
 - Manually curated data obtained through collaborators, data providers (by means of legal assignment agreements) or open source projects
   (p.e. CATalog).