Showerthoughts @lemmy.world irelephant [he/him]🍭 @lemm.ee 1y ago Robots.txt is just a dni for scrapers.