The Future of Research Communications and e-Scholarship

Close this search box.

Why may Google textmine but Scientists may not?

Author: Piwowar, Heather "Check out the robot.txt files for PMC  for /pmc/articles/  and notice that GoogleBot is allowed, Bing and a few others are allowed, but User-Agent:* (the rest of us) are not.  The same is true for ScienceDirect robots.txt:  Google may textmine everything, experimenting scientists, nothing.  (hat tip to Alf Eaton on twitter) Is this defensible on … Read more