The Ultimate Guide to synthetic dataset

https://www.longisland.com/profile/insammsowm/

This enables Goggle (user-agent name GoogleBot) to go to every page and Listing, whilst at the same time banning Talk to Jeeves through the web page entirely