.Google's Gary Illyes uncovers Googlebot gathers web links instead of "complying with" all of them, opposing formal documentation.Googlebot picks up links rather than following all of them in real-time.Gary Illyes shared this info in Google.com's 'Search Off The Document' podcast.Google.com's records opposes the genuine spider actions.