.Google's Gary Illyes reveals Googlebot collects links as opposed to "adhering to" them, opposing official paperwork.Googlebot picks up hyperlinks as opposed to following all of them in real-time.Gary Illyes discussed this details in Google's 'Look Off The Record' podcast.Google's documentation contradicts the actual crawler behavior.