Crawlers (or bots) are used to assemble data available on the internet. By using web site navigation menus, and reading inner and exterior hyperlinks, the bots begin to grasp the context of a page. Of course, the words, pictures, and other knowledge on pages additionally help search engines perceive