What Does Spider Trap Mean?
A spider trap is an online feature that traps a web crawler or bot in an infinite loop or other recursive situation that takes up its resources and essentially ties up that crawler for a specific set of iterations.
Techopedia Explains Spider Trap
Some spider traps are made to intentionally divert the attention of web crawlers. For example, someone may program a deep directory structure so that the web crawler goes crawling down into that structure instead of moving to other areas of a site or online space. Programmers can also overload the crawler’s lexical analyzer, or load up a session with cookies in order to drain the resources of spambots or other crawlers.
