Dataset

List of User-Agents (Categorized by Spiders, Robots, Crawler, Browser)

Added By Infochimps

A searchable database of user-agents as used by browsers, search-engines spiders and crawlers, web-directories, download managers, link checkers, proxy servers, web filtering tools, harvesters, spambots, badbots. Sorted by the user-agents names with informations about their type, purpose and origin. The info-field at every user-agents entry offers even more information. Recent additions and updates are at the top of each page. The numerous Mozilla variations are not included in the alphabetical assortment “M” and can be found at an own page.

Direct Download of XML Version