{"json_modified": "2016-03-28T08:42:34.467460", "uuid": "f38f5dbe-9fbc-48dc-9251-25a42be560c1", "title": "Crawler", "url": "/en-US/docs/Glossary/Crawler", "tags": ["Crawler", "Infrastructure", "Browser", "Glossary"], "translations": [{"uuid": "1d441764-0b3b-4a36-b8fa-c75d06f03f9c", "title": "Robot d'indexation", "url": "/fr/docs/Glossaire/Robot_d_indexation", "tags": ["Glossaire", "Navigateur", "Robot d'indexation", "Infrastructure"], "summary": "Un robot d'indexation est un programme, souvent appel\u00e9 bot ou robot, qui parcourt de mani\u00e8re syst\u00e9matique le <a class=\"glossaryLink\" href=\"/fr/docs/Glossaire/World_Wide_Web\" title=\"Web&#xA0;: Le World Wide Web&#x2014;commun&#xE9;ment appel&#xE9; WWW, W3, ou le Web&#x2014;est un syst&#xE8;me de pages web publiques interconnect&#xE9;es &#xE0; travers l'Internet. Le Web et l'Internet ne sont pas la m&#xEA;me chose : le Web est l'une des nombreuses applications b&#xE2;ties au-dessus de l'Internet.\">Web</a> pour collecter des donn\u00e9es \u00e0 partir des pages web. Les moteurs de recherche utilisent g\u00e9n\u00e9ralement des robots d'indexation pour construire leurs index.", "localization_tags": [], "locale": "fr", "last_edit": "2016-01-25T14:56:03", "review_tags": []}, {"uuid": "464a8d85-a99c-451a-92ef-3ad5437727b0", "title": "Crawler", "url": "/ja/docs/Glossary/Crawler", "tags": ["Crawler", "glossary", "Infrastructure", "Browser", "Glossary"], "summary": "Web crawler \u306f\u3001\u4e00\u822c\u7684\u306b bot \u3084 robot \u3068\u547c\u3070\u308c\u308b\u30d7\u30ed\u30b0\u30e9\u30e0\u3067\u3059\u3002crawler \u306f\u81ea\u52d5\u7684\u306b <a class=\"glossaryLink\" href=\"/ja/docs/Glossary/World_Wide_Web\" title=\"&#x3053;&#x306E;&#x7528;&#x8A9E; (Web) &#x306E;&#x5B9A;&#x7FA9;&#x306F;&#x307E;&#x3060;&#x66F8;&#x304B;&#x308C;&#x3066;&#x3044;&#x307E;&#x305B;&#x3093;&#x3002;&#x305C;&#x3072;&#x3054;&#x5BC4;&#x7A3F;&#x304F;&#x3060;&#x3055;&#x3044;&#xFF01;\">Web</a> \u3092\u30d6\u30e9\u30a6\u30ba\u3057\u3001Web \u30da\u30fc\u30b8\u304b\u3089\u30c7\u30fc\u30bf\u3092\u53ce\u96c6\u3057\u307e\u3059\u3002\u4e00\u822c\u7684\u306b\u3001\u691c\u7d22\u30a8\u30f3\u30b8\u30f3\u306f\u3001crawler \u3092\u4f7f\u7528\u3057\u3066\u30a4\u30f3\u30c7\u30c3\u30af\u30b9\u3092\u69cb\u7bc9\u3057\u307e\u3059\u3002", "localization_tags": [], "locale": "ja", "last_edit": "2016-03-08T05:57:06", "review_tags": []}], "modified": "2015-07-08T13:24:24", "label": "Crawler", "localization_tags": [], "locale": "en-US", "id": 134655, "last_edit": "2015-07-08T13:24:12", "summary": "A web crawler is a program, often called a bot or robot, which systematically browses the <a class=\"glossaryLink\" href=\"/en-US/docs/Glossary/World_Wide_Web\" title=\"Web: The World Wide Web&#x2014;commonly referred to as WWW, W3, or the Web&#x2014;is a system of interconnected public webpages accessible through the Internet. The Web is not the same as the Internet: the Web is one of many applications built on top of the Internet.\">Web</a>\u00a0to collect data from webpages. \u00a0Typically search engines use crawlers to build indexes.", "sections": [{"id": "Learn_more", "title": "Learn more"}], "slug": "Glossary/Crawler", "review_tags": []}