Robot | Path | Permission |
GoogleBot | / | ✔ |
BingBot | / | ✔ |
BaiduSpider | / | ✔ |
YandexBot | / | ✔ |
# robots.txt viewer # Author: Nico Hemkes (www.hemk.es) User-agent: * Disallow: /robots/checksum/*.txt Disallow: /robots/checksum/*.json Disallow: /out/ Disallow: /robots/compare/ Disallow: |
Title | robots.txt check - look in a robots.txt file | robots.txt |
Description | I like to look into robots.txt files on websites. So I create a google chrome and mozilla firefox extension for |
Keywords | robots.txt lookup, robots.txt viewer, firefox addon, chrome extension |
WebSite | robots-viewer.com |
Host IP | 93.177.65.235 |
Location | - |
Site | Rank |
US$889,299
Last updated: 2023-05-19 17:34:28
robots-viewer.com has Semrush global rank of 11,901,860. robots-viewer.com has an estimated worth of US$ 889,299, based on its estimated Ads revenue. robots-viewer.com receives approximately 102,612 unique visitors each day. Its web server is located in -, with IP address 93.177.65.235. According to SiteAdvisor, robots-viewer.com is safe to visit. |
Purchase/Sale Value | US$889,299 |
Daily Ads Revenue | US$821 |
Monthly Ads Revenue | US$24,627 |
Yearly Ads Revenue | US$295,521 |
Daily Unique Visitors | 6,841 |
Note: All traffic and earnings values are estimates. |
Host | Type | TTL | Data |
robots-viewer.com. | A | 299 | IP: 93.177.65.235 |
robots-viewer.com. | NS | 86400 | NS Record: dion.ns.cloudflare.com. |
robots-viewer.com. | NS | 86400 | NS Record: dora.ns.cloudflare.com. |
robots.txt viewer Startpage Statistics Extension Domains Changelog Chrome Firefox robots.txt viewer I like to look into the robots.txt file on websites. The content is interesting, revealing and sometimes funny The most comfortable way to take a look at the robots.txt file is done with one click Just one click, not more! Chromium based browsers Chrome, Edge, Opera - Finde me @ google chrome webstore. visit google chrome webstore Mozilla Firefox Also available for mozilla firefox. visit firefox addon center How it works Click on the robots.txt viewer icon in your chrome or firefox browser tab and look at the websites robots.txt file content. You can open the robots.txt file directly over the link-icon on the right. robots.txt viewer a browser extension by @turbopixel privacy | |
HTTP/1.1 301 Moved Permanently Server: nginx/1.14.2 Date: Thu, 03 Nov 2022 08:41:10 GMT Content-Type: text/html Content-Length: 185 Connection: keep-alive Location: http://www.robots-viewer.com/ HTTP/1.1 301 Moved Permanently Server: nginx/1.14.2 Date: Thu, 03 Nov 2022 08:41:10 GMT Content-Type: text/html Content-Length: 185 Connection: keep-alive Location: https://www.robots-viewer.com/ X-Powered-By: TinyCP HTTP/2 200 server: nginx/1.14.2 date: Thu, 03 Nov 2022 08:41:10 GMT content-type: text/html; charset=UTF-8 x-powered-by: TinyCP strict-transport-security: max-age=600; preload x-xss-protection: 1; mode=block x-content-type-options: nosniff referrer-policy: no-referrer-when-downgrade |
Domain Name: ROBOTS-VIEWER.COM Registry Domain ID: 2169017403_DOMAIN_COM-VRSN Registrar WHOIS Server: whois.enterprice.net Registrar URL: http://www.epag.de Updated Date: 2022-10-01T07:24:12Z Creation Date: 2017-09-30T13:52:46Z Registry Expiry Date: 2023-09-30T13:52:46Z Registrar: EPAG DOMAINSERVICES GmbH Registrar IANA ID: 85 Registrar Abuse Contact Email: legal@tucows.com Registrar Abuse Contact Phone: +1.4165350123 Domain Status: ok https://icann.org/epp#ok Name Server: DION.NS.CLOUDFLARE.COM Name Server: DORA.NS.CLOUDFLARE.COM DNSSEC: unsigned >>> Last update of whois database: 2022-11-03T08:38:01Z <<< |