Home » A-Z Proxies Bot V0.2
The A-Z Proxies Bot is our proxy-crawling robot. This page will provide you with answers to the most commonly asked questions about how our robot works.
- How does the A-Z Proxies Bot identify itself?
- How often will the A-Z Proxies Bot access my web proxy?
- How much bandwidth does the A-Z Proxies Bot use?
- Which files does the A-Z Proxies bot access?
- Does the A-Z Proxies bot attempt to use the web proxy to access a web site?
- Does the A-Z Proxies Bot obey the Robots Exclusion Standard?
- How do I prevent the A-Z Proxies Bot from accessing my web proxy?
- What happens if I just block the A-Z Proxies Bot IP Address?
1. How does the A-Z Proxies Bot identify itself?
The following user agent will appear in your log files:
"A-Z Proxies Bot V0.2 - http://www.azproxies.com/bot.html"
Where V represents the version number of the bot.
2. How often will the A-Z Proxies Bot access my web proxy?
Typically the A-Z Proxies Bot will attempt to access your web proxy multiple times each day to ensure that your web proxy is responding to HTTP requests. In addition the bot will perform a monthly check to determine the software that your web proxy is using.
3. How much bandwidth does the A-Z Proxies Bot use?
The A-Z Proxies Bot has been specifically developed with your bandwidth in mind. The bot will only request the minimum amount of information that it needs to determine if your web proxy is responding to HTTP requests, each request will typically result in less than 500 bytes of data being transfered. During the monthly software check the bot will request the full contents of your homepage and you will notice an increase in the data transfered during this once a month check.
4. Which files does the A-Z Proxies bot access?
The A-Z Proxies Bot will only attempt to access your homepage. The bot will not follow links or access any other pages on your web proxy.
5. Does the A-Z Proxies bot attempt to use the web proxy to access a web site?
No, under no circumstance will the A-Z Proxies Bot attempt to use your web proxy to access any web sites.
6. Does the A-Z Proxies Bot obey the Robots Exclusion Standard?
No the A-Z Proxies Bot does not obey the Robots Exclusion Standard. To ensure that we are not wasting any of your bandwidth we do not request the robots.txt file nor parse it for instructions. The A-Z Proxies Bot is an integral part of ensuring the proxy list only includes active web proxies and as such requires access to all proxies contained in the list.
7. How do I prevent the A-Z Proxies Bot from accessing my web proxy?
Please contact us and request that your web proxy is removed from the A-Z Proxies web proxy list. After removal from the list the A-Z Proxies Bot will no longer visit your web proxy.
8. What happens if I just block the A-Z Proxies Bot IP Address?
Unfortunately if you decide to block the A-Z Proxies Bot from accessing your web proxy then your web proxy will be automatically removed.
