You are not logged in  Login

Playlists  Saved Searches  Help  Profile  Register

Mp3Realm

Search for Audio!





Wednesday, 20 August 2008


Mp3Bot

Mp3Bot is Mp3Realm's owned and operated audio indexing bot that controls how the site operates. Each audio related url will be crawled a maximum of 10 Kilobytes. Down below you will find common questions that have been asked.


Q: How do i stop it from indexing?

You must use a robots.txt (Robot Exclusion Standard). Just simply add the User-Agent as Mp3Bot. The following example will block Mp3Bot from your entire site.

User-agent: Mp3Bot
Disallow: /


Q: Can you tell me IP's so i can block it?

Unforunately,, we can not. Mp3Bot is a distributed crawler meaning many hosts on different addresses run the indexer. Also due to DHCP, dynamic IP's are constantly renewed and refreshed with a new address periodically. You are better off using the Robots Exclusion Standard to block the bot.


Q: Is your software Open-Source?

Not at this time. We have discussed future plans for open-source crawling software. But don't get your hopes up.

Your Playlists


You need to login first

Remember Me



Search Cloud


Low Madonna Akon Genesis Linkin Park dj Scooter beatles Justin Timberlake Britney Spears Chris Brown Avril Lavigne Michael Jackson Kiss ABBA Shakira mark medlock Eminem thomas godoj Rihanna Mariah Carey usher u2 the 50 cent 

Advertisements





Affiliates


TheFreeSite
PlayNES.net
GoArcade