- Audio & Multimedia
- Business
- Communications
- Desktop
- Development
- Education
- Games
- Graphics
- Home & Hobby
- Network & Internet
- Screen Savers
- Security & Privacy
- Servers
- System Utilities
- Web Development
- SSuite NetSurfer Browser x64
- UltraFileSearch Std
- Pen Drive Recovery Free
- Aiseesoft iPhone Cleaner...
- AnyMP4 Blu-ray Ripper
- Apeaksoft iOS Unlocker
- Apeaksoft Screen Recorder...
- AnyRec Video Enhancer
- Windows Data Files Undelete
- Data Unerase Software
- Mac Removable Media File...
- Data Recovery Software
- Vista Partition Data...
- Softaken MS PowerPoint...
- Verwijderde Bestanden...
- ADRC Data Recovery Tools
- avast! Antivirus
- Revo Uninstaller
- Java Runtime Environment
- AVG Anti-Virus Free Edition
- GOM Media Player
- RegSeeker
- IrfanView
- CPU-Z
- Malwarebytes Anti-Malware
- Spybot Search & Destroy
- Skype
- µTorrent
-
2Printer 5.5
Enables you to print any type documents or files in bath mode one after another specifying the paper size and without any...
-
Vivaldi for MacOS 6.6
No ad browser and uses minimum memory, takes very less time to load, some unique features added like notes containing...
-
Win PDF Editor 3.6.3
Editing PDF documents was like nightmare for me but when I am suggested by one of colleagues I tried this and found that...
-
Serial to Ethernet Connector 9.0
It can successfully turn your computer to a terminal server so that any device connected to the com port will be...
-
ShutUp10 1.4.1388
This software will let you take the full control over your windows 10 and decide which program to start automatically or...
-
TeraCopy 3.26
Copies files seamlessly from source to target location, also detects errors while transferring and rectifies it.
-
Ulysses for Windows 2.7.11
Writing application with most of useful features that a standard word processor may offer like markdown, emerging to...
-
InjuredPixels 4.0
It will repair the damaged pixels of the display unit so that it can still be usable for some more days instead of buying...
-
DrvInfo 1.2.0.2016.0
The software will show you the details of a drive as soon as it is inserted into the port whether it is a floppy, flash...
-
Unreal Commander 3.57
Can see the files in windows. You may copy, cut and paste right from there or upload to server directly.
System Utilities / Other / RoboGen ROBOTS.TXT Editor 1.52
RoboGen ROBOTS.TXT Editor 1.52
Advertisement
Advertisement
RoboGen ROBOTS.TXT Editor 1.52 Description
RoboGen is a visual editor for Robot Exclusion Files. It allows the user to quickly and easily create the ROBOTS.
RoboGen is a visual editor for Robot Exclusion Files. It allows the user to quickly and easily create the ROBOTS.TXT files required to instruct web search engines which parts of a web site are not to be indexed and made searchable by the general web public. RoboGen does this by providing the user a way to log onto his FTP server and then select the documents and directories which are not to be made searchable. RoboGen maintains a database of over 180 search engine user-agents, which are selectable from a drop down menu.
OS: Win95, Win98, WinME, WinXP, Windows 2000
System Requirements: Windows Installer
Tags: Robots Txt - Search Engine - Robot Exclusion - Robot Meta Tag - Martijn Koster
User Reviews of RoboGen ROBOTS.TXT Editor
-
Whois Web Professional 4.2 Whois Web Professional is a Windows-based application that runs queries of whois servers to obtain ownership information of Internet domain names and IP addresses. The key features include: (1) Easy-to-use tabbed interface... Download