Ruby library to help write robots.txt compliant web robots
