# All robots will spider the domain
User-agent:*
Disallow:/cgi-bin/
Disallow:/images/
Disallow:/classes/
Disallow:/update_hotel/
Disallow:/xml/
Disallow:/dev/
Disallow:/menu.php
Disallow:/header.php
Disallow:/footer.php
Disallow:/int.php
Disallow:/multi.php