robots.txt file and doctype declaration

I would be happy to help you with your project and supply you with the coding you need. I can also help write the robots file if you will indicate what parts of your site you do not want robots to visit.

concerning doctype. in the code:

Once you tell me what you need to skip I can make your robots txt file, and examine your site and tell you what sort of doc it is. Robots txt will take all of a couple of minutes

This is, at most, about ten minutes worth of work... see PMB.