User-agent: * Disallow: /index.htm Disallow: /*.htm$ Disallow: /*.php$