# Prevent crawlers from indexing any internal pages User-agent: * Disallow: /internal/