# Tells Scanning Robots Where They Are And Are Not Welcome # # User-agent: can also specify by name; "*" is for everyone # Disallow: disallow if this matches first part of requested path # # For now disallow all we can modify this as needed to allow certain crawlers. # User-agent: * Disallow: /45 Disallow: /add Disallow: /genre Disallow: /inst Disallow: /ken Disallow: /mail Disallow: /molen Disallow: /split Disallow: /wacht Disallow: /portretten/ Disallow: /filmpix/ Disallow: /hoezen/ Disallow: /kaften/ Disallow: /kunsten/ Disallow: /leeglinks/