## robots.txt file for robot exclusion on orgprints.org ## ########################################################## ## Should be in both orgprints/html/en and orgprints/html/de. ## Will be automatically copied to these when running ## generate_static if placed in cfg/static/general. User-agent: * # Adapt these if new sub-directories are added to the archive by way of symlinks Disallow: /backup/ Disallow: /wikiuploads/ Disallow: /wikipub/ Disallow: /farmpub/ Disallow: /test/ # All but subjects and projects views are disallowed to avoid unnecessary and confusing # repetition of hits on search engines. # Add views here if new views are added in the eprints browse_views configuration. Disallow: /view/projects_refereed/ Disallow: /view/subjects_refereed/ Disallow: /view/refereed_type/ Disallow: /view/year_type/ Disallow: /view/doclang_refereed/ # not actually generated at the moment ... Disallow: /view/year/