[OpenIndiana-discuss] opensolaris.org shutting down next month
real-men-dont-click at gmx.net
real-men-dont-click at gmx.net
Sat Feb 16 12:26:50 UTC 2013
>
>
> robots.txt at hub.opensolaris.org already forbids to crawl the site:
>
>
> User-agent: *
> Disallow: /*!
>
>
> If I remeber correctly, they replaced the robots.txt since yesterday....
>
> So, the usual web archives are worthless i this case.
>
> http://tinyurl.com/29dwvxf should work, anyway.
>
> cu
>
> _______________________________________________
> OpenIndiana-discuss mailing list
> OpenIndiana-discuss at openindiana.org
> http://openindiana.org/mailman/listinfo/openindiana-discuss
>
OK, wrong robots.txt in previous port (was from www.opensolaris.org), here is the correct one:
User-agent: *
Disallow: /bin/export/
Disallow: /bin/xmlrpc/
Disallow: /bin/pdf/
Disallow: /bin/edit/
Disallow: /bin/inline/
Disallow: /bin/preview/
Disallow: /bin/save/
Disallow: /bin/cancel/
Disallow: /bin/delete/
Disallow: /bin/register/
Disallow: /bin/propupdate/
Disallow: /bin/propadd/
Disallow: /bin/propdelete/
Disallow: /bin/commentadd/
Disallow: /bin/objectremove/
Disallow: /bin/attach/
Disallow: /bin/upload/
Disallow: /bin/download/
Disallow: /bin/dot/
Disallow: /bin/delattachment/
Disallow: /bin/skin/
Disallow: /bin/login/
Disallow: /bin/loginerror/
Disallow: /bin/logout/
Disallow: /bin/status/
Disallow: /bin/lifeblog/
Disallow: /bin/viewrev/
Disallow: /bin/downloadrev/
Disallow: /bin/viewattachrev/
cu
Carsten
More information about the OpenIndiana-discuss
mailing list