[OpenIndiana-discuss] opensolaris.org shutting down next month

real-men-dont-click at gmx.net real-men-dont-click at gmx.net
Sat Feb 16 12:26:50 UTC 2013


> 
> 
> robots.txt at hub.opensolaris.org already forbids to crawl the site:
> 
> 
> User-agent: *
> Disallow: /*!
> 
> 
> If I remeber correctly, they replaced the robots.txt since yesterday....
> 
> So, the usual web archives are worthless i this case.
> 
> http://tinyurl.com/29dwvxf should work, anyway.
> 
> cu
> 
> _______________________________________________
> OpenIndiana-discuss mailing list
> OpenIndiana-discuss at openindiana.org
> http://openindiana.org/mailman/listinfo/openindiana-discuss
> 


OK, wrong robots.txt in previous port (was from www.opensolaris.org), here is the correct one:


User-agent: *
Disallow: /bin/export/
Disallow: /bin/xmlrpc/
Disallow: /bin/pdf/
Disallow: /bin/edit/
Disallow: /bin/inline/
Disallow: /bin/preview/
Disallow: /bin/save/
Disallow: /bin/cancel/
Disallow: /bin/delete/
Disallow: /bin/register/
Disallow: /bin/propupdate/
Disallow: /bin/propadd/
Disallow: /bin/propdelete/
Disallow: /bin/commentadd/
Disallow: /bin/objectremove/
Disallow: /bin/attach/
Disallow: /bin/upload/
Disallow: /bin/download/
Disallow: /bin/dot/
Disallow: /bin/delattachment/
Disallow: /bin/skin/
Disallow: /bin/login/
Disallow: /bin/loginerror/
Disallow: /bin/logout/
Disallow: /bin/status/
Disallow: /bin/lifeblog/
Disallow: /bin/viewrev/
Disallow: /bin/downloadrev/
Disallow: /bin/viewattachrev/


cu

Carsten



More information about the OpenIndiana-discuss mailing list