How about prefixing the caching directories with the inversed URL of the server? Many problems have occurred because we are confusing cache items from the test server with live cache items. This could easily be fixed

In the java connector this is fixed by prefixing the cache directory with the inversed server url, e.g. .openml/cache/org/openml/www/datasets, etc