SuccessfulKoala55 I am using it as follows:
after calling clearml.Task.init()
I create an object:
cache = Cache('/scidata/marek/diskcache')
and then in the loading function I do:
if cache_arg in load_and_crop.cache:
return load_and_crop.cache[cache_arg]
UpsetTurkey67 It would be great if you could write a script we could use to reproduce
I am seeing such warnings clearml.model - WARNING - 9 model found when searching
Hi UpsetTurkey67 ! What if in Task.init
you set auto_connect_frameworks={"joblib": False}
. Do you still have this issue?
SmugDolphin23 let me know if you need any help in reproducing
to avoid loading and cropping a big image
UpsetTurkey67 can you expand on how exactly you're using joblib?
SuccessfulKoala55 any ideas what can be the cause?
but I do agree that some kind of autoconnect may be the issue
SuccessfulKoala55 I have the same problem with diskcache
The problem started appearing when I started to use joblib
with a simple memory caching mechanism.
SmugDolphin23 I have checked that when setting auto_connect_frameworks=False it works, but disabling just joblib is not enough.
UpsetTurkey67 great, thank you! We are taking a look
UpsetTurkey67 can you please open a Github issue as well, so we can better track this one?
SmugDolphin23 it took some time, but I was able to cut 90% of the code, just dataloading remains and the problem persists (which is fortunate, as it makes it easy to replicate). Please have a look.
SmugDolphin23 it did not help, shall I create smallest example when it does not work and paste it here?