Hey @<1577468626967990272:profile|PerplexedDolphin99> , yes, this method call will help you limit the number of files you have in your cache, but not the total size of your cache. To be able to control the size, I’d recommend checking the ~/clearml.conf
file in the sdk.storage.cache
section
in the documentation i only see these parameters
and there is no other options
can you guide me to other cache parameters?
@<1537605940121964544:profile|EnthusiasticShrimp49>
Thanks for pointing this out, we will need to update our documentation. Still, if you manually inspect the ~/clearml.conf
file you will see the available configurations
storage {
cache {
# Defaults to system temp folder / cache
default_base_dir: "~/.clearml/cache"
# default_cache_manager_size: 100
}
i see
so, if i change default_cache_manager_size
variable to some utterly big number (like 1 trillion files) - all should be fine?
and did it have some default value?
Wait, my config looks a bit different, what clearml package version are you using?
it was config generated by clearml init
command
i generate another one with clearml-agent init
comand
this is how it looks like
storage {
cache {
# Defaults to system temp folder / cache
default_base_dir: "~/.clearml/cache"
size {
# max_used_bytes = -1
min_free_bytes = 10GB
# cleanup_margin_percent = 5%
}
}
btw
$ pip freeze | grep clearml
clearml==1.11.0
clearml-agent==1.5.2
so. if i understand it right. i should uncomment max_used_bytes = -1
string?
or place there some big number?
Yes, that is correct. Btw, not it looks more like my clearml.conf