Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
I'M Running A Simple Experiment (One Training Task, Nothing Else) And I'M Getting A Puzzling Message. Any Help Deciphering That Is Appreciated. I'M Pasting Part Of The Warnings Below:

I'm running a simple experiment (one training task, nothing else) and I'm getting a puzzling message. Any help deciphering that is appreciated. I'm pasting part of the warnings below:
021-09-14 13:09:29,248 - clearml.model - WARNING - More than one model found when searching forfile:///key/mem_info.joblib(showing first 10 models follow) 2021-09-14 13:09:29,248 - clearml.model - WARNING - More than one model found when searching forfile:///key/mem_info.joblib(showing first 10 models follow) 2021-09-14 13:09:29,248 - clearml.model - WARNING - More than one model found when searching forfile:///key/mem_info.joblib(showing first 10 models follow) 2021-09-14 13:09:29,248 - clearml.model - WARNING - More than one model found when searching forfile:///key/mem_info.joblib(showing first 10 models follow) 2021-09-14 13:09:29,249 - clearml.model - WARNING - More than one model found when searching forfile:///key/mem_info.joblib(showing first 10 models follow) 2021-09-14 13:09:29,249 - clearml.model - WARNING - Selected modelImported by baseline(id=942ca06614234855b96c4aec034dfd2e) 2021-09-14 13:09:29,249 - clearml.model - WARNING - Selected modelImported by baseline(id=942ca06614234855b96c4aec034dfd2e) 2021-09-14 13:09:29,249 - clearml.model - WARNING - More than one model found when searching forfile:///key/mem_info.joblib(showing first 10 models follow) 2021-09-14 13:09:29,249 - clearml.model - WARNING - Selected modelImported by baseline(id=942ca06614234855b96c4aec034dfd2e) 2021-09-14 13:09:29,249 - clearml.model - WARNING - Additionally found modelImported by baseline(id=c6b46cda24f9427db6c1ac49d20d1623) 2021-09-14 13:09:29,249 - clearml.model - WARNING - Selected modelImported by baseline(id=942ca06614234855b96c4aec034dfd2e) 2021-09-14 13:09:29,250 - clearml.model - WARNING - Selected modelImported by baseline(id=942ca06614234855b96c4aec034dfd2e) 2021-09-14 13:09:29,250 - clearml.model - WARNING - Additionally found modelImported by baseline(id=c6b46cda24f9427db6c1ac49d20d1623) 2021-09-14 13:09:29,250 - clearml.model - WARNING - Additionally found modelImported by baseline(id=c6b46cda24f9427db6c1ac49d20d1623) 2021-09-14 13:09:29,250 - clearml.model - WARNING - Additionally found modelImported by baseline(id=75dedc67391c4857b9a30cd10ea7debd) 2021-09-14 13:09:29,250 - clearml.model - WARNING - Selected modelImported by baseline(id=942ca06614234855b96c4aec034dfd2e) 2021-09-14 13:09:29,250 - clearml.model - WARNING - Additionally found modelImported by baseline(id=75dedc67391c4857b9a30cd10ea7debd) 2021-09-14 13:09:29,250 - clearml.model - WARNING - Additionally found modelImported by baseline(id=c0e13590a7b24396913641b2e1ac3be5) 2021-09-14 13:09:29,250 - clearml.model - WARNING - Additionally found modelImported by baseline(id=75dedc67391c4857b9a30cd10ea7debd) 2021-09-14 13:09:29,250 - clearml.model - WARNING - Additionally found modelImported by baseline(id=c0e13590a7b24396913641b2e1ac3be5) 2021-09-14 13:09:29,250 - clearml.model - WARNING - Additionally found modelImported by baseline(id=c6b46cda24f9427db6c1ac49d20d1623) 2021-09-14 13:09:29,250 - clearml.model - WARNING - Additionally found modelImported by baseline(id=c6b46cda24f9427db6c1ac49d20d1623) 2021-09-14 13:09:29,250 - clearml.model - WARNING - Additionally found modelImported by baseline(id=c0e13590a7b24396913641b2e1ac3be5) 2021-09-14 13:09:29,250 - clearml.model - WARNING - Additionally found modelImported by baseline(id=75dedc67391c4857b9a30cd10ea7debd) 2021-09-14 13:09:29,250 - clearml.model - WARNING - Additionally found modelImported by baseline(id=e236ea6f321f42f78b29bbfdd33766e4) 2021-09-14 13:09:29,250 - clearml.model - WARNING - Additionally found modelImported by baseline(id=75dedc67391c4857b9a30cd10ea7debd) 2021-09-14 13:09:29,250 - clearml.model - WARNING - Additionally found modelImported by baseline(id=c0e13590a7b24396913641b2e1ac3be5) 2021-09-14 13:09:29,250 - clearml.model - WARNING - Additionally found modelImported by baseline(id=e236ea6f321f42f78b29bbfdd33766e4) 2021-09-14 13:09:29,250 - clearml.model - WARNING - Additionally found modelImported by baseline(id=e236ea6f321f42f78b29bbfdd33766e4) 2021-09-14 13:09:29,251 - clearml.model - WARNING - Additionally found modelImported by baseline(id=c6b46cda24f9427db6c1ac49d20d1623) 2021-09-14 13:09:29,251 - clearml.model - WARNING - Additionally found modelImported by baseline(id=476f08d159b94071b731e890daab8c0a) 2021-09-14 13:09:29,251 - clearml.model - WARNING - Additionally found modelImported by baseline(id=e236ea6f321f42f78b29bbfdd33766e4) 2021-09-14 13:09:29,251 - clearml.model - WARNING - Additionally found modelImported by baseline(id=c0e13590a7b24396913641b2e1ac3be5) 2021-09-14 13:09:29,251 - clearml.model - WARNING - Additionally found modelImported by baseline(id=476f08d159b94071b731e890daab8c0a) 2021-09-14 13:09:29,251 - clearml.model - WARNING - Additionally found modelImported by baseline(id=75dedc67391c4857b9a30cd10ea7debd) 2021-09-14 13:09:29,251 - clearml.model - WARNING - Additionally found modelImported by baseline(id=e236ea6f321f42f78b29bbfdd33766e4) 2021-09-14 13:09:29,251 - clearml.model - WARNING - Additionally found modelImported by baseline(id=476f08d159b94071b731e890daab8c0a) 2021-09-14 13:09:29,251 - clearml.model - WARNING - Additionally found modelImported by baseline(id=476f08d159b94071b731e890daab8c0a) 2021-09-14 13:09:29,251 - clearml.model - WARNING - Additionally found modelImported by baseline(id=c0e13590a7b24396913641b2e1ac3be5) 2021-09-14 13:09:29,251 - clearml.model - INFO - Selected model id: 942ca06614234855b96c4aec034dfd2e 2021-09-14 13:09:29,251 - clearml.model - INFO - Selected model id: 942ca06614234855b96c4aec034dfd2e 2021-09-14 13:09:29,251 - clearml.model - INFO - Selected model id: 942ca06614234855b96c4aec034dfd2e 2021-09-14 13:09:29,251 - clearml.model - WARNING - Additionally found modelImported by baseline(id=476f08d159b94071b731e890daab8c0a) 2021-09-14 13:09:29,251 - clearml.model - INFO - Selected model id: 942ca06614234855b96c4aec034dfd2e 2021-09-14 13:09:29,251 - clearml.model - WARNING - Additionally found modelImported by baseline(id=e236ea6f321f42f78b29bbfdd33766e4) 2021-09-14 13:09:29,251 - clearml.model - INFO - Selected model id: 942ca06614234855b96c4aec034dfd2e 2021-09-14 13:09:29,251 - clearml.model - WARNING - Additionally found modelImported by baseline(id=476f08d159b94071b731e890daab8c0a)What are those "Imported by baseline" models?
Where are they found (I'm pretty sure they are not in that path, I checked).
Why are there so many repeated warnings? (I just want to understand as well as possible what's happening).

This is basically the whole script (contains all the clearml-related calls):
task = Task.init(project_name=project_name, task_name=task_name, tags=tags or []) task.connect_configuration(config, name="master config") if spec: task.connect_configuration(spec, name="spec") run_config(paths, config, task_name) task.close()

  
  
Posted 3 years ago
Votes Newest

Answers 7


Hi WittyOwl57 , what version of clearml are you using?

  
  
Posted 3 years ago

Actually scikit implies joblib 🙂 (so you should use scikit, anyhow I'll make sure we add joblib as it is more explicit)

  
  
Posted 3 years ago

Hi WittyOwl57
I think what happens is it auto-logs the joblib load/save calls, these calls track models used/created by the code, and attach them to the model repository representing these model.
I'm assuming there are multiple load/save , and there are multiple model instances pointing to the same local file "file:///tmp/..." . The earning basically says it is re-registering existing models.
Make sense ?

  
  
Posted 3 years ago

ah nice, I'll try auto_connect_frameworks (probably with {'joblib': False} ? - we don't use scikit-learn)

  
  
Posted 3 years ago

(BTW: you can disable the auto-logging feature of joblib)
Task.init(..., auto_connect_frameworks={'scikit': False})

  
  
Posted 3 years ago

'scikit' worked nicely, thanks again

  
  
Posted 3 years ago

Hi Natan, I'm using 1.0.5

  
  
Posted 3 years ago
1K Views
7 Answers
3 years ago
one year ago
Tags