Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi, I Would Like To Understand More On How Clearml Deal With Codes.

Hi, i would like to understand more on how ClearML deal with codes.
I noticed that i am able to read the source codes of the python script that i have used automagical on. Did the clearml python lib pushed the entire script to ClearML? If that script is git cloned from Gitlab repoA, would the git information be saved into ClearML and displayed as well? Does ClearML server requires credentials to the Gitlab report?

  
  
Posted 3 years ago
Votes Newest

Answers 7


I see i understand better now. Thanks.

  
  
Posted 3 years ago

However, please note that if you add files to your code and don't git add them, they will not be detected by git diff and so won't be updated in the Uncommitted Changes section

  
  
Posted 3 years ago

Hi SubstantialElk6 .

ClearML with add you entire script to the uncommitted changes section if its a standalone script (not part of a git repository).
If you run a script that is part of a git repository, the uncommitted changes section will contain the git diff of you work, along with the git repository address, branch, commit id or tag.

In order to re run a clone of this task, the agent running it will need to have the credentials to the repository (in order to clone it)

  
  
Posted 3 years ago

Hi thanks.
So i suppose ClearML make use of the information in .git folder at the root of the script folder to gather those info.

I have yet to go through thoroughly with ClearML agent. TimelyPenguin76 , so if i run a training with uncommited changes and didn't commit/push after. When i clone the task, isn't ClearML agent unable to pull that script from the git repo?

  
  
Posted 3 years ago

Another tip - if you have uncommitted changes on top of a commit, you will have to push that commit before the agent can successfully apply the diff in remote mode 😓

  
  
Posted 3 years ago

SubstantialElk6 it will store these differences in the Uncommitted Changes section (obtained using the git diff command). When cloning and running this experiment using a ClearML Agent, the Agent will first clone the repo, than apply the uncommitted changes, so the code it will run will be identical to the one you executed

  
  
Posted 3 years ago

Just to make sure the point got through, the server will never have your Git credentials, but you can configure a ClearML Agent with these credentials so it can run your experiment.

  
  
Posted 3 years ago
962 Views
7 Answers
3 years ago
one year ago
Tags