Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
How Does Clearml Associate Projects/Experiments With Git Repos? Can I Think Of It As Clearml Project = Git Repo And Clearml Experiment = Git Commit? What About Git Branches - Is There Any Way To Organize Things Such That Separate Branches Are Easy To Trac

How does ClearML associate projects/experiments with git repos? Can I think of it as ClearML Project = Git Repo and ClearML Experiment = Git Commit? What about git branches - is there any way to organize things such that separate branches are easy to track and compare the outputs of?

  
  
Posted one year ago
Votes Newest

Answers 10


I'm not sure if Subprojects will work for that - can you use the Web UI to compare the artifacts from two separate subprojects?

  
  
Posted one year ago

So I'm thinking maybe a Project for each thing we're forecasting, and then new Tasks for each time we run it

  
  
Posted one year ago

But we're also testing out new models all the time, which are typically implemented as git branches - they run on the same set of inputs but don't output their results into production

  
  
Posted one year ago

I'll give it a shot and see! Just setting up a test server now, so it's still a hypothetical question just from reading the docs so far

  
  
Posted one year ago

awesome, I'll test it out - thanks for the tips!

  
  
Posted one year ago

And then we want to compare backtests or just this week's estimates across multiple of those models/branches

  
  
Posted one year ago

My use case is running forecasting models in production across multiple businesses

  
  
Posted one year ago

Intersting!
I would also add that Task name is not unique and you can use to describe the "process / goal etc" which would make it pretty obvious to search / review from the UI.
Regrading models and branchs, Iw ould use the Task tags (you can have as many as you like) to tag the specific model type (or dev branch if the alg is diff), this means you can also easily filter based on the Tags in the UI.

can you use the Web UI to compare the artifacts from two separate subprojects?

Yes comparison is not limited, in the comparison mode you can add any Task to the comparison, you can also have "flatten view" of projects (i.e. Tasks from all the subprojects) for easy access

  
  
Posted one year ago

thanks for the thoughtful response, @<1523701205467926528:profile|AgitatedDove14> ! I think I'll need to test out some workflows to see what works

  
  
Posted one year ago

Hi @<1532532498972545024:profile|LittleReindeer37>
This is truly a great discussion to have. Personally I think the main difference is that software development is a somewhat linear process , and git captures it very well. But ML is a lot wider nonlinear process, which to me means that trying to conform the same workflow into a Dev tree will end up failing. The way ClearML thinks about it (and I think the analogy to source control is correct ) is probably closer to how you think about project management rather than git. That said, every Task holds everything about the state of process in Dev (ie code, args, env etc) , project is closer to Dev project (sometimes this is a single repo, but with more complicated projects you have multiple ) , but each Task/expriment is a "commit" of you will... I think that subprojects were born from the need to divide the progress into more managable workflow , where you can have multiple Dev streams under the same conceptual project (maybe diff models dev for the same goal). Wdyt ?

  
  
Posted one year ago
1K Views
10 Answers
one year ago
one year ago
Tags