Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
SlimyDove85
Moderator
5 Questions, 15 Answers
  Active since 10 January 2023
  Last activity 9 months ago

Reputation

0

Badges 1

14 × Eureka!
0 Votes
2 Answers
509 Views
0 Votes 2 Answers 509 Views
Hi, Quick Y/N question: is it possible to build a pipeline of pipelines? I'd imagine this to be possible, since pipelines are also treated as tasks.
9 months ago
0 Votes
4 Answers
509 Views
0 Votes 4 Answers 509 Views
one year ago
0 Votes
3 Answers
577 Views
0 Votes 3 Answers 577 Views
Hello! What considerations are there to upgrading ClearML kubernetes installation from 1.6.0 to 1.7.0? Will it suffice to just update the image_tag within th...
one year ago
0 Votes
10 Answers
527 Views
0 Votes 10 Answers 527 Views
one year ago
0 Votes
15 Answers
566 Views
0 Votes 15 Answers 566 Views
one year ago
0 Hello! What Considerations Are There To Upgrading Clearml Kubernetes Installation From 1.6.0 To 1.7.0? Will It Suffice To Just Update The Image_Tag Within The Helm Charts And Keep Rest Of The Config As It Was? Br, -Ville P.

It is not out yet indeed, why I am wondering. Also a good question about the mongodb stuff and quite relevant, because we just went ham switching from AWS EBS => EFS and also deleting (or supposedly deleting?) all of our old pvcs + pvs. Somehow after redeployment, ClearML still had access to the old data, which should've been destroyed.

Note: we are still in dev, so this is ok 😅

one year ago
0 Hi, Quick Y/N Question: Is It Possible To Build A Pipeline Of Pipelines? I'D Imagine This To Be Possible, Since Pipelines Are Also Treated As Tasks.

Thanks for the answer - just thinking about how to build an easy solution for new feature requests.

Combining pre-existing pipes in the described way would make things "simpler" the way I see it, but could also lead to other problems. Will have to think about it a little more.

9 months ago
0 Hi I Have A Problem (Presumably) With K8Sglue-Agents Working Roughly 50% Of The Time. Basically What Happens Is When I Launch A Pipeline From Command Line, It Ends Up In "Pending" State And Dissapears From All Of The Queues. Initially It First Appears On

API server does not restart during the process. I'll try to see if I catch up something in its logs or where should I monitor the networking in? I.e., what is the flow 😅

one year ago
0 Hi I Have A Problem (Presumably) With K8Sglue-Agents Working Roughly 50% Of The Time. Basically What Happens Is When I Launch A Pipeline From Command Line, It Ends Up In "Pending" State And Dissapears From All Of The Queues. Initially It First Appears On

The queue 'feature_pipelines" should exist and the latter queue is something that the agents sometimes want to create for some reason (though it should not be required?)

Latter warning is ok I guess.

one year ago
0 Hi I Have A Problem (Presumably) With K8Sglue-Agents Working Roughly 50% Of The Time. Basically What Happens Is When I Launch A Pipeline From Command Line, It Ends Up In "Pending" State And Dissapears From All Of The Queues. Initially It First Appears On

Ok, was able to get a crash and log some output from the apiserver:

` [2022-08-11 09:21:13,727] [11] [INFO] [clearml.service_repo] Returned 200 for tasks.stopped in 17ms
[2022-08-11 09:21:13,829] [11] [INFO] [clearml.service_repo] Returned 200 for queues.get_next_task in 11ms
[2022-08-11 09:21:13,871] [11] [INFO] [clearml.service_repo] Returned 200 for queues.get_next_task in 8ms
[2022-08-11 09:21:13,986] [11] [WARNING] [clearml.service_repo] Returned 400 for queues.get_by_id in 4ms, msg=Inv...

one year ago
0 Hi! Working On Deploying Clearml To Aws Eks And Looking For A Way To Initialize Projects And Designated Queues For Agents. Are There Any Best Practices For This Or Should I Just Add A Command When Starting Up The Api Server (I.E., Send Some Http Requests

In the deployment if I add agents to queues that are not present (using k8sglue), they fail to launch until the queues become available. Would like to avoid manually setting up queues that I know I'll be using.

one year ago
0 You Guys, Thank You So Much. I Have Super Positive Things To Say About Clearml And I'M Very Excited To Try It Out At Work (Still Selling It)

Yes, thank you from me too! Wrapping up a project where we ended up deploying a self hosted version on EKS and leveraging its autoscaling abilities. Ticked a lot boxes for our team from model deployment to running pipelines, tracking experiments, storing artifacts and even allowing the deployment of some R code/models by making the use of custom docker images a breeze 😅

Given once your pipes become sufficiently complex and start to veer more outside the ML domain, you might op...

10 months ago
0 Hi, What Would Be The Recommended Way To Add/Track Arbitrary Models To/With Outputmodels? Currently Hacking It By Using Joblib Dump And Subsequently Deleting Unwanted "Local" Files. Arbitrary In This Case Just Extensions To Some Scikitlearn Classes.

Basically I've defined some extended sklearn models, which I import in my ClearML task file and set them up with some initial parameters.

Some pseudocode:
` mdl = SomeExtendedSklearnModel(**params)

Load data

X = load_data(...)

Run

task = Task.init(...)
output_models = OutputModel(task=task, ..., framework="ScikitLearn")
preds = mdl.fit_predict(X)
joblib.dump(mdl, "mdl.pkl") `

one year ago
0 Hi, What Would Be The Recommended Way To Add/Track Arbitrary Models To/With Outputmodels? Currently Hacking It By Using Joblib Dump And Subsequently Deleting Unwanted "Local" Files. Arbitrary In This Case Just Extensions To Some Scikitlearn Classes.

Without the joblib dump I do not get my models registered as models, even though the experiment runs fine and logs everything else : )

Edit: Note that I also want ClearML to store these into my predefined artifact store, which it does with the aforementioned "hacky" solution.

one year ago