Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
SubstantialElk6
Moderator
115 Questions, 310 Answers
  Active since 10 January 2023
  Last activity 10 months ago

Reputation

0

Badges 1

282 × Eureka!
0 Votes
8 Answers
588 Views
0 Votes 8 Answers 588 Views
Hi, if i've ClearML agents installed on several servers, each with a single GPU. How can I train a gpt2 model that would require multiple GPUs?
12 months ago
0 Votes
2 Answers
592 Views
0 Votes 2 Answers 592 Views
one year ago
0 Votes
29 Answers
640 Views
0 Votes 29 Answers 640 Views
Hi, I started my agent using. clearml-agent daemon --gpus 0 --queue gpu --docker --foreground, with the following parameters in clearml.conf. default_docker:...
3 years ago
0 Votes
2 Answers
483 Views
0 Votes 2 Answers 483 Views
2 years ago
0 Votes
8 Answers
525 Views
0 Votes 8 Answers 525 Views
Hi we have had some crashes on ClearML server and it was caused by ClearML uploading the models into ClearML server (by default). Is it possible to have an o...
2 years ago
0 Votes
2 Answers
521 Views
0 Votes 2 Answers 521 Views
Sorry, I'm asking too much questions today. I gave myself a whole day to fully evaluate ClearML...that's why. Here goes. Regarding Automatic Logging (Automag...
3 years ago
0 Votes
7 Answers
514 Views
0 Votes 7 Answers 514 Views
2 years ago
0 Votes
2 Answers
515 Views
0 Votes 2 Answers 515 Views
Hi, i was trying out the steps on this ( https://github.com/allegroai/clearml/blob/master/docs/clearml-task.md ) and encountered the following error. Environ...
3 years ago
0 Votes
3 Answers
550 Views
0 Votes 3 Answers 550 Views
Hi, i'm wondering if ClearML did a comparison of their ClearML Pipelines with other solutions such as Apache Beam? Or if ClearML supports integration with su...
one year ago
0 Votes
1 Answers
642 Views
0 Votes 1 Answers 642 Views
[Distributed Training] Hi, i have a ClearML setup with K8SGlue that spins up pods of 4 GPUs when picking tasks off the clearml queue. We would now want to pr...
one year ago
0 Votes
6 Answers
564 Views
0 Votes 6 Answers 564 Views
Hi, we are planning to move on to openshift. Can I ask if k8s-glue supports openshift?
2 years ago
0 Votes
1 Answers
559 Views
0 Votes 1 Answers 559 Views
Clearml-Agent didn't seem to take the CA store from the OS. Where can i point ClearML to the CA certs, in particular for uploading of models into S3. At the ...
2 years ago
0 Votes
5 Answers
540 Views
0 Votes 5 Answers 540 Views
Hi, i would like to ask around if anyone has following languages working with ClearML? It can be direct from ClearML SDK or via any indirect method. Julia R ...
2 years ago
0 Votes
1 Answers
541 Views
0 Votes 1 Answers 541 Views
Thought i would share this. Something to think about over the new year. 🙂 https://www.thoughtworks.com/content/dam/thoughtworks/documents/whitepaper/tw_whit...
2 years ago
0 Votes
3 Answers
534 Views
0 Votes 3 Answers 534 Views
Hi, the https://github.com/allegroai/trains/blob/master/examples/services/jupyter-service/execute_jupyter_notebook_server.py file linked by following page is...
2 years ago
0 Votes
2 Answers
519 Views
0 Votes 2 Answers 519 Views
2 years ago
0 Votes
23 Answers
533 Views
0 Votes 23 Answers 533 Views
Hi i saw this on the clearml-agent docs but other than the docker image, i'm not sure how to integrate this with clearml py and clearml-server. Please advise...
3 years ago
0 Votes
15 Answers
581 Views
0 Votes 15 Answers 581 Views
Hi, i noted that clearml-serving does not support Spacy models out of the box and that Clearml-Serving only supports following; Support Machine Learning Mode...
one year ago
0 Votes
1 Answers
474 Views
0 Votes 1 Answers 474 Views
Hi, I've three questions regarding clearml pipelines. - can I check when we use a clearml pipeline and data get transferred from stage to stage, do the data ...
9 months ago
0 Votes
2 Answers
598 Views
0 Votes 2 Answers 598 Views
Hi i saw this announcement from NVIDIA on TAO's integration with ClearML. How can we use it?
one year ago
0 Votes
4 Answers
584 Views
0 Votes 4 Answers 584 Views
Hi, i am trying to understand clearml-data and only found this piece of article explaining it. https://github.com/allegroai/clearml/blob/master/docs/datasets...
2 years ago
0 Votes
8 Answers
511 Views
0 Votes 8 Answers 511 Views
Hi, is there any code examples of how DataOps is being established? https://clear.ml/products/clearml-dataops/
2 years ago
0 Votes
3 Answers
521 Views
0 Votes 3 Answers 521 Views
Hi, i got this screenshot from our workers tab and would like to clarify some understanding. I noticed that the Total number of workers and Number of active ...
one year ago
0 Votes
3 Answers
572 Views
0 Votes 3 Answers 572 Views
Hi, is there a way I can supply credentials to clearml-data (cli and python) without going thru the ClearML.conf?
2 years ago
0 Votes
3 Answers
555 Views
0 Votes 3 Answers 555 Views
Just wondering, why aren't you guys getting yourselves known in GTC?
2 years ago
0 Votes
5 Answers
557 Views
0 Votes 5 Answers 557 Views
Hi, can i choose not print the clearml-agent config logs in the console? Reason is we are passing credentials via env var to the k8s glue and its being displ...
2 years ago
0 Votes
5 Answers
589 Views
0 Votes 5 Answers 589 Views
one year ago
0 Votes
2 Answers
620 Views
0 Votes 2 Answers 620 Views
one year ago
0 Votes
1 Answers
450 Views
0 Votes 1 Answers 450 Views
ClearML is distinctly missing in the curated MLOps landscape. Https://mad.firstmark.com
10 months ago
0 Votes
3 Answers
550 Views
0 Votes 3 Answers 550 Views
Hi, can i default a docker image when running a pipeline? I currently set it as pipe = PipelineController(...) pipe.task.setbase_docker("ubuntu:20:04") pipe....
one year ago
Show more results questions
0 Hi I'M Using Clearml Datasets. How Do I Tell From The Clearml Ui Which Datasets Version Am I Using?

Okay this part I missed, why would you need to add additional "catalog" when you have the UI?

Yeah this is the part i am trying to reconcile. I don't see any UI for datasets, Or is this a feature of hyperdatasets and i just mixed them up.

2 years ago
0 Hi, I Notice A New Behavuour With Clearml-Agent=1.1.0. When It Is Installing The Packages I Nrequirements.Txt, It Failed With.

can you please verify that you have all the required packages installed locally ?

Its not installed on the image that runs the experiment. But its reflected in the requirements.txt.

what is the setting of 

agent.package_manager.system_site_packages

True.

2 years ago
2 years ago
0 Hi, I'M Using The K8S Glue And Have A Few Questions.

Hi, it's a preference from my developers. They preferred that the they install the python libraries into the images, load them up into the registry. In other words, they prefer to have libraries installed at image time.

3 years ago
0 Hi, I'M Using The K8S Glue And Have A Few Questions.

I think the default action of clearml-agent k8s glue when running a task is to create a virtual env and installing the dependancies. So i'm just checking how to change that behaviour to look at global instead.

3 years ago
0 Hi, I Notice A New Behavuour With Clearml-Agent=1.1.0. When It Is Installing The Packages I Nrequirements.Txt, It Failed With.

Its hard to tell, but the agent change was a significant one. Unless python versions has something to do with it.

2 years ago
0 Hi, I Cant Access The Clearml Ui, Is There Something Wrong With Your Servers?

Hi, it looks like the entire http://clear.ml domain is offline for more than 12 hours. Main pages and documentation are inaccessible as well.

one year ago
0 Hi, Is There A Command I Can Use To Generate A Report That Can

Can i dig into the mongodb or ES to pull these data?

2 years ago
0 Hi, How Do I Switch Clearml Server To Run On Https With A Self Signed Cert?

Does the enterprise version support natively?

2 years ago
0 Hi, I Am Trying To Understand Clearml-Data And Only Found This Piece Of Article Explaining It.

Hi erez, i think i would want to reference the code that transformed the data. Take for example, i received 10k images, i performed some transformation and save it as a next version before i split it up for my ML training. Some time later, i receive a new set of 10k images and wants to apply the same transformation and then append it to the previous 10k as another version. Clearml-data does well for the data-versioning part, but in terms of data provenance, its not clear how i can associate t...

2 years ago
0 Hi, How Can I Make A Stage In A Clearml Pipeline Non-Blocking? The Scenario Is That Stages Downstream Needed Runtime Info From The First Stage, However The First Stage Needs To Continue Running To Act As A Monitor For The Other Downstream Stages.

The first stage is a rank0 pytorch script. The downstream stages are rankN scripts, they are waiting for the IP address of the first stage. But the first stage doesn’t return, it simply waits for the rankN scripts to connect to it. But in this case, the rankN scripts doesn’t start. So its probably necessary to have just a single stage.

If i were to start a single rank0, and subsequent rankN tasks, it would be rather messy on ClearML Dashboard. Best to have either a single clearml application...

11 months ago
2 years ago
0 Hi, I'M Using The K8S Glue And Have A Few Questions.

Any comments on using the global python libraries without the need to 'pip install' anything?

3 years ago
0 Hi, I Was Trying Out The Steps On This (

Hi yes, still getting the SSLs. It looks like some incompatibility with the OS ssl libraries.

3 years ago
2 years ago
0 Hi, I Notice A New Behavuour With Clearml-Agent=1.1.0. When It Is Installing The Packages I Nrequirements.Txt, It Failed With.

Ok. I noted this is due to the venv_update setting. It needs to be disabled as it has a dependancy on the internet url. We can close this.

2 years ago
0 Hi, I Started My Agent Using. Clearml-Agent Daemon --Gpus 0 --Queue Gpu --Docker --Foreground, With The Following Parameters In Clearml.Conf.

Sorry i don't quite understand this. The task itself was submitted as I run the code on the client. I suppose the dependancies requirements would be copied over as the experiment is cloned?

3 years ago
0 Hi, I Started My Agent Using. Clearml-Agent Daemon --Gpus 0 --Queue Gpu --Docker --Foreground, With The Following Parameters In Clearml.Conf.

Thank. Gonna try that out. But i hit another snag. Strangely, the Agent is not creating the right venv. This is what the Agent created.
` pip:

  • asn1crypto==0.24.0
  • attrs==20.3.0
  • certifi==2020.12.5
  • chardet==4.0.0
  • cryptography==2.1.4
  • Cython==0.29.22
  • furl==2.1.0
  • future==0.18.2
  • humanfriendly==9.1
  • idna==2.6
  • importlib-metadata==3.7.0
  • jsonschema==3.2.0
  • keyring==10.6.0
  • keyrings.alt==3.0
  • orderedmultidict==1.0.1
  • pathlib2==2.3.5
  • psutil==5.8.0
  • pycrypto==2.6.1
  • pygobject...
3 years ago
Show more results compactanswers