Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
ExasperatedCrab78
Moderator
2 Questions, 220 Answers
  Active since 10 January 2023
  Last activity one year ago

Reputation

0

Badges 1

2 × Eureka!
0 Votes
0 Answers
563 Views
0 Votes 0 Answers 563 Views
A little something else: Using ClearML, an OAK-1 AI camera and a raspberry pi to create a pushup counter that locks my PC every hour and only unlocks again w...
one year ago
0 Votes
5 Answers
622 Views
0 Votes 5 Answers 622 Views
We're working on ClearML serving right now and are very interested in what you all are searching for in a serving engine, so we can make the best serving eng...
one year ago
0 We'Re Working On Clearml Serving Right Now And Are Very Interested In What You All Are Searching For In A Serving Engine, So We Can Make The Best Serving Engine We Can

Hi Jax! Thanks for the feedback, we really appreciate it 😄

MLFlow is able to support a multitude of models from dev to deployment. Is ClearML and ClearML-Serving going to support as much as well?

Do you mean by this that you want to be able to seamlessly deploy models that were tracked using ClearML experiment manager with ClearML serving?

I believe in such scenarios, a custom engine would be required. I would like to know, how difficult is it to create a custom engine wit...

one year ago
0 Hi All! I Recently Started Working With Clearml Serving. I Got This Example Working

Thank you so much, sorry for the inconvenience and thank you for your patience! I've pushed it internally and we're looking for a patch 🙂

one year ago
0 Hello Again, I Would Like To Ask You If Something Like This Is Possible In Clearml (See Screenshot)? For Each Experiment (

Thank you so much! In the meantime, I check once more and the closest I could get was using report_single_value() . It forces you to report each an every row though, but the comparison looks a little better this way. No color coding yet, but maybe it can already help you a little 🙂

one year ago
0 Hello Again, I Would Like To Ask You If Something Like This Is Possible In Clearml (See Screenshot)? For Each Experiment (

Hi CurvedHedgehog15 , so my previous reply does assume you have reported a scalar for each individual FAR level. Then you can add individual levels as shown in the gif. But like you siad, that might actually cause you to loose your overview in the scalars tab.

So I don't think there's an immediate way to do this in ClearML right now, but would you mind opening an issue on github for it? It might be interesting to add it to the tool?

one year ago
0 Hi All, What Is The Appropriate Way To Mount A Volume When Running The Docker Container For A Task? I'M Executing A Task From The Experiment Manager And Adding In

Nice! Well found and thanks for posting the solution!

May I ask out of curiosity, why mount X11? Are you planning to use a GUI app on the k8s cluster?

one year ago
0 I Am Looking For The Dataset Used In Sarcasm Detection Demo

Great to hear! Then it comes down to waiting for the next hugging release!

one year ago
0 Hello

What kind of machine are you running this on?

one year ago
0 I Am Looking For The Dataset Used In Sarcasm Detection Demo

Ah I see 😄 I have submitted a ClearML patch to Huggingface transformers: None

It is merged, but not in a release yet. Would you mind checking if it works if you install transformers from github? (aka the latest master version)

one year ago
0 Hey, We Are Using Clearml 1.9.0 With Transformers 4.25.1… And We Started Getting Errors That Do Not Reproduce In Earlier Versions (Only Works In 1.7.2 All 1.8.X Don’T Work):

Now worries! Just so I understand fully though: you were already using the patch with success from my branch. Now that it has been merged into transformers main branch you installed it from there and that's when you started having issues with not saving models? Then installing transformers 4.21.3 fixes it (which should have the old clearml integration even before the patch?)

one year ago
0 Hi All

Ah I see. So then I would guess it is due to the remote machine (the clearml agent) not being able to properly access your clearml server

11 months ago
0 Tasks Can Be Put In Draft State - If We Will Execute:

RoundMosquito25 it is true that the TaskScheduler requires a task_id , but that does not mean you have to run the pipeline every time 🙂

When setting up, you indeed need to run the pipeline once, to get it into the system. But from that point on, you should be able to just use the task_scheduler on the pipeline ID. The scheduler should automatically clone the pipeline and enqueue it. It will basically use the 1 existing pipeline as a "template" for subsequent runs.

one year ago
0 Hi Team, I’M Trying To Generate Gcp Autoscaler, And Received The Following Error:

Great! Please let me know if it works when adding this permission, we'll update the docs in a jiffy!

one year ago
0 Hey, We Are Using Clearml 1.9.0 With Transformers 4.25.1… And We Started Getting Errors That Do Not Reproduce In Earlier Versions (Only Works In 1.7.2 All 1.8.X Don’T Work):

It should, but please check first. This is some code I quickly made for myself. It did make tests for it, but it would be nice to hear from someone else that it worked (as evidenced by the error above 😅 )

one year ago
0 Hi, I Am Trying

That looks like a bug, would you mind copy pasting this into a github issue? 🙂 AgitatedDove14 is there something else this could be?

one year ago
0 Hello Everyone ! I Tried To Reproduce Your Tutorial :

Nice find! I'll pass it through to the relevant devs, we'll fix that right up 🙂 Is there any feedback you have on the functionality specifically? aka, would you use alias give what you know now or would you e.g. name it differently?

one year ago
0 Hello Everyone ! I Tried To Reproduce Your Tutorial :

This update was just to modernize the example itself 🙂

one year ago
0 Hello, Does Clearml_Apiserver Needed To Listen To 8008 Only? Can I Change To Other Ports Likes 9008?

Hi VictoriousPenguin97 ! I think you should be able to change it in the docker-compose file here: https://github.com/allegroai/clearml-server/blob/master/docker/docker-compose.yml

You can map the internal 8008 port to another port on your local machine. But beware to provide the different port number to any client that tries to connect (using clearml-init )

one year ago
0 Hello Everyone ! I Tried To Reproduce Your Tutorial :

And it seems you are fully correct, log_dataset_statistics is not even called in preprocessing.py 🤔 That seems like a bad oversight from our end. If you add it yourself, does it work then? Add it on line 140, just after dataset_task.flush the line itself is: self.log_dataset_statistics(dataset_task) also change line 84 to values=self.metadata['label'],
You found it, so if you want you can open a PR and fix it so you get credit for it 🙂 If not, I can do it ...

one year ago
0 Hi When I Run Task.Init(…) I Get The Following Error: 2022-07-03 18:43:29,022 - Clearml.Repository Detection - Warning - Failed Accessing The Jupyter Server: 403 Client Error: Forbidden For Url:

Can you walk us through how you set up your jupyter instance? If we can recreate your error, we'll be able to help much faster. What's the command you're using to set it up, on which OS are you running it and so on 🙂 Also, have you checked your jupyter server is running on port 8888? Chances are something else is using 8888, so jupyter might be running on some other port like 8889 instead, so ClearML is trying to get a kernel from a completely different service.

one year ago
0 Question On Using Clearml-Data To Manage Contents Of Datasets. I’M Having An Issue Deleting A Directory Within A Dataset Uploaded. Here Are A Few Ways I’Ve Tried, Create New Dataset With Parent, Remove --Files <Path To Folder>. That Doesn’T Work, Only

For the record, this is a minimal reproducible example:

Local folder structure:
` ├── remove_folder
│ ├── batch_0
│ │ ├── file_0_0.txt
│ │ ├── file_0_1.txt
│ │ ├── file_0_2.txt
│ │ ├── file_0_3.txt
│ │ ├── file_0_4.txt
│ │ ├── file_0_5.txt
│ │ ├── file_0_6.txt
│ │ ├── file_0_7.txt
│ │ ├── file_0_8.txt
│ │ └── file_0_9.txt
│ └── batch_1
│ ├── file_1_0.txt
│ ├── file_1_1.txt
│ ├── file_1_2.txt
│ ├── file_1_3.txt
│ ├── fi...

one year ago
0 Hey, I Was Planning To Save The Best Trained Model And Get A Task Id For It, So I Could Use It Later As

Also, this might be a little stupid sorry, but your torch save command saves the model in the current folder, whereas you give clearml the 'model_folder/model' path instead. Could it be that the path is just incorrect?

2 years ago
0 Hi Community, How Can I Prevent Clearml Creating A New Experiment, Each Time I Interrupt And Restart Training On The Same Task? I'M Training Yolov8 And Clearml Docker Usage Is Up To 30Gb. I Can'T See A Yaml Config Parameter For This.

Hey @<1539780305588588544:profile|ConvolutedLeopard95> , unfortunately this is not built-in into the YOLOv8 tracker. Would you mind opening an issue on the YOLOv8 github page and atting me? (I'm thepycoder on github)

I can then follow up the progress on it, because it makes sense to expose this parameter through the yaml.

That said, to help you right now, please change [this line](https://github.com/ultralytics/ultralytics/blob/fe61018975182f4d7645681b4ecc09266939dbfb/ultralytics/yolo/uti...

one year ago
0 It Would Be Nice To Group Experiments Within Projects Use Cases:

Could you use tags for that? In that case you can easily filter on which group you're interested in, or do you have a more impactful UI change in mind to implement groups? 🙂

2 years ago
0 Hello Everyone, I Am A New User For Clearml, I Have One Question: I Created The Dataset, And Upload Files Successfully By Class

With what error message did it fail? I would expect it to fail, because you finalized this version of your dataset by uploading it 🙂 You'll need a mutable copy of the dataset before you can remove files from it I think, or you could always remove the file on disk and create a new dataset with the uploaded one as a parent. In that way, clearml will keep track of what changed in between versions.

2 years ago
0 Hello Everyone ! As You Can Observe In Attached Snipped, In My Code I Freeze The Env, And The Agent Install Every Cached Dependency With The Same Version. Is There Any Way That The Agent On My Side (My Computer) Will Straightly Use The Virtual Environment

Hi ExasperatedCrocodile76 ,

You can try running the agent with these environment variables set to 1:

CLEARML_AGENT_SKIP_PIP_VENV_INSTALL=1 CLEARML_AGENT_SKIP_PYTHON_ENV_INSTALL=1There's more env vars here: https://clear.ml/docs/latest/docs/clearml_agent/clearml_agent_env_var

Does that work for you?

one year ago
0 Hello, Trying To Figure Out How To Run A Machine In Docker Mode (Ecr Private Repo) Using Clearml. For Some Reason I Cannot Get This To Work With :

Does it help to also run docker login in the init bash script?
You should be able to access your AWS credentials from the environment (the agent will inject them based on your config)

one year ago
0 Clearml.Backend_Interface.Session.Senderror: Action Failed <500/100: Tasks.Enqueue/V1.0 (General Data Error (Connectionerror(<Urllib3.Connection.Httpconnection Object At 0X7F28607096D8>: Failed To Establish A New Connection: [Errno 111] Connection Refused

Hey @<1539780272512307200:profile|GaudyPig83> !

Are you running a self-hosted server? Is this the only type of HTTP call that fails or does e.g. logging experiments also not work? A connection error usually means your docker containers can't reach each other.

one year ago
Show more results compactanswers