Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
AmiableSeaturtle81
Moderator
35 Questions, 135 Answers
  Active since 14 July 2023
  Last activity 27 days ago

Reputation

0

Badges 1

123 × Eureka!
0 Votes
0 Answers
991 Views
0 Votes 0 Answers 991 Views
one year ago
0 Votes
2 Answers
741 Views
0 Votes 2 Answers 741 Views
What could be the reason that im not getting any scalars reported to clearml using example script? None
12 months ago
0 Votes
1 Answers
878 Views
0 Votes 1 Answers 878 Views
one year ago
0 Votes
0 Answers
558 Views
0 Votes 0 Answers 558 Views
Is this a bug? Clearml version 1.26.4 im passing a list of S3 urls to add_external_files The list is about 1K of files, but only 7 are uploaded (only unique ...
7 months ago
0 Votes
1 Answers
1K Views
0 Votes 1 Answers 1K Views
how to make sure that clearml agents are running queue after server restart? Sometimes our worker dies and we manually have to run settuping for queue, we ru...
one year ago
0 Votes
1 Answers
780 Views
0 Votes 1 Answers 780 Views
one year ago
0 Votes
1 Answers
788 Views
0 Votes 1 Answers 788 Views
Another annoying problem we have is that task deletion doesnt delete any files at all. I have selected deletion of images But nothing is deleted. I have to w...
one year ago
0 Votes
5 Answers
630 Views
0 Votes 5 Answers 630 Views
Hello, for some reason my upload speed to S3 is insanely slow, I noticed in logs that it upoads to /tmp folder. What does that mean? why tmp?
8 months ago
0 Votes
0 Answers
821 Views
0 Votes 0 Answers 821 Views
S3 Setup is confusing for me, so this is how clearml.conf looks like on my local machine where I run test scripts
12 months ago
0 Votes
1 Answers
1K Views
0 Votes 1 Answers 1K Views
well, FAQ helped: None I had to clear my cookies and session storage, problem solved
one year ago
0 Votes
0 Answers
625 Views
0 Votes 0 Answers 625 Views
fixing it manually later on fixes the problem
9 months ago
0 Votes
14 Answers
623 Views
0 Votes 14 Answers 623 Views
7 months ago
0 Votes
1 Answers
583 Views
0 Votes 1 Answers 583 Views
7 months ago
0 Votes
7 Answers
615 Views
0 Votes 7 Answers 615 Views
Graph is drawn quite bad in such cases, hard to understand the relations Red line shows the actual linking, but it looks like it links to another dataset alo...
6 months ago
0 Votes
2 Answers
188 Views
0 Votes 2 Answers 188 Views
2 months ago
0 Votes
0 Answers
1K Views
0 Votes 0 Answers 1K Views
deleted /opt/clearml deleted /home/ma/.clearml deleted /home/ma/clearml.conf Nothing helps
one year ago
0 Votes
2 Answers
766 Views
0 Votes 2 Answers 766 Views
How can I move clearml dataset to another directory? Change its URL
one year ago
0 Votes
1 Answers
605 Views
0 Votes 1 Answers 605 Views
Hello, can clearml.Dataset be put in multiple threads or processes? Especially these two: clearml_dataset.add_files(dst_project_path.absolute()) clearml_data...
8 months ago
0 Votes
4 Answers
284 Views
0 Votes 4 Answers 284 Views
4 months ago
0 Votes
3 Answers
688 Views
0 Votes 3 Answers 688 Views
All of our users suddenly cant log in. We get 401, existing logged users are fine, but once logged out cant log back in. Here is what webserver says in logs:...
6 months ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
im downloading clearml dataset with: dataset.get_local_copy(use_soft_links=True) Somwtimes datasets are really huge, how to get progressbar or any callback o...
one year ago
0 Votes
3 Answers
510 Views
0 Votes 3 Answers 510 Views
Im having difficuilty understanding how to handle modified files on S3 - I have a file None , its relative_path is /raw/a.png Stored on clearml Dataset "A" (...
6 months ago
0 Votes
25 Answers
815 Views
0 Votes 25 Answers 815 Views
one year ago
0 Votes
3 Answers
758 Views
0 Votes 3 Answers 758 Views
Hey clearml team, would be nice to include dataset hash when using clearml-data cli. Is the order of --ids the same as returned rows?
7 months ago
0 Votes
5 Answers
769 Views
0 Votes 5 Answers 769 Views
10 months ago
0 Votes
6 Answers
733 Views
0 Votes 6 Answers 733 Views
9 months ago
0 Votes
29 Answers
1K Views
0 Votes 29 Answers 1K Views
Hello, please dont tell me I just deleted something: I wanted to do two things: - Update clearml server- I followed the guilde at None - I deleted my old con...
one year ago
0 Votes
9 Answers
168 Views
0 Votes 9 Answers 168 Views
Have you guys forgot to add uv caching? Im trying on 1.9.3rc0 and uv always redownloads the packages, doesnt use cache. Or is it my skill issue? All i added:...
one month ago
0 Votes
0 Answers
961 Views
0 Votes 0 Answers 961 Views
Tested on two PCs now
one year ago
0 Votes
1 Answers
851 Views
0 Votes 1 Answers 851 Views
Hello, can anyone please give us update on our self hosted Ceph server not working with your clearml.conf because we dont have "region" field? None
11 months ago
Show more results questions
0 Why Is Async_Delete Not Working?

good morning, I tried the script you provided and Im getting somewhere
image

11 months ago
0 Why Is Async_Delete Not Working?

I know these keys work, url and everything else works because I use these creds daily

11 months ago
0 Why Is Async_Delete Not Working?

helper is returned as None for some reason

11 months ago
0 Why Is Async_Delete Not Working?

I do have write permissions

11 months ago
0 Why Is Async_Delete Not Working?

we do, yes. Changing it to https in settings doesnt help

11 months ago
0 Why Is Async_Delete Not Working?

@<1523701435869433856:profile|SmugDolphin23> Any news?

10 months ago
0 Why Is Async_Delete Not Working?

@<1523703436166565888:profile|DeterminedCrab71> Thanks for responding
It was unclear to me that I need to set 443 also everywhere in clearml.conf
Setting s3 host urls with 443 in clearml.conf and also in web UI made it work

Im now almost at the finish line. The last thing that would be great is to fix archived task deletion.
For some reason i have error of missing S3 keys in clearml docker compose logs, the folder / files are not deleted in S3 bucket.

You can see how storage_credentials.co...

10 months ago
0 Why Is Async_Delete Not Working?

@<1523701070390366208:profile|CostlyOstrich36> Hello John, we are still unable to use clearml with our self hosted s3 CEPH instances, is there any update on the hotfix for 1.14?

11 months ago
0 Why Is Async_Delete Not Working?

The problem is that clearml.conf s3 config doesnt support empty region field, even empty strings crashes it

11 months ago
0 Why Is Async_Delete Not Working?

Adding bucket in clearml.conf causes the same error: clearml.storage - ERROR - Failed uploading: Could not connect to the endpoint URL: " None "
image
image
![image](https://clearml-web-assets.s3.amazonaws.com/scoold/images/TT...

11 months ago
0 Hi, I’Ve Set Up A Clearml Server With The Default_Output_Uri Pointed To S3. We’Re Planning To Migrate From S3 To Azure Blob Storage. Is There A Direct Way To Migrate The Data, Or Should We Simply Transfer The Data From S3 To Azure And Update The Default_

We had a similar problem. Clearml doesnt support data migration (not that I know of)
So you have two ways to fix this:

  • Recreate the dataset when its already in Azure
  • Edit each elasticsearch database file entry to point to new destination (we did this)
7 months ago
0 Why Is Async_Delete Not Working?

I tried it with port, but still having the same issue
Tried it with/without secure and multipart
image
image
image

11 months ago
0 Why Is Async_Delete Not Working?

there is a typing in clearm.conf i sent you on like 87, there should be "key" not "ey" im aware of it

11 months ago
0 Why Is Async_Delete Not Working?

removing it doesnt fix the problem

11 months ago
0 Why Is Async_Delete Not Working?

Yes, credetials seems to work
Im trying to figure out not why I dont see the uploaded files / folders

  • I checked maybe clearml task uses fileserver instead but i dont see any files in fileserver folder
  • Nothing is uploaded in bucket (i will ask IT guy to check if im uploading any files in logs)
    image
11 months ago
0 Why Is Async_Delete Not Working?
  1. This is how web UI configurations looks like
    image
10 months ago
0 Why Is Async_Delete Not Working?

Setting these urls in SETTINGS/Configuration/ WEB APP CLOUD ACCESS in web ui
None doesnt work
None doesnt work
None doesnt work
None doesnt work
None gets replaced to None ://s3.host-our.com:8080 doesnt work
None doesnt work
None doesnt work

In all of these inst...

10 months ago
0 Why Is Async_Delete Not Working?

i need clearml.conf on my clearml server (in config folder which is mounted in docker-compose) or user PC? Or Both?
Its self hosted S3 thats all I know, i dont think it s Minio

11 months ago
0 Why Is Async_Delete Not Working?

I dont have a region. I guess I will wait till tomarrow then?

11 months ago
0 Why Is Async_Delete Not Working?

Hey, i see that 1.14.2 dropped
I tried it but the issue is still there, maybe the hotfix is in next patch?

Here is the setup so you can reproduce it (we dont have region field)
clearml.conf:
s3 {
use_credentials_chain: false
credentials: [
{
host: " s3.somehost.com "
key: "XXXXXXXXXXXXXXXXXXXX"
` secret: "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX...

11 months ago
0 Why Is Async_Delete Not Working?

But there are stil some wierd issues, i cannot see the files uploaded in bucket

11 months ago
0 Why Is Async_Delete Not Working?

In which ui? Because there are two ways to do it. When clicking on artifacti url there is a popup (but has no way to change host url)
Our s3 host doesnt have port (didnt specify port in clearml.conf anywhere and upload works)
image
image
![image](https://clearml-web-assets.s3.amazonaws.com/scoold/images/TT9A...

10 months ago
0 Why Is Async_Delete Not Working?

clearml.conf is a fresh one i did clearml-init to make sure

11 months ago
0 Why Is Async_Delete Not Working?

also, when uploading artifacts, I see where they are stored on the s3 bucket, but I cant find where the debug images are stored at

11 months ago
0 Why Is Async_Delete Not Working?

Specifying it like this, gets me different error:

Exception has occurred: ValueError

  • Insufficient permissions (delete failed) for None
    botocore.exceptions.ClientError: An error occurred (IllegalLocationConstraintException) when calling the DeleteObject operation: The me-south-1 location constraint is incompatible for the region specific endpoint this request was sent to.

During handling of the above exception, another exception occurred:

File "/home/ma...

11 months ago
0 Have You Guys Forgot To Add Uv Caching? Im Trying On 1.9.3Rc0 And Uv Always Redownloads The Packages, Doesnt Use Cache. Or Is It My Skill Issue? All I Added: Package_Manager: {

Not really, but i think i will figure out the uv caching

I have another question @<1523701070390366208:profile|CostlyOstrich36>
How can i make the clearml agent to just run the image with just the uv
dont install any packages, nothing
i found docker_init_bash_script in clearml.config
i know there are some envs to pass in task init but that does not fully do what i want - just simply run the image, i have all the dependencies

28 days ago
0 Have You Guys Forgot To Add Uv Caching? Im Trying On 1.9.3Rc0 And Uv Always Redownloads The Packages, Doesnt Use Cache. Or Is It My Skill Issue? All I Added: Package_Manager: {

i can add "source /workspace/.venv/bin/activate", to clearml.conf docker_init_bash_script
However it then tries to access pip, but i dont need no pip, how to disable it, i already have my packages, and uv doesnt even require pip

28 days ago
Show more results compactanswers