AmiableSeaturtle81

35 Questions, 135 Answers

Active since 14 July 2023

Last activity 19 hours ago

Reputation

Badges 1

123 × Eureka!

Questions 35
Answers 135

0 Votes

2 Answers

678 Views

0 Votes 2 Answers 678 Views

What Could Be The Reason That Im Not Getting Any Scalars Reported To Clearml Using Example Script?

What could be the reason that im not getting any scalars reported to clearml using example script? None

clearml

11 months ago

0 Votes

1 Answers

194 Views

0 Votes 1 Answers 194 Views

Hello, How Can I Run My Tasks Inside Docker Without Installing Anything At All. Assume That My Image Is Ready To Go And Only Thing That Could Change Is Code. This Is How I Run My Queue On Worker: Clearml-Agent Daemon --Queue Cccg --Docker This Is How I

Hello, how can i run my tasks inside docker without installing anything at all. Assume that my image is ready to go and only thing that could change is code....

clearml

2 months ago

0 Votes

80 Answers

33K Views

0 Votes 80 Answers 33K Views

Why Is Async_Delete Not Working?

Why is async_delete not working? - bucket is not right in logs - This is really misleading in web ui, because it says "success" although async_delete failed ...

clearml

11 months ago

0 Votes

1 Answers

778 Views

0 Votes 1 Answers 778 Views

Hello, Can Anyone Please Give Us Update On Our Self Hosted Ceph Server Not Working With Your Clearml.Conf Because We Dont Have "Region" Field?

Hello, can anyone please give us update on our self hosted Ceph server not working with your clearml.conf because we dont have "region" field? None

clearml

10 months ago

0 Votes

0 Answers

466 Views

0 Votes 0 Answers 466 Views

Is This A Bug? Clearml Version 1.26.4 Im Passing A List Of S3 Urls To Add_External_Files The List Is About 1K Of Files, But Only 7 Are Uploaded (Only Unique File Basenames) Here Is An Example: External_Files = [ '

Is this a bug? Clearml version 1.26.4 im passing a list of S3 urls to add_external_files The list is about 1K of files, but only 7 are uploaded (only unique ...

clearml

6 months ago

Show more results

0 I'Ve Had This Bug Where Every Few Weeks All My Current Running Experiments Are Stopped And Then Deleted. This Has Now Happend Like 3-4 Times. I Dont Understand What Is Causing It. Model Files, Debug Images Are Saved In Fileserver Folder, But The Task Itse

after task is deleted

11 months ago

we are cleaning, but there is a major problem
When deleting a task from web UI, nothing is deleted elsewhere
Debug images are not deleted, models are not deleted. And I suspect that scalars and logs are not deleted too
Im not sure why is that so

11 months ago

0 Graph Is Drawn Quite Bad In Such Cases, Hard To Understand The Relations Red Line Shows The Actual Linking, But It Looks Like It Links To Another Dataset Along The Way Clearml==1.15.1

@<1523701070390366208:profile|CostlyOstrich36> Updated webserver and the problem still persists
This is the new stack:
WebApp: 1.15.1-478 • Server: 1.14.1-451 • API: 2.28

notice, we didnt update API (we had running experiments)

5 months ago

0 Hello, Im Having Huge Performance Issues On Large Clearml Datasets How Can I Link To Parent Dataset Without Parent Dataset Files. I Want To Create A Smaller Subset Of Parent Dataset, Like 5% Of It. To Achieve This, I Have To Call Remove_Files() To 60K It

@<1709740168430227456:profile|HomelyBluewhale47> We have the same problem. Millions of files, stored on CEPH. I would not recommend you to do it this way. Everything gets insanely slow (dataset.list_files, downloading the dataset, removing files)

The way I use Clearml Datasets for large number of samples now is to save a json which stores all paths to samples in Dataset metadata:
clearml_dataset.set_metadata(metadata, metadata_name=metadata_key)

However this then means that you need wrappe...

6 months ago

0 Why Is Async_Delete Not Working?

Setting these urls in SETTINGS/Configuration/ WEB APP CLOUD ACCESS in web ui
None doesnt work
None doesnt work
None doesnt work
None doesnt work
None gets replaced to None ://s3.host-our.com:8080 doesnt work
None doesnt work
None doesnt work

In all of these inst...

9 months ago

0 Hello, Please Dont Tell Me I Just Deleted Something: I Wanted To Do Two Things:

well, I connected to mongodb manually and it is empty, loaded with just examples

one year ago

0 Hello, Please Dont Tell Me I Just Deleted Something: I Wanted To Do Two Things:

But it seems like the data is gone, not sure how to get them back

one year ago

0 Hello, Please Dont Tell Me I Just Deleted Something: I Wanted To Do Two Things:

I guess I fucked up something when moving files

one year ago

0 Hello, Please Dont Tell Me I Just Deleted Something: I Wanted To Do Two Things:

I get the same when I copy /opt/clearml/data folder into /mnt/data/clearml/data

one year ago

0 Hello, Please Dont Tell Me I Just Deleted Something: I Wanted To Do Two Things:

I get sidebars and login on my local PC
But the data isnt loaded

I tried to not edit anything in docker-compose and just paste my data in there. Didnt help

one year ago

0 Hello, Please Dont Tell Me I Just Deleted Something: I Wanted To Do Two Things:

Is fileserver folder needed for successful backup?

one year ago

0 Hello, Please Dont Tell Me I Just Deleted Something: I Wanted To Do Two Things:

thanks for help

one year ago

0 Hello, Please Dont Tell Me I Just Deleted Something: I Wanted To Do Two Things:

Log dump

one year ago

0 Have You Guys Forgot To Add Uv Caching? Im Trying On 1.9.3Rc0 And Uv Always Redownloads The Packages, Doesnt Use Cache. Or Is It My Skill Issue? All I Added: Package_Manager: {

Im basically trying to force the agent to use uv defined python

one day ago

0 Hello, Please Dont Tell Me I Just Deleted Something: I Wanted To Do Two Things:

yes

one year ago

0 Have You Guys Forgot To Add Uv Caching? Im Trying On 1.9.3Rc0 And Uv Always Redownloads The Packages, Doesnt Use Cache. Or Is It My Skill Issue? All I Added: Package_Manager: {

Where can i override this so that it uses uv instead of trying to install python with apt

one day ago

0 Hello, Please Dont Tell Me I Just Deleted Something: I Wanted To Do Two Things:

here is also another magic stuff

one year ago

0 Have You Guys Forgot To Add Uv Caching? Im Trying On 1.9.3Rc0 And Uv Always Redownloads The Packages, Doesnt Use Cache. Or Is It My Skill Issue? All I Added: Package_Manager: {

I see in clearml-agent that it is created here

one day ago

0 Im Downloading Clearml Dataset With: Dataset.Get_Local_Copy(Use_Soft_Links=True) Somwtimes Datasets Are Really Huge, How To Get Progressbar Or Any Callback On Download Status? Otherwise I Have To Check If I Have Network Trafic Or Something

doesnt help

one year ago

0 Hello, For Some Reason My Upload Speed To S3 Is Insanely Slow, I Noticed In Logs That It Upoads To /Tmp Folder. What Does That Mean? Why Tmp?

No, i specify where to upload
I see the data on S3 bucket is beeing uploaded. Just the log messages are really confusing

7 months ago

0 Have You Guys Forgot To Add Uv Caching? Im Trying On 1.9.3Rc0 And Uv Always Redownloads The Packages, Doesnt Use Cache. Or Is It My Skill Issue? All I Added: Package_Manager: {

Not really, but i think i will figure out the uv caching

I have another question @<1523701070390366208:profile|CostlyOstrich36>
How can i make the clearml agent to just run the image with just the uv
dont install any packages, nothing
i found docker_init_bash_script in clearml.config
i know there are some envs to pass in task init but that does not fully do what i want - just simply run the image, i have all the dependencies

one day ago

0 Hello, Please Dont Tell Me I Just Deleted Something: I Wanted To Do Two Things:

I also dont have side panel for some reason

one year ago

0 Hello, Please Dont Tell Me I Just Deleted Something: I Wanted To Do Two Things:

This is what I see on fresh clearml
Where all my mounts are on /mnt/data/clearml-server instead of /opt/clearml