AmiableSeaturtle81

35 Questions, 135 Answers

Active since 14 July 2023

Last activity 21 hours ago

Reputation

Badges 1

123 × Eureka!

Questions 35
Answers 135

0 Votes

4 Answers

225 Views

0 Votes 4 Answers 225 Views

Some Wierd Bug With Get_Local_Copy? I Have: Dataset C (100X A.Png, 100X B.Json, 100X C.Json) Dataset B (5X A.Png, 5X B.Json, 5X C.Json, 10X New.Json) Dataset A (5X A.Png) When Doing Get_Local_Copy() It Starts Downloading Dataset C Which Is 1.5Tb. This Sh

Some wierd bug with get_local_copy? I have: Dataset C (100x a.png, 100x b.json, 100x c.json) Dataset B (5x a.png, 5x b.json, 5x c.json, 10x new.json) Dataset...

clearml

3 months ago

0 Votes

0 Answers

762 Views

0 Votes 0 Answers 762 Views

5. S3 Setup Is Confusing For Me, So This Is How Clearml.Conf Looks Like On My Local Machine Where I Run Test Scripts

S3 Setup is confusing for me, so this is how clearml.conf looks like on my local machine where I run test scripts

clearml

11 months ago

0 Votes

7 Answers

532 Views

0 Votes 7 Answers 532 Views

Graph Is Drawn Quite Bad In Such Cases, Hard To Understand The Relations Red Line Shows The Actual Linking, But It Looks Like It Links To Another Dataset Along The Way Clearml==1.15.1

Graph is drawn quite bad in such cases, hard to understand the relations Red line shows the actual linking, but it looks like it links to another dataset alo...

clearml

5 months ago

0 Votes

25 Answers

742 Views

0 Votes 25 Answers 742 Views

I'Ve Had This Bug Where Every Few Weeks All My Current Running Experiments Are Stopped And Then Deleted. This Has Now Happend Like 3-4 Times. I Dont Understand What Is Causing It. Model Files, Debug Images Are Saved In Fileserver Folder, But The Task Itse

I've had this bug where every few weeks all my current running experiments are stopped and then deleted. This has now happend like 3-4 times. I dont understa...

clearml

11 months ago

0 Votes

1 Answers

1K Views

0 Votes 1 Answers 1K Views

Is There A Reason That Im Not Seeing Any Side Panels? Following This Tutorial:

Is there a reason that im not seeing any side panels? Following this tutorial: None

clearml

one year ago

0 Votes

2 Answers

119 Views

0 Votes 2 Answers 119 Views

Did We Hit The Clearml Self-Hosted Capacity? We Have 150Gb Of Scalar Index In Elasticsearach And Evertyhting Is Failing Hard. Console Logs, Scalars, Plots Are Not Loading, Averything In Clearml Web App Lags, Freezes Or Fails To Load The Server Is Has 30Gb

did we hit the clearml self-hosted capacity? We have 150GB of scalar index in elasticsearach and evertyhting is failing hard. Console logs, scalars, plots ar...

clearml

one month ago

0 Votes

0 Answers

562 Views

0 Votes 0 Answers 562 Views

Fixing It Manually Later On Fixes The Problem

fixing it manually later on fixes the problem

clearml

9 months ago

0 Votes

0 Answers

930 Views

0 Votes 0 Answers 930 Views

Hello, Has Anyone Had Problems Where Their Experiments Are Deleted And Tasks Killed For Some Reason? Multiple Times Now I Have Had My Experiments Aborted And Completely Wiped Out From Clearml, Including Images, Checkpoints And All. I Cant Figure Out What

hello, has anyone had problems where their experiments are deleted and tasks killed for some reason? Multiple times now I have had my experiments aborted and...

clearml

one year ago

0 Votes

1 Answers

1K Views

0 Votes 1 Answers 1K Views

How To Make Sure That Clearml Agents Are Running Queue After Server Restart? Sometimes Our Worker Dies And We Manually Have To Run Settuping For Queue, We Run It In Docker Mode Too

how to make sure that clearml agents are running queue after server restart? Sometimes our worker dies and we manually have to run settuping for queue, we ru...

clearml

one year ago

0 Votes

3 Answers

1K Views

0 Votes 3 Answers 1K Views

Im Downloading Clearml Dataset With: Dataset.Get_Local_Copy(Use_Soft_Links=True) Somwtimes Datasets Are Really Huge, How To Get Progressbar Or Any Callback On Download Status? Otherwise I Have To Check If I Have Network Trafic Or Something

im downloading clearml dataset with: dataset.get_local_copy(use_soft_links=True) Somwtimes datasets are really huge, how to get progressbar or any callback o...

clearml

one year ago

0 Votes

0 Answers

1K Views

0 Votes 0 Answers 1K Views

Deleted /Opt/Clearml Deleted /Home/Ma/.Clearml Deleted /Home/Ma/Clearml.Conf Nothing Helps

deleted /opt/clearml deleted /home/ma/.clearml deleted /home/ma/clearml.conf Nothing helps

clearml

one year ago

0 Votes

1 Answers

672 Views

0 Votes 1 Answers 672 Views

Is This A Bug When Doing Clearml-Agent Init? When It Asks For You To Specify File-Store If I Put

Is this a bug when doing clearml-agent init? When it asks for you to specify file-store if I put None it will fails to understant that its and S3 storage and...

clearml

9 months ago

0 Votes

3 Answers

440 Views

0 Votes 3 Answers 440 Views

Im Having Difficuilty Understanding How To Handle Modified Files On S3

Im having difficuilty understanding how to handle modified files on S3 - I have a file None , its relative_path is /raw/a.png Stored on clearml Dataset "A" (...

clearml

5 months ago

0 Votes

6 Answers

662 Views

0 Votes 6 Answers 662 Views

Does Dataset.Add_Files Support Uploading From S3 Uri? I Have No Problem Uploading To S3 But Cant Use Data That Is Already In S3? Or Am I Dong Something Wrong? I Read In Documentation That Add_External_Files Supports This Feature, But I Want To Be Able To

Does Dataset.add_files support uploading from S3 uri? I have no problem uploading to S3 but cant use data that is already in s3? Or am I dong something wrong...

clearml

8 months ago

0 Votes

2 Answers

706 Views

0 Votes 2 Answers 706 Views

How Can I Move Clearml Dataset To Another Directory? Change Its Url

How can I move clearml dataset to another directory? Change its URL

clearml

one year ago

0 Votes

1 Answers

507 Views

0 Votes 1 Answers 507 Views

Is There Any Way To Get Dataset Size Without Downloading State.Json? Im Doing Ds = Clearml.Dataset.Get(Dataset_Id=D_Id), But It Instantly Tries To Download State.Json Which Is On S3. Im Only Interested In Size And File Count Which I Then Get From Calling

Is there any way to get dataset size without downloading state.json? im doing ds = clearml.Dataset.get(dataset_id=d_id), but it instantly tries to download s...

clearml

6 months ago

0 Votes

1 Answers

542 Views

0 Votes 1 Answers 542 Views

Hello, Can Clearml.Dataset Be Put In Multiple Threads Or Processes? Especially These Two: Clearml_Dataset.Add_Files(Dst_Project_Path.Absolute()) Clearml_Dataset.Upload() Our Dataset Is About 2 Million Files, And It Is Way Too Slow

Hello, can clearml.Dataset be put in multiple threads or processes? Especially these two: clearml_dataset.add_files(dst_project_path.absolute()) clearml_data...

clearml

7 months ago

0 Votes

2 Answers

678 Views

0 Votes 2 Answers 678 Views

What Could Be The Reason That Im Not Getting Any Scalars Reported To Clearml Using Example Script?

What could be the reason that im not getting any scalars reported to clearml using example script? None

clearml

11 months ago

0 Votes

1 Answers

194 Views

0 Votes 1 Answers 194 Views

Hello, How Can I Run My Tasks Inside Docker Without Installing Anything At All. Assume That My Image Is Ready To Go And Only Thing That Could Change Is Code. This Is How I Run My Queue On Worker: Clearml-Agent Daemon --Queue Cccg --Docker This Is How I

Hello, how can i run my tasks inside docker without installing anything at all. Assume that my image is ready to go and only thing that could change is code....

clearml

2 months ago

0 Votes

1 Answers

778 Views

0 Votes 1 Answers 778 Views

Hello, Can Anyone Please Give Us Update On Our Self Hosted Ceph Server Not Working With Your Clearml.Conf Because We Dont Have "Region" Field?

Hello, can anyone please give us update on our self hosted Ceph server not working with your clearml.conf because we dont have "region" field? None

clearml

10 months ago

0 Votes

0 Answers

467 Views

0 Votes 0 Answers 467 Views

Is This A Bug? Clearml Version 1.26.4 Im Passing A List Of S3 Urls To Add_External_Files The List Is About 1K Of Files, But Only 7 Are Uploaded (Only Unique File Basenames) Here Is An Example: External_Files = [ '

Is this a bug? Clearml version 1.26.4 im passing a list of S3 urls to add_external_files The list is about 1K of files, but only 7 are uploaded (only unique ...

clearml

6 months ago

0 Votes

1 Answers

985 Views

0 Votes 1 Answers 985 Views

Well, Faq Helped:

well, FAQ helped: None I had to clear my cookies and session storage, problem solved

clearml

one year ago

0 Votes

3 Answers

603 Views

0 Votes 3 Answers 603 Views

All Of Our Users Suddenly Cant Log In. We Get 401, Existing Logged Users Are Fine, But Once Logged Out Cant Log Back In. Here Is What Webserver Says In Logs:

All of our users suddenly cant log in. We get 401, existing logged users are fine, but once logged out cant log back in. Here is what webserver says in logs:...

clearml

5 months ago

0 Votes

1 Answers

722 Views

0 Votes 1 Answers 722 Views

Hello, Clearml.Task Has Great Ability Save Environment State Like Packages Uncommited Changes Etc. How Can I Get The Same Effect When Creating Clearml.Dataset, It Doesnt Save The Package List. When Looking At Dataset Page, I See The Dataset Upload Task Bu

Hello, clearml.Task has great ability save environment state like packages uncommited changes etc. How can I get the same effect when creating clearml.Datase...

clearml

11 months ago

0 Votes

1 Answers

491 Views

0 Votes 1 Answers 491 Views

Hello, How To Handle Clearml.Task.Add_Requirements("Requirements.Txt) Cases When We Have --Extra-Intex-Url In The File

Hello, how to handle clearml.Task.add_requirements("requirements.txt) cases when we have --extra-intex-url in the file

clearml

5 months ago

0 Votes

0 Answers

902 Views

0 Votes 0 Answers 902 Views

Tested On Two Pcs Now

Tested on two PCs now

clearml

one year ago

0 Votes

29 Answers

1K Views

0 Votes 29 Answers 1K Views

Hello, Please Dont Tell Me I Just Deleted Something: I Wanted To Do Two Things:

Hello, please dont tell me I just deleted something: I wanted to do two things: - Update clearml server- I followed the guilde at None - I deleted my old con...

clearml

one year ago

0 Votes

5 Answers

558 Views

0 Votes 5 Answers 558 Views

Hello, For Some Reason My Upload Speed To S3 Is Insanely Slow, I Noticed In Logs That It Upoads To /Tmp Folder. What Does That Mean? Why Tmp?

Hello, for some reason my upload speed to S3 is insanely slow, I noticed in logs that it upoads to /tmp folder. What does that mean? why tmp?

clearml

7 months ago

0 Votes

3 Answers

669 Views

0 Votes 3 Answers 669 Views

Hey Clearml Team, Would Be Nice To Include Dataset Hash When Using Clearml-Data Cli. Is The Order Of --Ids The Same As Returned Rows?

Hey clearml team, would be nice to include dataset hash when using clearml-data cli. Is the order of --ids the same as returned rows?

dataset

6 months ago

0 Votes

1 Answers

718 Views

0 Votes 1 Answers 718 Views

Another Annoying Problem We Have Is That Task Deletion Doesnt Delete Any Files At All. I Have Selected Deletion Of Images But Nothing Is Deleted. I Have To Write Python Scripts To Delete Up To 1Tb Data

Another annoying problem we have is that task deletion doesnt delete any files at all. I have selected deletion of images But nothing is deleted. I have to w...

clearml

11 months ago

Show more results

0 Hey Clearml Team, Would Be Nice To Include Dataset Hash When Using Clearml-Data Cli. Is The Order Of --Ids The Same As Returned Rows?

I already found the source code and i modified it as needed.
How can I now get this info from Task that is created when Dataset is created?
Couldnt find anything like clearml.Dataset(id=id).get_size()

6 months ago

0 Hi There, Our. Self-Hosted Server Is Periodically Very Slow To React In The Web Ui. We'Ve Been Debugging For Quite Some Time, And It Would Seem That Elastisearch Might Be The Culprit. Looking At The Elastisearch Index, We Have An Index Of Around 80G Of Tr

What you want is to have a service script that cleans up archived tasks, here is what we used: None

2 months ago

WebApp: 1.16.0-494 • Server: 1.16.0-494 • API: 2.30
But be careful, upgrading is extremely dangerous

2 months ago

@<1523701601770934272:profile|GiganticMole91> Thats rookie numbers. We are at 228 GB for elastic now

2 months ago

0 Hey Clearml Team, Would Be Nice To Include Dataset Hash When Using Clearml-Data Cli. Is The Order Of --Ids The Same As Returned Rows?

Im doing all of this because there isnt (or im not aware of) any good way understand what datasets are on workers

6 months ago

7 out of 30 GB is currently used and is quite stable

2 months ago

has 8 cores, so nothing fancy even

2 months ago

0 All Of Our Users Suddenly Cant Log In. We Get 401, Existing Logged Users Are Fine, But Once Logged Out Cant Log Back In. Here Is What Webserver Says In Logs:

We fixed the issue, thanks, had to update everything to latest.

5 months ago

0 Why Is Async_Delete Not Working?

Setting these urls in SETTINGS/Configuration/ WEB APP CLOUD ACCESS in web ui
None doesnt work
None doesnt work
None doesnt work
None doesnt work
None gets replaced to None ://s3.host-our.com:8080 doesnt work
None doesnt work
None doesnt work

In all of these inst...

9 months ago

0 Why Is Async_Delete Not Working?

Hey, i see that 1.14.2 dropped
I tried it but the issue is still there, maybe the hotfix is in next patch?

Here is the setup so you can reproduce it (we dont have region field)
clearml.conf:
s3 {
use_credentials_chain: false
credentials: [
{
host: " s3.somehost.com "
key: "XXXXXXXXXXXXXXXXXXXX"
` secret: "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX...