AmiableSeaturtle81

35 Questions, 135 Answers

Active since 14 July 2023

Last activity 9 months ago

Reputation

Badges 1

123 × Eureka!

Answers 135

0 Graph Is Drawn Quite Bad In Such Cases, Hard To Understand The Relations Red Line Shows The Actual Linking, But It Looks Like It Links To Another Dataset Along The Way Clearml==1.15.1

Can I do it while i have multiple ongoing training?

one year ago

0 Does Dataset.Add_Files Support Uploading From S3 Uri? I Have No Problem Uploading To S3 But Cant Use Data That Is Already In S3? Or Am I Dong Something Wrong? I Read In Documentation That Add_External_Files Supports This Feature, But I Want To Be Able To

Yes, but does add_external_files makes chunked zips as add_files do?

one year ago

0 Hello, What Are Mongodb Default Login Credentials For Self Hosted Clearml Server? We Are Moving Our Datasets To Another Place And So Far I Think Clearml Doesnt Support It. So I Would Like To Try Change The Database Entry (Im Guessing Its Stored Somewhere)

ok, is dataset path stored in mongo?
Im unable to find it in elasticsearch (debug images were here)

one year ago

0 Why Is Async_Delete Not Working?

maybe someone on your end can try to parse such a config and see if they also have the same problem

one year ago

0 Hello, Im Having Huge Performance Issues On Large Clearml Datasets How Can I Link To Parent Dataset Without Parent Dataset Files. I Want To Create A Smaller Subset Of Parent Dataset, Like 5% Of It. To Achieve This, I Have To Call Remove_Files() To 60K It

You can check out boto3 python client (This is what we use to download / upload all S3 stuff), but minio-client probably already uses it under the hood.
We also use aws cli to do some downloading, it is way faster than python.

Regarding pdfs, yes, you have no choice but to preprocess it

one year ago

0 Hi There, Our. Self-Hosted Server Is Periodically Very Slow To React In The Web Ui. We'Ve Been Debugging For Quite Some Time, And It Would Seem That Elastisearch Might Be The Culprit. Looking At The Elastisearch Index, We Have An Index Of Around 80G Of Tr

WebApp: 1.16.0-494 • Server: 1.16.0-494 • API: 2.30
But be careful, upgrading is extremely dangerous

11 months ago

0 Have You Guys Forgot To Add Uv Caching? Im Trying On 1.9.3Rc0 And Uv Always Redownloads The Packages, Doesnt Use Cache. Or Is It My Skill Issue? All I Added: Package_Manager: {

how to get rid of this auto appended line

9 months ago

0 Have You Guys Forgot To Add Uv Caching? Im Trying On 1.9.3Rc0 And Uv Always Redownloads The Packages, Doesnt Use Cache. Or Is It My Skill Issue? All I Added: Package_Manager: {

i also think that if my package manager is set to uv, then it should only use uv and ignore pip at all

9 months ago

0 Hi, I’Ve Set Up A Clearml Server With The Default_Output_Uri Pointed To S3. We’Re Planning To Migrate From S3 To Azure Blob Storage. Is There A Direct Way To Migrate The Data, Or Should We Simply Transfer The Data From S3 To Azure And Update The Default_

We had a similar problem. Clearml doesnt support data migration (not that I know of)
So you have two ways to fix this:

Recreate the dataset when its already in Azure
Edit each elasticsearch database file entry to point to new destination (we did this)

one year ago

has 8 cores, so nothing fancy even

11 months ago

0 Did We Hit The Clearml Self-Hosted Capacity? We Have 150Gb Of Scalar Index In Elasticsearach And Evertyhting Is Failing Hard. Console Logs, Scalars, Plots Are Not Loading, Averything In Clearml Web App Lags, Freezes Or Fails To Load The Server Is Has 30Gb

Is it possible to split the large elasticsearch indexes? I know elasticsearch has something called rollover, but im not sure that clearml supports this

10 months ago

0 Hello, Please Dont Tell Me I Just Deleted Something: I Wanted To Do Two Things:

I guess I fucked up something when moving files

2 years ago

0 Have You Guys Forgot To Add Uv Caching? Im Trying On 1.9.3Rc0 And Uv Always Redownloads The Packages, Doesnt Use Cache. Or Is It My Skill Issue? All I Added: Package_Manager: {

Im basically trying to force the agent to use uv defined python

9 months ago

0 All Of Our Users Suddenly Cant Log In. We Get 401, Existing Logged Users Are Fine, But Once Logged Out Cant Log Back In. Here Is What Webserver Says In Logs:

We fixed the issue, thanks, had to update everything to latest.

one year ago

0 Have You Guys Forgot To Add Uv Caching? Im Trying On 1.9.3Rc0 And Uv Always Redownloads The Packages, Doesnt Use Cache. Or Is It My Skill Issue? All I Added: Package_Manager: {

i can add "source /workspace/.venv/bin/activate", to clearml.conf docker_init_bash_script
However it then tries to access pip, but i dont need no pip, how to disable it, i already have my packages, and uv doesnt even require pip

9 months ago

Show more results