Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
AmiableSeaturtle81
Moderator
35 Questions, 135 Answers
  Active since 14 July 2023
  Last activity 11 months ago

Reputation

0

Badges 1

123 × Eureka!
0 Votes
6 Answers
2K Views
0 Votes 6 Answers 2K Views
Does Dataset.Add_Files Support Uploading From S3 Uri? I Have No Problem Uploading To S3 But Cant Use Data That Is Already In S3? Or Am I Dong Something Wrong? I Read In Documentation That Add_External_Files Supports This Feature, But I Want To Be Able To
Does Dataset.add_files support uploading from S3 uri? I have no problem uploading to S3 but cant use data that is already in s3? Or am I dong something wrong...
one year ago
0 Votes
3 Answers
2K Views
0 Votes 3 Answers 2K Views
All Of Our Users Suddenly Cant Log In. We Get 401, Existing Logged Users Are Fine, But Once Logged Out Cant Log Back In. Here Is What Webserver Says In Logs:
All of our users suddenly cant log in. We get 401, existing logged users are fine, but once logged out cant log back in. Here is what webserver says in logs:...
one year ago
0 Votes
2 Answers
1K Views
0 Votes 2 Answers 1K Views
How Can I Move Clearml Dataset To Another Directory? Change Its Url
How can I move clearml dataset to another directory? Change its URL
one year ago
0 Votes
0 Answers
2K Views
0 Votes 0 Answers 2K Views
Hello, Has Anyone Had Problems Where Their Experiments Are Deleted And Tasks Killed For Some Reason? Multiple Times Now I Have Had My Experiments Aborted And Completely Wiped Out From Clearml, Including Images, Checkpoints And All. I Cant Figure Out What
hello, has anyone had problems where their experiments are deleted and tasks killed for some reason? Multiple times now I have had my experiments aborted and...
2 years ago
0 Votes
2 Answers
1K Views
0 Votes 2 Answers 1K Views
Did We Hit The Clearml Self-Hosted Capacity? We Have 150Gb Of Scalar Index In Elasticsearach And Evertyhting Is Failing Hard. Console Logs, Scalars, Plots Are Not Loading, Averything In Clearml Web App Lags, Freezes Or Fails To Load The Server Is Has 30Gb
did we hit the clearml self-hosted capacity? We have 150GB of scalar index in elasticsearach and evertyhting is failing hard. Console logs, scalars, plots ar...
one year ago
0 Votes
1 Answers
1K Views
0 Votes 1 Answers 1K Views
Another Annoying Problem We Have Is That Task Deletion Doesnt Delete Any Files At All. I Have Selected Deletion Of Images But Nothing Is Deleted. I Have To Write Python Scripts To Delete Up To 1Tb Data
Another annoying problem we have is that task deletion doesnt delete any files at all. I have selected deletion of images But nothing is deleted. I have to w...
one year ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
Im Having Difficuilty Understanding How To Handle Modified Files On S3
Im having difficuilty understanding how to handle modified files on S3 - I have a file None , its relative_path is /raw/a.png Stored on clearml Dataset "A" (...
one year ago
0 Votes
5 Answers
2K Views
0 Votes 5 Answers 2K Views
Hello, What Are Mongodb Default Login Credentials For Self Hosted Clearml Server? We Are Moving Our Datasets To Another Place And So Far I Think Clearml Doesnt Support It. So I Would Like To Try Change The Database Entry (Im Guessing Its Stored Somewhere)
Hello, what are mongodb default login credentials for self hosted clearml server? We are moving our datasets to another place and so far I think clearml does...
one year ago
0 Votes
1 Answers
2K Views
0 Votes 1 Answers 2K Views
<image>
2 years ago
0 Votes
1 Answers
1K Views
0 Votes 1 Answers 1K Views
Is This A Bug When Doing Clearml-Agent Init? When It Asks For You To Specify File-Store If I Put
Is this a bug when doing clearml-agent init? When it asks for you to specify file-store if I put None it will fails to understant that its and S3 storage and...
one year ago
0 Votes
25 Answers
2K Views
0 Votes 25 Answers 2K Views
I'Ve Had This Bug Where Every Few Weeks All My Current Running Experiments Are Stopped And Then Deleted. This Has Now Happend Like 3-4 Times. I Dont Understand What Is Causing It. Model Files, Debug Images Are Saved In Fileserver Folder, But The Task Itse
I've had this bug where every few weeks all my current running experiments are stopped and then deleted. This has now happend like 3-4 times. I dont understa...
one year ago
0 Votes
3 Answers
2K Views
0 Votes 3 Answers 2K Views
Hey Clearml Team, Would Be Nice To Include Dataset Hash When Using Clearml-Data Cli. Is The Order Of --Ids The Same As Returned Rows?
Hey clearml team, would be nice to include dataset hash when using clearml-data cli. Is the order of --ids the same as returned rows?
one year ago
0 Votes
0 Answers
2K Views
0 Votes 0 Answers 2K Views
Deleted /Opt/Clearml Deleted /Home/Ma/.Clearml Deleted /Home/Ma/Clearml.Conf Nothing Helps
deleted /opt/clearml deleted /home/ma/.clearml deleted /home/ma/clearml.conf Nothing helps
2 years ago
0 Votes
14 Answers
2K Views
0 Votes 14 Answers 2K Views
Hello, Im Having Huge Performance Issues On Large Clearml Datasets How Can I Link To Parent Dataset Without Parent Dataset Files. I Want To Create A Smaller Subset Of Parent Dataset, Like 5% Of It. To Achieve This, I Have To Call Remove_Files() To 60K It
Hello, im having huge performance issues on large Clearml Datasets How can I link to parent dataset without parent dataset files. I want to create a smaller ...
one year ago
0 Votes
29 Answers
2K Views
0 Votes 29 Answers 2K Views
Hello, Please Dont Tell Me I Just Deleted Something: I Wanted To Do Two Things:
Hello, please dont tell me I just deleted something: I wanted to do two things: - Update clearml server- I followed the guilde at None - I deleted my old con...
2 years ago
0 Votes
0 Answers
2K Views
0 Votes 0 Answers 2K Views
Tested On Two Pcs Now
Tested on two PCs now
2 years ago
0 Votes
0 Answers
1K Views
0 Votes 0 Answers 1K Views
Fixing It Manually Later On Fixes The Problem
fixing it manually later on fixes the problem
one year ago
0 Votes
1 Answers
1K Views
0 Votes 1 Answers 1K Views
Hello, Can Clearml.Dataset Be Put In Multiple Threads Or Processes? Especially These Two: Clearml_Dataset.Add_Files(Dst_Project_Path.Absolute()) Clearml_Dataset.Upload() Our Dataset Is About 2 Million Files, And It Is Way Too Slow
Hello, can clearml.Dataset be put in multiple threads or processes? Especially these two: clearml_dataset.add_files(dst_project_path.absolute()) clearml_data...
one year ago
0 Votes
1 Answers
2K Views
0 Votes 1 Answers 2K Views
Hello, Clearml.Task Has Great Ability Save Environment State Like Packages Uncommited Changes Etc. How Can I Get The Same Effect When Creating Clearml.Dataset, It Doesnt Save The Package List. When Looking At Dataset Page, I See The Dataset Upload Task Bu
Hello, clearml.Task has great ability save environment state like packages uncommited changes etc. How can I get the same effect when creating clearml.Datase...
one year ago
0 Votes
1 Answers
2K Views
0 Votes 1 Answers 2K Views
Hello, Can Anyone Please Give Us Update On Our Self Hosted Ceph Server Not Working With Your Clearml.Conf Because We Dont Have "Region" Field?
Hello, can anyone please give us update on our self hosted Ceph server not working with your clearml.conf because we dont have "region" field? None
one year ago
0 Votes
9 Answers
1K Views
0 Votes 9 Answers 1K Views
Have You Guys Forgot To Add Uv Caching? Im Trying On 1.9.3Rc0 And Uv Always Redownloads The Packages, Doesnt Use Cache. Or Is It My Skill Issue? All I Added: Package_Manager: {
Have you guys forgot to add uv caching? Im trying on 1.9.3rc0 and uv always redownloads the packages, doesnt use cache. Or is it my skill issue? All i added:...
11 months ago
0 Votes
1 Answers
1K Views
0 Votes 1 Answers 1K Views
Hello, How To Handle Clearml.Task.Add_Requirements("Requirements.Txt) Cases When We Have --Extra-Intex-Url In The File
Hello, how to handle clearml.Task.add_requirements("requirements.txt) cases when we have --extra-intex-url in the file
one year ago
0 Votes
7 Answers
1K Views
0 Votes 7 Answers 1K Views
Graph Is Drawn Quite Bad In Such Cases, Hard To Understand The Relations Red Line Shows The Actual Linking, But It Looks Like It Links To Another Dataset Along The Way Clearml==1.15.1
Graph is drawn quite bad in such cases, hard to understand the relations Red line shows the actual linking, but it looks like it links to another dataset alo...
one year ago
0 Votes
5 Answers
1K Views
0 Votes 5 Answers 1K Views
Hello, For Some Reason My Upload Speed To S3 Is Insanely Slow, I Noticed In Logs That It Upoads To /Tmp Folder. What Does That Mean? Why Tmp?
Hello, for some reason my upload speed to S3 is insanely slow, I noticed in logs that it upoads to /tmp folder. What does that mean? why tmp?
one year ago
0 Votes
1 Answers
1K Views
0 Votes 1 Answers 1K Views
Hello, How Can I Run My Tasks Inside Docker Without Installing Anything At All. Assume That My Image Is Ready To Go And Only Thing That Could Change Is Code. This Is How I Run My Queue On Worker: Clearml-Agent Daemon --Queue Cccg --Docker This Is How I
Hello, how can i run my tasks inside docker without installing anything at all. Assume that my image is ready to go and only thing that could change is code....
one year ago
0 Votes
2 Answers
2K Views
0 Votes 2 Answers 2K Views
What Could Be The Reason That Im Not Getting Any Scalars Reported To Clearml Using Example Script?
What could be the reason that im not getting any scalars reported to clearml using example script? None
one year ago
0 Votes
3 Answers
2K Views
0 Votes 3 Answers 2K Views
Im Downloading Clearml Dataset With: Dataset.Get_Local_Copy(Use_Soft_Links=True) Somwtimes Datasets Are Really Huge, How To Get Progressbar Or Any Callback On Download Status? Otherwise I Have To Check If I Have Network Trafic Or Something
im downloading clearml dataset with: dataset.get_local_copy(use_soft_links=True) Somwtimes datasets are really huge, how to get progressbar or any callback o...
2 years ago
0 Votes
1 Answers
2K Views
0 Votes 1 Answers 2K Views
Well, Faq Helped:
well, FAQ helped: None I had to clear my cookies and session storage, problem solved
2 years ago
0 Votes
1 Answers
2K Views
0 Votes 1 Answers 2K Views
Is There Any Way To Get Dataset Size Without Downloading State.Json? Im Doing Ds = Clearml.Dataset.Get(Dataset_Id=D_Id), But It Instantly Tries To Download State.Json Which Is On S3. Im Only Interested In Size And File Count Which I Then Get From Calling
Is there any way to get dataset size without downloading state.json? im doing ds = clearml.Dataset.get(dataset_id=d_id), but it instantly tries to download s...
one year ago
0 Votes
0 Answers
1K Views
0 Votes 0 Answers 1K Views
Is This A Bug? Clearml Version 1.26.4 Im Passing A List Of S3 Urls To Add_External_Files The List Is About 1K Of Files, But Only 7 Are Uploaded (Only Unique File Basenames) Here Is An Example: External_Files = [ '
Is this a bug? Clearml version 1.26.4 im passing a list of S3 urls to add_external_files The list is about 1K of files, but only 7 are uploaded (only unique ...
one year ago
Show more results questions
0 I'Ve Had This Bug Where Every Few Weeks All My Current Running Experiments Are Stopped And Then Deleted. This Has Now Happend Like 3-4 Times. I Dont Understand What Is Causing It. Model Files, Debug Images Are Saved In Fileserver Folder, But The Task Itse

@<1523701087100473344:profile|SuccessfulKoala55> Anything on this?

one year ago
0 I'Ve Had This Bug Where Every Few Weeks All My Current Running Experiments Are Stopped And Then Deleted. This Has Now Happend Like 3-4 Times. I Dont Understand What Is Causing It. Model Files, Debug Images Are Saved In Fileserver Folder, But The Task Itse

hi, thanks for reaching out. Getting desperate here.
Yes, its self hosted
No, only currently running experiments are deleted (task itself is gone, but debug images and models are present in fileserver folder)

What I do see is some random elastisearch errors popping up from time to time

[2024-01-05 09:16:47,707] [9] [WARNING] [elasticsearch] POST None ` [status:N/A requ...

one year ago
0 I'Ve Had This Bug Where Every Few Weeks All My Current Running Experiments Are Stopped And Then Deleted. This Has Now Happend Like 3-4 Times. I Dont Understand What Is Causing It. Model Files, Debug Images Are Saved In Fileserver Folder, But The Task Itse

from docker inspect I can see that allegorai/clearml uses:
"CLEARML_SERVER_VERSION=1.11.0",
"CLEARML_SERVER_BUILD=373"

Image hash:ed05631045c4237f59ad48f477e06dd72274ab67e70d2f9adc489431d1ce75d7

one year ago
0 I'Ve Had This Bug Where Every Few Weeks All My Current Running Experiments Are Stopped And Then Deleted. This Has Now Happend Like 3-4 Times. I Dont Understand What Is Causing It. Model Files, Debug Images Are Saved In Fileserver Folder, But The Task Itse

I do notice another strange thing
Agent-services is down because It has no API key to clearm

one year ago
0 I'Ve Had This Bug Where Every Few Weeks All My Current Running Experiments Are Stopped And Then Deleted. This Has Now Happend Like 3-4 Times. I Dont Understand What Is Causing It. Model Files, Debug Images Are Saved In Fileserver Folder, But The Task Itse

after task is deleted

one year ago
0 I'Ve Had This Bug Where Every Few Weeks All My Current Running Experiments Are Stopped And Then Deleted. This Has Now Happend Like 3-4 Times. I Dont Understand What Is Causing It. Model Files, Debug Images Are Saved In Fileserver Folder, But The Task Itse
  1. is 50GB elastisearch normal? Have you seen it. elsewhere or are we doing something wrong, one thing I think is that we are probably logging too frequently
  2. Is it possible to somehow clean up this?
one year ago
0 I'Ve Had This Bug Where Every Few Weeks All My Current Running Experiments Are Stopped And Then Deleted. This Has Now Happend Like 3-4 Times. I Dont Understand What Is Causing It. Model Files, Debug Images Are Saved In Fileserver Folder, But The Task Itse

image

one year ago
0 I'Ve Had This Bug Where Every Few Weeks All My Current Running Experiments Are Stopped And Then Deleted. This Has Now Happend Like 3-4 Times. I Dont Understand What Is Causing It. Model Files, Debug Images Are Saved In Fileserver Folder, But The Task Itse

I see the debug images in fileserver folder

one year ago
0 I'Ve Had This Bug Where Every Few Weeks All My Current Running Experiments Are Stopped And Then Deleted. This Has Now Happend Like 3-4 Times. I Dont Understand What Is Causing It. Model Files, Debug Images Are Saved In Fileserver Folder, But The Task Itse

What do you mean by reusing the task for clearml Dataset, got a code example?
We have multiple different projects with multiple people working on each project.
This is our most used code on dataset uploading
image

one year ago
0 I'Ve Had This Bug Where Every Few Weeks All My Current Running Experiments Are Stopped And Then Deleted. This Has Now Happend Like 3-4 Times. I Dont Understand What Is Causing It. Model Files, Debug Images Are Saved In Fileserver Folder, But The Task Itse

The incident happened last friday (5 january)
Im giving you logs from around that time
image

one year ago
0 Hello, Please Dont Tell Me I Just Deleted Something: I Wanted To Do Two Things:

is there any way to see if I even have the data in mongodb?

2 years ago
0 Hello, Please Dont Tell Me I Just Deleted Something: I Wanted To Do Two Things:

I hope that its all the experiments

2 years ago
0 Why Is Async_Delete Not Working?

image

one year ago
0 Have You Guys Forgot To Add Uv Caching? Im Trying On 1.9.3Rc0 And Uv Always Redownloads The Packages, Doesnt Use Cache. Or Is It My Skill Issue? All I Added: Package_Manager: {

i can add "source /workspace/.venv/bin/activate", to clearml.conf docker_init_bash_script
However it then tries to access pip, but i dont need no pip, how to disable it, i already have my packages, and uv doesnt even require pip

11 months ago
0 Some Wierd Bug With Get_Local_Copy? I Have: Dataset C (100X A.Png, 100X B.Json, 100X C.Json) Dataset B (5X A.Png, 5X B.Json, 5X C.Json, 10X New.Json) Dataset A (5X A.Png) When Doing Get_Local_Copy() It Starts Downloading Dataset C Which Is 1.5Tb. This Sh

@<1523701070390366208:profile|CostlyOstrich36> It it still needed since Eugene thinks there is a bug?

one year ago
Show more results compactanswers