ObedientTurkey46

16 Questions, 17 Answers

Active since 30 April 2024

Last activity 28 days ago

Reputation

Badges 1

17 × Eureka!

Questions 16
Answers 17

0 Votes

2 Answers

571 Views

0 Votes 2 Answers 571 Views

Hello, I Have An Issue With Task.Close(). On A Mac It Works As Expected, But On My (Gpu Enabled) Linux Machine The Code Execution Freezes When Calling Task.Close(). Do You Have Any Idea What The Issue Could Be Or How I Cloud Debug It? The Log Does Not Sho

Hello, I have an issue with task.close(). On a Mac it works as expected, but on my (gpu enabled) linux machine the code execution freezes when calling task.c...

clearml

7 months ago

0 Votes

1 Answers

612 Views

0 Votes 1 Answers 612 Views

Hi! The Code

Hi! The code dataset.get_metadata('metadata_name') produces the console message Cannot find metadata on this task, are you sure it has the correct name? if t...

clearml

9 months ago

0 Votes

1 Answers

719 Views

0 Votes 1 Answers 719 Views

Hi! I Am Currently Testing The Function Of Tags, Using Dataset.Add_Tag(). Why Do Tags Only Show On A Version Level, But Not On The Dataset-Level? (See Images) The Tag “Blaa” Has Been Added Manually In The Web-Ui. Why Do “Kophenhangen”, “Paris” Or “Vis” No

Hi! I am currently testing the function of tags, using dataset.add_tag(). Why do tags only show on a version level, but not on the dataset-level? (see images...

clearml

9 months ago

0 Votes

0 Answers

495 Views

0 Votes 0 Answers 495 Views

Hi Again! When Running A Ultralytics Yolov8 Training (Locally), It Happens Every Second Run, That Only The Metrics For The First Epoch Are Tracked, But No Metrics For Any Further Epochs. What Can I Do, To Ensure Tracking Of All Epochs?

Hi again! When running a ultralytics yolov8 training (locally), it happens every second run, that only the metrics for the first epoch are tracked, but no me...

clearml

6 months ago

0 Votes

2 Answers

836 Views

0 Votes 2 Answers 836 Views

Hi, I Am Training With A Significant Amount Of Images. I Have Created A Clearml Dataset Containing Two Folders: Images And Labels. Until Now I Have Created A Local-Copy (Dataset.Get_Local_Copy()), And Worked With The Data In ‘Data_Set’ Path. I Now Want (A

Hi, I am training with a significant amount of images. I have created a clearml Dataset containing two folders: images and labels. Until now I have created a...

clearml

10 months ago

0 Votes

2 Answers

861 Views

0 Votes 2 Answers 861 Views

Hi, I Am Using

Hi, I am using TaskScheduler to start a pipeline once per hour, that sequentially executes tasks. My current solution is that I have three execution queues, ...

clearml

10 months ago

0 Votes

1 Answers

853 Views

0 Votes 1 Answers 853 Views

Hello! How Will Clearml React, If I Have Combine Two Datasets Into A New Dataset, And Both Contain A File “Ids.Txt”. Will One Be Overwritten, Will Both Files Be Merged, Will There Be Two Renamed Files? Thank You!

Hello! How will clearml react, if I have combine two Datasets into a new Dataset, and both contain a file “IDs.txt”. Will one be overwritten, will both files...

clearml

9 months ago

0 Votes

6 Answers

180 Views

0 Votes 6 Answers 180 Views

Hi, I Have Two Instances Of Clearml-Server That I Would Like To Merge Into One. Is There Any Way To Do That Without Loosing Tracked Experiments, Datasets Or Artefacts? Additionally, Do You If It Is Possible To Backup Clearml-Server

Hi, I have two instances of clearml-server that I would like to merge into one. Is there any way to do that without loosing tracked experiments, datasets or ...

clearml

one month ago

0 Votes

9 Answers

178 Views

0 Votes 9 Answers 178 Views

Hi! I Have Noticed That Clearml-Elastic Container Consumes 32.82Gib Memory. This Seems

Hi! I have noticed that clearml-elastic container consumes 32.82GiB Memory. This seems very high (we have a total of 91GiB available -> elastic uses 1/3). Is...

clearml

one month ago

0 Votes

1 Answers

861 Views

0 Votes 1 Answers 861 Views

Hi 👋 How can I connect clearml to a relational database, and have sql query as a dataset? (e.g. dataset.add_references(query = “select * from images where l...

clearml

one year ago

0 Votes

1 Answers

214 Views

0 Votes 1 Answers 214 Views

Hi, When Using Yolo In A Docker Based Clearml Agent, I Get The Error Below. How Do I Need To Setup Clearml Agent To Have Access To Cv2?

Hi, When using yolo in a Docker based clearml agent, I get the error below. How do I need to setup clearml agent to have access to CV2? Starting Task Executi...

mlops

one month ago

0 Votes

1 Answers

187 Views

0 Votes 1 Answers 187 Views

Hi, I Am Currently Setting Up Clearml-Agents. Here

Hi, I am currently setting up clearml-agents. Here None , I read about the option to cache venvs. Where in the clearml.conf does venvs_cache need to be speci...

clearml

one month ago

0 Votes

1 Answers

427 Views

0 Votes 1 Answers 427 Views

Hi Everyone, I’M Looking To Implement Authentication For My Self-Hosted Clearml Server. Specifically, I Noticed The Option To Enable Web Login Authentication, Which I Assume Only Secures Access To The Clearml Web Interface. However, I’D Like To Know:

Hi everyone, I’m looking to implement authentication for my self-hosted ClearML server. Specifically, I noticed the option to enable Web Login Authentication...

clearml

4 months ago

0 Votes

2 Answers

456 Views

0 Votes 2 Answers 456 Views

Hi, I Am Observing A Strange Behaviour When Loading A Dataset’S Local Copy.

Hi, I am observing a strange behaviour when loading a dataset’s local copy. dataset_path_training = cml_dataset_training.get_local_copy() logger.info(f"Creat...

clearml

7 months ago

0 Votes

3 Answers

687 Views

0 Votes 3 Answers 687 Views

Hi! When Deleting Datasets With The Code: Dataset.Delete(Dataset_Id = Dataset_Id, Delete_Files=False, Delete_External_Files=False, Force=True, Entire_Dataset=True) An Empty Entry Remains In Clearml (See Picture). How Can I Remove These Empty Listings Prog

Hi! When deleting datasets with the code: Dataset.delete(dataset_id = dataset_id, delete_files=False, delete_external_files=False, force=True, entire_dataset...

clearml

9 months ago

0 Votes

8 Answers

235 Views

0 Votes 8 Answers 235 Views

Hello! I Am Setting Up A Clearml-Server With Self-Hosted Minio. Do I Would Like To Keep The Clearml.Conf As Default As Possible (Such That Users Do Not Need To Configure Much And Do Not Need Access To Mino Keys). I Am Trying To Use The Server-Config File

Hello! I am setting up a clearml-server with self-hosted minio. Do I would like to keep the clearml.conf as default as possible (such that users do not need ...

aws

2 months ago

0 Hi! I Have Noticed That Clearml-Elastic Container Consumes 32.82Gib Memory. This Seems

Thank you for getting back!
I have reduced it to a max of 2GB for the container and 1GB for the java heap inside the container. Up to now I haven’t experienced any issues 👍

29 days ago

0 Hi! I Have Noticed That Clearml-Elastic Container Consumes 32.82Gib Memory. This Seems

@<1576381444509405184:profile|ManiacalLizard2> Do you have an observation/experience as to what happens when ES hits the limit?

29 days ago

0 Hi! I Have Noticed That Clearml-Elastic Container Consumes 32.82Gib Memory. This Seems

It seems elastic has allocated a heap of 32GiB, but uses only 4GiB. Where/why have 32GiB been allocated?

one month ago

0 Hi! I Have Noticed That Clearml-Elastic Container Consumes 32.82Gib Memory. This Seems

And how much memory does ElasticSearch realistically need?

29 days ago

0 Hi, I Am Observing A Strange Behaviour When Loading A Dataset’S Local Copy.

Yes, that solved the problem. Thank you!

7 months ago

0 Hello, I Have An Issue With Task.Close(). On A Mac It Works As Expected, But On My (Gpu Enabled) Linux Machine The Code Execution Freezes When Calling Task.Close(). Do You Have Any Idea What The Issue Could Be Or How I Cloud Debug It? The Log Does Not Sho

Hi John,
This happens locally.

6 months ago

0 Hi, I Have Two Instances Of Clearml-Server That I Would Like To Merge Into One. Is There Any Way To Do That Without Loosing Tracked Experiments, Datasets Or Artefacts? Additionally, Do You If It Is Possible To Backup Clearml-Server

Thank you so much for your reply! Regarding merging - we have decided to overwrite one server by the other, so this issue is solved.
What Database is clearml using? How to access them?

one month ago

Thank you! 🙂

one month ago

So the solution would be to custom develop a backup routine that is fetching the data increments from Elastic Search, MongoDB & Redis directly?

one month ago

0 Hi, I Am Training With A Significant Amount Of Images. I Have Created A Clearml Dataset Containing Two Folders: Images And Labels. Until Now I Have Created A Local-Copy (Dataset.Get_Local_Copy()), And Worked With The Data In ‘Data_Set’ Path. I Now Want (A

That sounds interesting. Will this also work in a on-prem hosting environment?

10 months ago

0 Hi, I Am Currently Setting Up Clearml-Agents. Here

Question is resolved. I found a full clearml.conf with agent configuration here: None

one month ago

0 Hi, I Am Using

awesome! works like charm 🙂
Thank you!

10 months ago

0 Hi! When Deleting Datasets With The Code: Dataset.Delete(Dataset_Id = Dataset_Id, Delete_Files=False, Delete_External_Files=False, Force=True, Entire_Dataset=True) An Empty Entry Remains In Clearml (See Picture). How Can I Remove These Empty Listings Prog

Thanks john.
the project is “legacy_data”, “5images” is the dataset name. How would i fetch a project and delete it (+ all it’s contents)?

9 months ago

0 Hello! I Am Setting Up A Clearml-Server With Self-Hosted Minio. Do I Would Like To Keep The Clearml.Conf As Default As Possible (Such That Users Do Not Need To Configure Much And Do Not Need Access To Mino Keys). I Am Trying To Use The Server-Config File

Thank you! That makes sense, and adding default_output_uri solved the issue.

Unfortunately, I now have the next issue. When deleting a Dataset I created for test purposes in the UI, it is not automatically deleted by clearml in minio. Do you know if I have missconfigured clearml in some way?

one month ago

Do you know what is going on? 🙂 Thank you!

one month ago

Can you explain why a user needs to configure the minio connection locally? My understanding was, that the data is up/downloaded to/from clearml-server, and where clearml-server is storing the data is to be configured on the server itself.

one month ago

Thank you for replying 🙂
I need to configure this in every clearml.conf for each data-scientist. Correct?

one month ago