ObedientTurkey46

16 Questions, 17 Answers

Active since 30 April 2024

Last activity 5 months ago

Reputation

Badges 1

17 × Eureka!

Questions 16
Answers 17

0 Votes

2 Answers

861 Views

0 Votes 2 Answers 861 Views

Hi, I Am Observing A Strange Behaviour When Loading A Dataset’S Local Copy.

Hi, I am observing a strange behaviour when loading a dataset’s local copy. dataset_path_training = cml_dataset_training.get_local_copy() logger.info(f"Creat...

clearml

one year ago

0 Votes

6 Answers

643 Views

0 Votes 6 Answers 643 Views

Hi, I Have Two Instances Of Clearml-Server That I Would Like To Merge Into One. Is There Any Way To Do That Without Loosing Tracked Experiments, Datasets Or Artefacts? Additionally, Do You If It Is Possible To Backup Clearml-Server

Hi, I have two instances of clearml-server that I would like to merge into one. Is there any way to do that without loosing tracked experiments, datasets or ...

clearml

6 months ago

0 Votes

2 Answers

1K Views

0 Votes 2 Answers 1K Views

Hi, I Am Using

Hi, I am using TaskScheduler to start a pipeline once per hour, that sequentially executes tasks. My current solution is that I have three execution queues, ...

clearml

one year ago

0 Votes

3 Answers

1K Views

0 Votes 3 Answers 1K Views

Hi! When Deleting Datasets With The Code: Dataset.Delete(Dataset_Id = Dataset_Id, Delete_Files=False, Delete_External_Files=False, Force=True, Entire_Dataset=True) An Empty Entry Remains In Clearml (See Picture). How Can I Remove These Empty Listings Prog

Hi! When deleting datasets with the code: Dataset.delete(dataset_id = dataset_id, delete_files=False, delete_external_files=False, force=True, entire_dataset...

clearml

one year ago

0 Votes

1 Answers

887 Views

0 Votes 1 Answers 887 Views

Hi Everyone, I’M Looking To Implement Authentication For My Self-Hosted Clearml Server. Specifically, I Noticed The Option To Enable Web Login Authentication, Which I Assume Only Secures Access To The Clearml Web Interface. However, I’D Like To Know:

Hi everyone, I’m looking to implement authentication for my self-hosted ClearML server. Specifically, I noticed the option to enable Web Login Authentication...

clearml

9 months ago

0 Votes

2 Answers

1K Views

0 Votes 2 Answers 1K Views

Hello, I Have An Issue With Task.Close(). On A Mac It Works As Expected, But On My (Gpu Enabled) Linux Machine The Code Execution Freezes When Calling Task.Close(). Do You Have Any Idea What The Issue Could Be Or How I Cloud Debug It? The Log Does Not Sho

Hello, I have an issue with task.close(). On a Mac it works as expected, but on my (gpu enabled) linux machine the code execution freezes when calling task.c...

clearml

11 months ago

0 Votes

1 Answers

1K Views

0 Votes 1 Answers 1K Views

Hi! I Am Currently Testing The Function Of Tags, Using Dataset.Add_Tag(). Why Do Tags Only Show On A Version Level, But Not On The Dataset-Level? (See Images) The Tag “Blaa” Has Been Added Manually In The Web-Ui. Why Do “Kophenhangen”, “Paris” Or “Vis” No

Hi! I am currently testing the function of tags, using dataset.add_tag(). Why do tags only show on a version level, but not on the dataset-level? (see images...

clearml

one year ago

0 Votes

8 Answers

848 Views

0 Votes 8 Answers 848 Views

Hello! I Am Setting Up A Clearml-Server With Self-Hosted Minio. Do I Would Like To Keep The Clearml.Conf As Default As Possible (Such That Users Do Not Need To Configure Much And Do Not Need Access To Mino Keys). I Am Trying To Use The Server-Config File

Hello! I am setting up a clearml-server with self-hosted minio. Do I would like to keep the clearml.conf as default as possible (such that users do not need ...

aws

6 months ago

0 Votes

1 Answers

1K Views

0 Votes 1 Answers 1K Views

Hi 👋 How can I connect clearml to a relational database, and have sql query as a dataset? (e.g. dataset.add_references(query = “select * from images where l...

clearml

one year ago

0 Votes

1 Answers

1K Views

0 Votes 1 Answers 1K Views

Hello! How Will Clearml React, If I Have Combine Two Datasets Into A New Dataset, And Both Contain A File “Ids.Txt”. Will One Be Overwritten, Will Both Files Be Merged, Will There Be Two Renamed Files? Thank You!

Hello! How will clearml react, if I have combine two Datasets into a new Dataset, and both contain a file “IDs.txt”. Will one be overwritten, will both files...

clearml

one year ago

0 Votes

9 Answers

615 Views

0 Votes 9 Answers 615 Views

Hi! I Have Noticed That Clearml-Elastic Container Consumes 32.82Gib Memory. This Seems

Hi! I have noticed that clearml-elastic container consumes 32.82GiB Memory. This seems very high (we have a total of 91GiB available -> elastic uses 1/3). Is...

clearml

6 months ago

0 Votes

0 Answers

871 Views

0 Votes 0 Answers 871 Views

Hi Again! When Running A Ultralytics Yolov8 Training (Locally), It Happens Every Second Run, That Only The Metrics For The First Epoch Are Tracked, But No Metrics For Any Further Epochs. What Can I Do, To Ensure Tracking Of All Epochs?

Hi again! When running a ultralytics yolov8 training (locally), it happens every second run, that only the metrics for the first epoch are tracked, but no me...

clearml

11 months ago

0 Votes

1 Answers

543 Views

0 Votes 1 Answers 543 Views

Hi, I Am Currently Setting Up Clearml-Agents. Here

Hi, I am currently setting up clearml-agents. Here None , I read about the option to cache venvs. Where in the clearml.conf does venvs_cache need to be speci...

clearml

6 months ago

0 Votes

1 Answers

911 Views

0 Votes 1 Answers 911 Views

Hi! The Code

Hi! The code dataset.get_metadata('metadata_name') produces the console message Cannot find metadata on this task, are you sure it has the correct name? if t...

clearml

one year ago

0 Votes

1 Answers

1K Views

0 Votes 1 Answers 1K Views

Hi, When Using Yolo In A Docker Based Clearml Agent, I Get The Error Below. How Do I Need To Setup Clearml Agent To Have Access To Cv2?

Hi, When using yolo in a Docker based clearml agent, I get the error below. How do I need to setup clearml agent to have access to CV2? Starting Task Executi...

mlops

6 months ago

0 Votes

2 Answers

1K Views

0 Votes 2 Answers 1K Views

Hi, I Am Training With A Significant Amount Of Images. I Have Created A Clearml Dataset Containing Two Folders: Images And Labels. Until Now I Have Created A Local-Copy (Dataset.Get_Local_Copy()), And Worked With The Data In ‘Data_Set’ Path. I Now Want (A

Hi, I am training with a significant amount of images. I have created a clearml Dataset containing two folders: images and labels. Until now I have created a...

clearml

one year ago

0 Hi, I Am Currently Setting Up Clearml-Agents. Here

Question is resolved. I found a full clearml.conf with agent configuration here: None

6 months ago

0 Hi! I Have Noticed That Clearml-Elastic Container Consumes 32.82Gib Memory. This Seems

Thank you for getting back!
I have reduced it to a max of 2GB for the container and 1GB for the java heap inside the container. Up to now I haven’t experienced any issues 👍

5 months ago

0 Hello! I Am Setting Up A Clearml-Server With Self-Hosted Minio. Do I Would Like To Keep The Clearml.Conf As Default As Possible (Such That Users Do Not Need To Configure Much And Do Not Need Access To Mino Keys). I Am Trying To Use The Server-Config File

Thank you for replying 🙂
I need to configure this in every clearml.conf for each data-scientist. Correct?

6 months ago

0 Hi! I Have Noticed That Clearml-Elastic Container Consumes 32.82Gib Memory. This Seems

@<1576381444509405184:profile|ManiacalLizard2> Do you have an observation/experience as to what happens when ES hits the limit?

5 months ago

0 Hello, I Have An Issue With Task.Close(). On A Mac It Works As Expected, But On My (Gpu Enabled) Linux Machine The Code Execution Freezes When Calling Task.Close(). Do You Have Any Idea What The Issue Could Be Or How I Cloud Debug It? The Log Does Not Sho

Hi John,
This happens locally.

11 months ago

0 Hi! I Have Noticed That Clearml-Elastic Container Consumes 32.82Gib Memory. This Seems

And how much memory does ElasticSearch realistically need?

5 months ago

0 Hi! I Have Noticed That Clearml-Elastic Container Consumes 32.82Gib Memory. This Seems

It seems elastic has allocated a heap of 32GiB, but uses only 4GiB. Where/why have 32GiB been allocated?

6 months ago

Thank you! That makes sense, and adding default_output_uri solved the issue.

Unfortunately, I now have the next issue. When deleting a Dataset I created for test purposes in the UI, it is not automatically deleted by clearml in minio. Do you know if I have missconfigured clearml in some way?

6 months ago

0 Hi, I Have Two Instances Of Clearml-Server That I Would Like To Merge Into One. Is There Any Way To Do That Without Loosing Tracked Experiments, Datasets Or Artefacts? Additionally, Do You If It Is Possible To Backup Clearml-Server

So the solution would be to custom develop a backup routine that is fetching the data increments from Elastic Search, MongoDB & Redis directly?

6 months ago

Thank you! 🙂

6 months ago

0 Hi, I Am Training With A Significant Amount Of Images. I Have Created A Clearml Dataset Containing Two Folders: Images And Labels. Until Now I Have Created A Local-Copy (Dataset.Get_Local_Copy()), And Worked With The Data In ‘Data_Set’ Path. I Now Want (A

That sounds interesting. Will this also work in a on-prem hosting environment?

one year ago

Can you explain why a user needs to configure the minio connection locally? My understanding was, that the data is up/downloaded to/from clearml-server, and where clearml-server is storing the data is to be configured on the server itself.

6 months ago

0 Hi! When Deleting Datasets With The Code: Dataset.Delete(Dataset_Id = Dataset_Id, Delete_Files=False, Delete_External_Files=False, Force=True, Entire_Dataset=True) An Empty Entry Remains In Clearml (See Picture). How Can I Remove These Empty Listings Prog

Thanks john.
the project is “legacy_data”, “5images” is the dataset name. How would i fetch a project and delete it (+ all it’s contents)?

one year ago

Do you know what is going on? 🙂 Thank you!

6 months ago

0 Hi, I Am Observing A Strange Behaviour When Loading A Dataset’S Local Copy.

Yes, that solved the problem. Thank you!

one year ago

0 Hi, I Am Using

awesome! works like charm 🙂
Thank you!

one year ago

Thank you so much for your reply! Regarding merging - we have decided to overwrite one server by the other, so this issue is solved.
What Database is clearml using? How to access them?

6 months ago