Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
RobustFox47
Moderator
22 Questions, 94 Answers
  Active since 10 January 2023
  Last activity 2 years ago

Reputation

0

Badges 1

89 × Eureka!
0 Votes
7 Answers
1K Views
0 Votes 7 Answers 1K Views
3 years ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
any plans for log space for hyperparameter support (log argument)? this is supported config space https://github.com/automl/ConfigSpace/blob/772665a86bca0d5b...
3 years ago
0 Votes
24 Answers
1K Views
0 Votes 24 Answers 1K Views
How can I call the runtime of a experiment running on the clearml agent?
2 years ago
0 Votes
11 Answers
1K Views
0 Votes 11 Answers 1K Views
3 years ago
0 Votes
8 Answers
1K Views
0 Votes 8 Answers 1K Views
Hi guys 🙂 hope you're having a good weekend. When I try and compare experiments on the Web UI the display just freezes. It would be great if you could give ...
3 years ago
0 Votes
7 Answers
1K Views
0 Votes 7 Answers 1K Views
Can I prevent torch.save()from automatically uploading the model and use task.update_output_model(model_path=best_model_path)at the end to upload the best mo...
3 years ago
0 Votes
7 Answers
1K Views
0 Votes 7 Answers 1K Views
Hi guys, I want automate the clearml-init in a docker container. Ideally I would do this by having the clearml.conf file in the container and then read in en...
aws
3 years ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
Are GP3 volumes automatically deleted when the instance is spun down using the clearml aws autoscaler?
aws
3 years ago
0 Votes
6 Answers
1K Views
0 Votes 6 Answers 1K Views
Hey guys, hope you're having a good week 🙂 How can i get the status of a task in the queue? status = Task.enqueue( cloned, queue_name='default', ) #now get ...
3 years ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
Happy Friday Everyone 🙂 how can I apply uncommitted changes from a task manually to debug locally?
3 years ago
0 Votes
0 Answers
1K Views
0 Votes 0 Answers 1K Views
Loving the new website & design 😍 😍 😍 😍 😍 congratulations 🚀
3 years ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
Another thing that would be useful is to enable git clone via github personal access token as ssh config can be annoying when working in containerised env fo...
3 years ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
Hi guys, I'm loving ClearML so far now we can quickly train and deploy customer models 🚀 however, when prototyping models in a .py file it's quite annoying ...
3 years ago
0 Votes
2 Answers
1K Views
0 Votes 2 Answers 1K Views
Hey, how can I download report_table objects back into python as a dataframe? I'm sure I've done this before but have no idea how I did it.
2 years ago
0 Votes
2 Answers
1K Views
0 Votes 2 Answers 1K Views
Hey, Are you thinking of getting ISO27001 or SOC2 at some point / do you already have it?
2 years ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
Hey how can I trigger multiple "Hyperparameter Optimization" in a for loop to run on a service? I have around 30 models I'd like to run a BO on in a service ...
2 years ago
0 Votes
6 Answers
1K Views
0 Votes 6 Answers 1K Views
I've just tried uploading a few datasets and they are not being detected on the UI.
2 years ago
0 Votes
18 Answers
1K Views
0 Votes 18 Answers 1K Views
Hey, Just trying out clearml-serving and getting the following error the provided PTX was compiled with an unsupported toolchain in the clearml-serving-trito...
2 years ago
0 Votes
22 Answers
2K Views
0 Votes 22 Answers 2K Views
Hi guys for the AWS auto-scaler I need to access aws ssm or create .env file locally when using the init script. Has anyone done this?
aws
3 years ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
3 years ago
0 Votes
16 Answers
2K Views
0 Votes 16 Answers 2K Views
Hi guys, I think there's something wrong on https://app.clear.ml . The font etc is changing to caps and . 's are being introduced into the path of project fo...
2 years ago
0 Votes
12 Answers
1K Views
0 Votes 12 Answers 1K Views
Hi everyone, I think it would be nice if startup_bash_script that takes in bash_script for the AWS autoscalers can be completely overwritten to input custom ...
3 years ago
0 Hey, Just Trying Out Clearml-Serving And Getting The Following Error

$ curl -X 'POST' ' ' -H 'accept: application/json' -H 'Content-Type: application/json' -d '{ "url": " " }' {"digit":5}

2 years ago
0 Hey, Just Trying Out Clearml-Serving And Getting The Following Error

Okay just for clarity...

Originally, my Nvidia drivers were running on an incompatible version for the triton server
This container was built for NVIDIA Driver Release 510.39 or later, but version 470.103.01 was detected and compatibility mode is UNAVAILABLE.
To fix this issue I updated the drivers on my base OS i.e.
sudo apt install nvidia-driver-510 -y sudo reboot
Then it worked. The docker-compose logs from clearml-serving-triton container did not make this clear (i.e. by r...

2 years ago
0 Hi Guys, I Think There'S Something Wrong On

` python upload_data_to_clearml_copy.py
Generating SHA2 hash for 1 files
100%|████████████████████████████████████████████████████████████████████| 1/1 [00:00<00:00, 733.91it/s]
Hash generation completed
0%| | 0/1 [00:00<?, ?it/s]
Compressing local files, chunk 1 [remaining 1 files]
100%|████████████████████████████████████████████████████████████████████| 1/1 [00:00<00:00, 538.77it/s]
File compression completed: t...

2 years ago
0 Hi Guys, I Think There'S Something Wrong On

Same with new version
(deepmirror) ryan@ryan:~/GitHub/deepmirror/ml-toolbox$ python -c "import clearml; print(clearml.__version__)" 1.6.1
Generating SHA2 hash for 1 files 100%|███████████████████████████████████████████████████████████████████| 1/1 [00:00<00:00, 2548.18it/s] Hash generation completed Uploading dataset changes (1 files compressed to 130 B) to BUCKET File compression and upload completed: total size 130 B, 1 chunked stored (average size 130 B)

2 years ago
0 How Can I Call The

` client.queues.get_default()

Traceback (most recent call last):
File "<string>", line 1, in <module>
File "/opt/conda/lib/python3.9/site-packages/clearml/backend_api/session/client/client.py", line 378, in new_func
return Response(self.session.send(request_cls(*args, **kwargs)))
File "/opt/conda/lib/python3.9/site-packages/clearml/backend_api/session/client/client.py", line 122, in send
raise APIError(result)
clearml.backend_api.session.client.client.APIError: APIError: code 4...

2 years ago
0 Hi Everyone, I Think It Would Be Nice If

yep using the community version

3 years ago
0 Hi Guys For The Aws Auto-Scaler I Need To Access Aws Ssm Or Create .Env File Locally When Using The Init Script. Has Anyone Done This?

Thanks JitteryCoyote63 , I'll double check the permissions of key/secrets and if no luck I'll check with the team

3 years ago
0 Hi Everyone, We Train Our Ml Models Using The Aws Autoscaler On G4Dn Instances. We Currently Have A 24 Vcpu Limit For G Type Instances In Eu-West. I'M Trying To Get This Limit At Least Doubled Or Tripled. My Request Keeps Stagnating With The Service Team

This was the response from AWS:

"Thank you for for sharing the requested details with us. As we discussed, I'd like to share that our internal service team is currently unable to support any G type vCPU increase request for limit increase. 

The issue is we are currently facing capacity scarcity to accommodate P and G instances. Our engineers are working towards fixing this issue. However, until then, we are unable to expand the capacity and process limit increase."

3 years ago
0 Has Anybody Used

` # dataset_class.py
from PIL import Image
from torch.utils.data import Dataset as BaseDataset

class Dataset(BaseDataset):

def __init__(
    self,
    images_fps,
    masks_fps,
    augmentation=None,
):
    self.augmentation = augmentation
    self.images_fps = images_fps
    self.masks_fps = masks_fps
    self.ids = len(images_fps)


def __getitem__(self, i):

    # read data
    img = Image.open(self.images_fps[i])
    mask = Image...
3 years ago
0 Hi Guys

When I get home I'll get the stats to you 👍 thank you :)

3 years ago
0 Hi Guys For The Aws Auto-Scaler I Need To Access Aws Ssm Or Create .Env File Locally When Using The Init Script. Has Anyone Done This?

echo -e $(aws ssm --region=eu-west-2 get-parameter --name 'my-param' --with-decryption --query "Parameter.Value") | tr -d '"' > .env set -a source .env set +a git clone https://${PAT}@github.com/myrepo/toolbox.git mv .env toolbox/ cd toolbox/ docker-compose up -d --build docker exec -it $(docker-compose ps -q) clearml-agent daemon --detached --gpus 0 --queue default

3 years ago
0 Hi Guys For The Aws Auto-Scaler I Need To Access Aws Ssm Or Create .Env File Locally When Using The Init Script. Has Anyone Done This?

For ClearML UI
2021-10-19 14:24:13 ClearML results page: Spinning new instance type=aws4gpu ClearML Monitor: GPU monitoring failed getting GPU reading, switching off GPU monitoring 2021-10-19 14:24:18 Error: Can not start new instance, Could not connect to the endpoint URL: " " Spinning new instance type=aws4gpu 2021-10-19 14:24:28 Error: Can not start new instance, Could not connect to the endpoint URL: " ` "
Spinning new instance type=aws4gpu
2021-10-19 14:24:38
Error: Can no...

3 years ago
0 I'Ve Just Tried Uploading A Few Datasets And They Are Not Being Detected On The Ui.

Can you try to go into 'Settings' -> 'Configuration' and verify that you have 'Show Hidden Projects' enabled

2 years ago
0 Hi Guys For The Aws Auto-Scaler I Need To Access Aws Ssm Or Create .Env File Locally When Using The Init Script. Has Anyone Done This?

`
2021-10-19 14:19:07
Spinning new instance type=aws4gpu
Error: Can not start new instance, An error occurred (InvalidParameterValue) when calling the RunInstances operation: Invalid availability zone: [eu-west-2]
Spinning new instance type=aws4gpu
ClearML Monitor: GPU monitoring failed getting GPU reading, switching off GPU monitoring
Error: Can not start new instance, An error occurred (InvalidParameterValue) when calling the RunInstances operation: Invalid availability zone: [eu-west-2]
S...

3 years ago
0 Hey, Just Trying Out Clearml-Serving And Getting The Following Error

I'll add a more detailed response once it's working

2 years ago
0 Hi Everyone, I Think It Would Be Nice If

Yes on the apps page is the possible to tigger programatically?

remote execution is working now. Internal worker nodes had not spun up the agent correctly 😛

3 years ago
0 Hi Guys, I Think There'S Something Wrong On

Yes correct . In fact we cannot see any old datasets

2 years ago
0 How Do You Save Models And Store The Classes As Well? When We Save The Model Using Pytorch We Just Save The State Dict And Not The Custom Classes For Different Models. I Was Thinking Of Just Pickling The Model But If Anyone Has A Better Suggestion That Wo

I can run clearml.OutputModel(task, framework='pytorch') to get the model from a previous task. but how can I get the pytorch model ( torch.nn.Module ) from the output model object

2 years ago
0 Hey Guys, Hope You'Re Having A Good Week

so I guess if the status has changed from running to completed

3 years ago
0 Can I Prevent

thanks

3 years ago
0 Hey Guys, Hope You'Re Having A Good Week

if it's completed or not

3 years ago
0 How Can I Call The

<queues.GetQueueMetricsResponse: { "queues": [] }>

2 years ago
0 Hi Everyone, I Think It Would Be Nice If

In short we clone the repo, build the docker container, and run agent in the container. The reason we do it this, rather than provide a docker image to the clearml-agent is two fold:

We actively develop our custom networks and architectures within a containerised env to make it easy for engineers to have a quick dev cycle for new models. (same repo is cloned and we build the docker container to work inside) We use the same repo to serve models on our backend (in a slightly different contain...

3 years ago
0 Happy Friday Everyone

great thank you

3 years ago
0 Hi Guys, I Think There'S Something Wrong On

`
import os
import glob
from clearml import Dataset

DATASET_NAME = "Bug"
DATASET_PROJECT = "ProjectFolder"
TARGET_FOLDER = "clearml_bug"
S3_BUCKET = os.getenv('S3_BUCKET')

if not os.path.exists(TARGET_FOLDER):
os.makedirs(TARGET_FOLDER)

with open(f'{TARGET_FOLDER}/data.txt', 'w') as f:
f.writelines('Hello, ClearML')

target_files = glob.glob(TARGET_FOLDER + "/**/*", recursive=True)

# upload dataset

dataset = Dataset.create(dataset_name=DATASET_NAME, dataset_project=DATASET_PR...

2 years ago
0 Hey Guys, Hope You'Re Having A Good Week

I've got it... i just remembered I can call
task_idfrom the cloned tasked and check the status of that 🙂

3 years ago
0 Hi Guys For The Aws Auto-Scaler I Need To Access Aws Ssm Or Create .Env File Locally When Using The Init Script. Has Anyone Done This?

I was having an issue with availability zone. I was using 'eu-west-2' instead of 'eu-west-2c'

3 years ago
0 Are Gp3 Volumes Automatically Deleted When The Instance Is Spun Down Using The Clearml Aws Autoscaler?

Okay, I'm going to look into this further. We had around 70 volumes that were not deleted but could have been due to something else.

3 years ago
Show more results compactanswers