Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
RotundHedgehog76
Moderator
17 Questions, 62 Answers
  Active since 10 January 2023
  Last activity 11 months ago

Reputation

0

Badges 1

53 × Eureka!
0 Votes
7 Answers
656 Views
0 Votes 7 Answers 656 Views
Hey, we've experienced some issues with Clearml Trigger Schedulers we were playing with in the last few days. This is what happened: We have a trigger listen...
one year ago
0 Votes
2 Answers
624 Views
0 Votes 2 Answers 624 Views
Hello, We use clearml agents in daemon mode. This writes the logs to /tmp. however when the agent dies, it deletes the logs as well and we dont know why it d...
11 months ago
0 Votes
1 Answers
609 Views
0 Votes 1 Answers 609 Views
Hello, we have started to recieve these erros in the console: > ClearML Task: created new task id=1ad0038289c54c9d92cb46668c2ffd96 > 2023-03-09 12:18:16,783 ...
one year ago
0 Votes
22 Answers
645 Views
0 Votes 22 Answers 645 Views
Hello all 😊 Has anyone attempted to use JupyterHub (not JupyterLab!) server with ClearML? We would like to run jupyterhub and spawn small jupyterlab instanc...
2 years ago
0 Votes
7 Answers
721 Views
0 Votes 7 Answers 721 Views
Hey, I tried to use clearml-data with PascalVOC2007 and something weird happened: $ wget -q $ tar xf VOCtrainval_06-Nov-2007.tar $ cd VOCdevkit/VOC2007 $ ls ...
2 years ago
0 Votes
4 Answers
628 Views
0 Votes 4 Answers 628 Views
What what I can see, there is no task status "aborted" , only "stopped" . Is that correct?
one year ago
0 Votes
3 Answers
711 Views
0 Votes 3 Answers 711 Views
Hello, Would you be so kind to update the allegroai/clearml-agent-services to use a newer ubuntu than 22.04? We just had to rebuild a custom image because it...
one year ago
0 Votes
6 Answers
667 Views
0 Votes 6 Answers 667 Views
Hi, I tried to make a clearml Dataset using the clearml-data and MNIST but I always get a 413 Request Entity Too Large We have our own ClearML deployment on ...
2 years ago
0 Votes
7 Answers
803 Views
0 Votes 7 Answers 803 Views
Hello, What exactly is the difference between the pip mode and the docker mode of the clearml-agent ? In the typical workflow shown in https://clear.ml/docs/...
2 years ago
0 Votes
26 Answers
674 Views
0 Votes 26 Answers 674 Views
one year ago
0 Votes
0 Answers
714 Views
0 Votes 0 Answers 714 Views
There seems to be a quirk in the behaviour of clearml-session when running clearml-session all the arguments get stored as future defaults in ~/.clearml_sess...
2 years ago
0 Votes
3 Answers
737 Views
0 Votes 3 Answers 737 Views
You seem to have an error in documentation or in the script help. https://clear.ml/docs/latest/docs/apps/clearml_session states that using --skip-docker-netw...
2 years ago
0 Votes
4 Answers
672 Views
0 Votes 4 Answers 672 Views
Hello, Is there a way to completely disable the apt update at the start of a training?
one year ago
0 Votes
2 Answers
678 Views
0 Votes 2 Answers 678 Views
Hello, we have issues with clearml-agent when using standalone mode. It seems when in standalone mode, the agent wont ever try to clone the repo 😓 it always...
one year ago
0 Votes
4 Answers
668 Views
0 Votes 4 Answers 668 Views
Hello 😊 I noticed that clearml has a sort of a " language " of referencing the Task's arguments, such as Args/batch or Args/task_id . This is used in Optuna...
2 years ago
0 Votes
7 Answers
728 Views
0 Votes 7 Answers 728 Views
Hey, perhaps a weird question but: Do you have the clearml logo in higher res? Haha im trying to build a slack agent with the green "C" logo but all the imag...
2 years ago
0 Votes
3 Answers
666 Views
0 Votes 3 Answers 666 Views
Hello, I believe you have a bug in https://github.com/allegroai/clearml-agent/blob/master/docker/services/entrypoint.sh#L20 - The shebang says /bin/sh - But ...
one year ago
0 Hi, I'M Having An Issue Getting A Clearml-Agent Machine With A Rtx 3090 To Train Remotely Because It Can'T Install Pytorch. My Local Development Environment (Also With A 3090) Has Torch == 1.12.1+Cu113 Which I Installed With The Command:

I think I know why though.

Clearml tries to install a package using pip, and pip cannot find the installation because it's not on pypi but it's listed in the pytorch download page

one year ago
0 Hi, I'M Having An Issue Getting A Clearml-Agent Machine With A Rtx 3090 To Train Remotely Because It Can'T Install Pytorch. My Local Development Environment (Also With A 3090) Has Torch == 1.12.1+Cu113 Which I Installed With The Command:

It's not because of the remote machine, it's the requirements 😅 as i said, the package is not on pypi. Try adding this at the top of your requirements.txt:

-f torch==1.12.1+cu113 ...other deps...

one year ago
0 Hello

trigger.add_task_trigger(name='export', schedule_task_id=SCHEDULE_ID, task_overrides={...})I would like to override the commit hash of the SCHEDULE_ID with task_overrides

2 years ago
0 Hello All

I don't think I expressed myself well 😅

My problem is I don't know how to run a jupyterhub Task. Basically what I want is a clearml-session but with a docker container running JupyterHub instead of JupyterLab.

Do I write a Python script? If yes, how can I approach writing it? If not, what are the altenatives?

2 years ago
0 Hello All

Thanks, I'll try it out first thing Monday and I'll let you know 😃

2 years ago
0 Hello All

That's only a part of a solution.
You'd also have to allow specifying jupyterhub_config.py , mounting it inside a container at a right place, mounting the docker socket in a secure manner to allow spawning user containers, connecting them to the correct network ( --host won't work), persisting the user database and user data...

2 years ago
0 Hello

By language, I meant the syntax. What is Args and what is batch in Args/batch and what other values exist 😀

By commit hash, I mean the hash od the commit a task was run from. I wish to refer to that commit hash in another task (started with a triggerscheduler) in code

2 years ago
0 Hello All

Mostly the configurabilty of clearml-session and how it was designed. Jupyterhub spawns a process at :8000 which we had to port foreward by hand, but spawning new docker containers using jupyterhub.Dockerspawner and connecting them to the correct network (the hub should talk to them without --network host ) seem too difficult or even impossible.

Oh, and there was no JupyterHub stdout in the console output on clearml server, it shows the jupyterlab's output by default

2 years ago
0 Hi Everyone! Can I Somehow Configure

We have deployed clearml-agents as systemd services. This allows you to tell systemd to restart the agent whenever it crashes, and it automatically starts them up when the server boots!

one year ago
0 Hello

to answer myself, the first part, task.get_parameters() retrieves a list of all the arguments which can be set. The syntax seems to be Args/{argparse destination}

However, this does not return the commit hash :((

2 years ago
0 Hello, We Have Started To Recieve These Erros In The Console:

SOLVED: It was an expired service account key in a clearml config

one year ago
0 Hello, We Have Issues With

agent version latest
clearml version latest

one year ago
0 Hello All

You are not missing nothing, it is what we would like to have, to allow multiple people have their own notebook servers. We have multiple people doing different experiments, and JupyterHub would be their "playground" environment

2 years ago
0 Hello All

CostlyOstrich36 jupyterhub is a multi-user server, which allows many users to login and spawn their own jupyterlab instances (with custom dependencies, data etc) for runing notebooks

AgitatedDove14 no errors, because I don't know how to start 😅 I am just exploring if anyone did this before I get my hands dirty

2 years ago
0 Hey, We'Ve Experienced Some Issues With Clearml Trigger Schedulers We Were Playing With In The Last Few Days. This Is What Happened:

Unfortunately, no, I can't paste the whole code. In a nutshell, the trigger spawns a new GCE instance with a clearml-agent running to schedule the experiments in Cloud.
This is an excerpt:

def gcp_start_trigger(task_id: str):
    curr_task = Task.get_task(task_id)
    #curr_task.reset(force=True)
    config = extract_config(curr_task)
    machine_type = config.get('machine-type')
    queue_name = f"gcp/{machine_type}"
    ensure_queue(queue_name)  # creates a new queue if it doesn't...
one year ago
Show more results compactanswers