Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
ExcitedFish86
Moderator
8 Questions, 55 Answers
  Active since 10 January 2023
  Last activity one year ago

Reputation

0

Badges 1

43 × Eureka!
0 Votes
9 Answers
673 Views
0 Votes 9 Answers 673 Views
Hi all, I'm trying to upgrade clearml-server but I keep getting permission errors from the elastic search container: clearml-elastic | ElasticsearchException...
3 years ago
0 Votes
2 Answers
634 Views
0 Votes 2 Answers 634 Views
Hi guys, just wanted to let you know that many links in the ClearML github page are broken (i.e., https://github.com/allegroai/clearml/blob/master )
3 years ago
0 Votes
13 Answers
739 Views
0 Votes 13 Answers 739 Views
Hi folks! I'm using SummaryWriter from PyTorch's tensorboard utils to log pr_curve , and I get the attached curve. Looks like the X axis is reversed, and I c...
3 years ago
0 Votes
30 Answers
606 Views
0 Votes 30 Answers 606 Views
Hi guys! Is there a way to tell an agent to run a task in an existing venv (without creating a new one)?
2 years ago
0 Votes
3 Answers
624 Views
0 Votes 3 Answers 624 Views
Hi all, I see there is an option for running a bash script / commands inside a container started by an agent. Is it possible to have this set differently per...
2 years ago
0 Votes
18 Answers
667 Views
0 Votes 18 Answers 667 Views
2 years ago
0 Votes
3 Answers
734 Views
0 Votes 3 Answers 734 Views
Hi all, Is there a way to filter a experiments in a hyperparameter sweep based on a given range of a parameter/metric in the UI (similar to wandb )? Also, is...
2 years ago
0 Votes
11 Answers
702 Views
0 Votes 11 Answers 702 Views
Hi all, I have a question regarding multi-node training using the clearml-agent. What is the recommended setup in this case? Say I have 3 nodes with 3 agents...
3 years ago
0 Hi Guys! Is There A Way To Tell An Agent To Run A Task In An Existing Venv (Without Creating A New One)?

another question - when running a non-dockerized agent and setting CLEARML_AGENT_SKIP_PIP_VENV_INSTALL , I still see things being installed when the experiment starts. Why does that happen?

2 years ago
0 Hi Guys! Is There A Way To Tell An Agent To Run A Task In An Existing Venv (Without Creating A New One)?

You mean running everything on a single machine (manually)?

Yes, but not limited to this.
I want to be able to install the venv in multiple servers and start the "simple" agents in each one on them. You can think of it as some kind of one-off agent for a specific (distributed) hyperparameter search task

2 years ago
0 Hi Guys! Is There A Way To Tell An Agent To Run A Task In An Existing Venv (Without Creating A New One)?

AgitatedDove14 , I'm running an agent inside a docker (using the image on dockerhub) and mounted the docker socket to the host so the agent can start sibling containers. How do I set the config for this agent? Some options can be set through env vars but not all of them 😞

2 years ago
0 Hi Guys! Is There A Way To Tell An Agent To Run A Task In An Existing Venv (Without Creating A New One)?

Of course conda needs to be installed, it is using a pre-existing condaΒ env, no?! what am I missing

its not a conda env, just a regular venv (poetry in this specific case)

And the assumption is the code is also there ?

yes. The user is responsible for the entire setup. the agent just executes python <path to script> <current hpo args>

2 years ago
0 Hi Guys! Is There A Way To Tell An Agent To Run A Task In An Existing Venv (Without Creating A New One)?

I'm trying to achieve a workflow similar to the one in wandb for parameter sweep where there are no venvs involved other than the one created by the user πŸ˜…

2 years ago
0 Hi Guys! Is There A Way To Tell An Agent To Run A Task In An Existing Venv (Without Creating A New One)?

It's a very convenient way of doing a parameter sweep on with minimal setup effort

2 years ago
0 Hi Guys! Is There A Way To Tell An Agent To Run A Task In An Existing Venv (Without Creating A New One)?

lol great hack. I'll check it out.
Although I'd be really happy if there was a solution in which I can just spawn an ad-hoc worker πŸ™‚

2 years ago
2 years ago
0 Hi Guys! Is There A Way To Tell An Agent To Run A Task In An Existing Venv (Without Creating A New One)?

AgitatedDove14 Just to see that I understood correctly - in an HPO task, all subtasks (a specific parameter combination) are created and pushed to the relevant queue at the moment the main (HPO) task is created?

2 years ago
0 Hi Guys! Is There A Way To Tell An Agent To Run A Task In An Existing Venv (Without Creating A New One)?

I just don't fully understand the internals of an HPO process. If I create an Optimizer task with a simple grid search, how do different tasks know which arguments were already dispatched if the arguments are generated at runtime?

2 years ago
0 Hi Guys! Is There A Way To Tell An Agent To Run A Task In An Existing Venv (Without Creating A New One)?

that was my next question πŸ™‚
How does this design work with a stateful search algorithm?

2 years ago
2 years ago
0 Hi All, I Have A Question Regarding Multi-Node Training Using The Clearml-Agent. What Is The Recommended Setup In This Case? Say I Have 3 Nodes With 3 Agents Running On Them. How Do I Make Sure They All Run The Same Job?

I see what you mean. So in a simple "all-or-nothing" solution I have to choose between potentially starving either the single node tasks (high priority + wait) or multi-node tasks (wait for a time when there are enough available agents and only then allocate the resource).

I actually meant NCCL. nvcc is the CUDA compiler πŸ˜…
NCCL communication can be both inter- and intra- node

3 years ago
0 Hi Guys! Is There A Way To Tell An Agent To Run A Task In An Existing Venv (Without Creating A New One)?

just seems a bit cleaner and more DevOps/k8s friendly to work with the container version of the agent πŸ™‚

2 years ago
0 Hi, In One Of My Agents With Cuda Version: 11.1 (From Nvidia-Smi), Clearml Agent 0.17.1 Detects Version 100 (I Can See From Experiments Logs:

cudnn isn't cuda, it's a separate library.
are you running on docker on bare metal? you should have cuda installed at /usr/local/cuda-<>

3 years ago
0 Hi All, I'M Trying To Upgrade

The legacy version worked just before I mv ed the folder but now (after reverting to the old name) that doesn't work also 😒

3 years ago
Show more results compactanswers