One way that is, every new feature will be save as a new file and I will specify the parent.
I think that would be the best way 🙂
@<1523701260895653888:profile|QuaintJellyfish58> , check cache_executed_step parameter in pipeline steps
Hi AttractiveShrimp45 , hyperparameter optimization is available in open source https://github.com/allegroai/clearml/tree/master/examples/optimization/hyper-parameter-optimization .
It is indeed lacking a GUI and does require some more tinkering to tune it to your needs.
https://clear.ml/docs/latest/docs/guides/optimization/hyper-parameter-optimization/examples_hyperparam_opt are the relevant docs 🙂
Hi @<1534344465790013440:profile|UnsightlyAnt34> , I'm afraid there is no easy way to do it. You would need to edit the links in mongodb/elastic to properly migrate it
I'm curious as to why you weren't redirected to login page
TenseOstrich47 , you can specify a docker image withtask.set_base_docker(docker_image="<DOCKER_IMAGE>")You will of course need to login to ECR on that machine so it will be able to download the docker image.
Hi @<1585441179091079168:profile|ColossalArcticwolf5> , can you provide a log of the run?
Click the little cogwheel on the top right as shown in the screenshot. It will open a menu and one of the options is to add custom metrics 🙂
It's totally possible, I think you need to do research on it. There are probably a few ways to do it too. I see CLEARML_API_ACCESS_KEY & CLEARML_API_SECRET_KEY in the docker compose - None
You should do some more digging around. One option is to see how you can generate a key/secret pair and inject them via your script into mongoDB where the credentials are stored. Another way is to see how the UI ...
Can you add a print out to verify that you selected the correct project?
Did anything change in your configurations? In the previous version there was no such issue? Is the agent version the only change?
But... if the machine is shut down, how do you expect the agent to run?
Hi TenseOstrich47 ,
Yes 🙂
Please take a look here:
https://github.com/allegroai/clearml/blob/master/examples/scheduler/trigger_example.py
https://github.com/allegroai/clearml/blob/master/examples/scheduler/cron_example.py
What do you mean by drop of many GB? Can you please elaborate on what happens exactly?
I know that elastic can sometimes create disk corruptions and requires regular backups..
Hi 🙂
Are you asking if you can share experiments between a self hosted server and http://app.clear.ml ?
UnevenDolphin73 , that's an interesting case. I'll see if I can reproduce it as well. Also can you please clarify step 4 a bit? Also on step 5 - what is "holding" it from spinning down?
It means there is nothing reporting iterations explicitly or any iterations being reported by any framework. This means scalers will show with time from start as x axist instead of iterations
But I believe you can use your user/group if you prefer 🙂
Hi NaughtyHorse47 🙂
I guess it really depends on what you want to do.
Specifically for you, if you want the duration of a task you can use task.get_by_id and look in the response for that info.
Hi FlatOctopus65 , are you trying to run on the same machine or a different one?
BitterLeopard33 , I don't see anything in GitHub. Maybe open an issue for better visibility ? 🙂
Hi @<1714088832913117184:profile|MammothSnake38> , not sure I understand. Can you add a screenshot of how you currently play audio files?
Hi @<1577468638728818688:profile|DelightfulArcticwolf22> , I think this is what you're looking for - CLEARML_AGENT_SKIP_PIP_VENV_INSTALL
CLEARML_AGENT_SKIP_PYTHON_ENV_INSTALL
CLEARML_AGENT_FORCE_SYSTEM_SITE_PACKAGES
None
you can find the different cache folders that clearml uses in ~/clearml.conf
Hi 🙂
Please try specifying the file itself explicitly
If you're running on GCP I think using the autoscaler is a far easier and also cost efficient solution. The autoscaler can spin up and down instances on GCP according to your needs.
There are no role based access controls in the open source version. This feature exists only in the Scale/Enterprise licenses.