Reputation
Badges 1
131 × Eureka!task.get_logger()?get_logger
not use
-
specify container from UI
-
libraries in the ubuntu repository have not yet reached their pip / pypi repository
AgitatedDove14 yes, that's right, he's changed
we run in containers without venv, in the main section, and then delete it or use it for similar experiments Sounds like something very similar, I'll try to use it, thanks a lot! Can this be configured in the UI by simply adding a docker image to the launch options?
@<1523701205467926528:profile|AgitatedDove14>
Can you please tell me how to return the folder where the script should run?
Traceback (most recent call last):
File "/root/.clearml/venvs-builds/3.7/code/train.py", line 12, in <module>
from src.utils.profiler.time_profiler import TimeProfiler
ModuleNotFoundError: No module named 'src'
/root/.clearml/venvs-builds/3.7/code/ -> /src/project
@<1523701070390366208:profile|CostlyOstrich36>
I replaced the open ports with ??9?
so that there would be no conflicts. If you write them down in a new form, then everything is ok
AgitatedDove14
cool
in theory, a calm launch is possible at 1.17.1-2?
and dell tasks, and all ok:
` #task = Task.init(
project_name=f"RL_experiments/{cfg.train.env_train.target.split('.')[-1]}/{'/'.join(cfg.train.trainmodule.target.split('.')[-2:])}",
task_name="demo",
reuse_last_task_id=False)
#task.connect(dict(OmegaConf.to_container(cfg, resolve=True)))
logger = get_logger("train_ql", log_level=cfg.base.log_level)
logger.info(f"cfg:\n{OmegaConf.to_yaml(cfg)}")
tmp_values = train_dqn_task(cfg.train, cfg.base)
...
i run:
` task = Task.init(
project_name=f"RL_experiments/{cfg.train.env_train.target.split('.')[-1]}/{'/'.join(cfg.train.trainmodule.target.split('.')[-2:])}",
task_name="demo",
reuse_last_task_id=False)
task.connect(dict(OmegaConf.to_container(cfg, resolve=True)))
logger = get_logger("train_ql", log_level=cfg.base.log_level)
logger.info(f"cfg:\n{OmegaConf.to_yaml(cfg)}")
tmp_values = train_dqn_task(cfg.train, cfg.base)
task.mark_completed() `
For reference
I have now locally raised Clearml on a nearby machine and logging is configured as in the textbook - all metrics are worked out.
On the machine where I run docker, I just copied the clearml.conf file. Maybe you need to do something else (send the /opt/clearml folder and drop it into the docker image?)?
docker run --rm -v /srv:/root/srv -v /srv/data/apatshin_docker/airflow/dags/voyager:/voyager voyager:cpu python3.7 /voyager/src/pipeline/train_task_dqn_demo.py
I figured it out, I had to click on the model to push, and only after that it would appear as available.
thanks a lot!
Can you please tell me if you know whether it is necessary to rewrite the Docker compose file?
Thank you very much for your help and for such a convenient product!)
I haven't figured out the alents yet, but it already looks amazing!)
` (base) user@s130:~$ clearml-init
ClearML SDK setup process
Please create new clearml credentials through the profile page in your clearml-server
web app (e.g. )
Or create a free account at
In the profile page, press "Create new credentials", then press "Copy to clipboard".
Paste copied configuration here:
api {
web_server: ` `
api_server: ` `
credentials {
"access_key" = "6VUTS73D48DMPVI1NMPS"
"secret_key" = "4fGtZVirW0ztSLbm6JPLESM...
About migration - we saved the data archives and copied them to a new server, extracting them to the appropriate folders and setting the necessary rights, and rebuilding the docker image and launching the container
Before all this, we migrated to the new version according to the instructions and everything went well, all the data after the restart was displayed correctly.
And only after that we began the process of switching to new hardware - with a large disk.
File Store Host configured to: http://localhost:8090if i setFile Store Host configured to:
then
` (base) user@s130:~$ python3.7
Python 3.7.9 (default, Aug 31 2020, 12:42:55)
[GCC 7.3.0] :: Anaconda, Inc. on linux
Type "help", "copyright", "credits" or "license" for more information.
from clearml import Task
task = Task.init(project_name="my project", task_name="my task")
ClearML Task: overwriting (reusing) task id=bf47e430826d43998c0f54c73addc12b
2021-11-03 19:15:13,491 - clear...
if i replace port from 8091 ti 8090 then opened page (pic. 1)
to
ports:
because airflow was raised on one of them (8080)
Yes, sure!
Thank you very much for your time!
CostlyOstrich36 so clear enough?)
Is it possible to do something so that the change of the server address is supported and the pictures are pulled up on the new server from the new server?
My question is, which version do you need docker compose?
like this?
export CLEARML_AGENT_SKIP_PYTHON_ENV_INSTALL="True"
upd: it's work!!!
Thanks a lot!