![Profile picture](https://clearml-web-assets.s3.amazonaws.com/scoold/avatars/AttractiveCockroach17.png)
Reputation
Badges 1
21 × Eureka!when adding a custom column to the table view from a param value. Maybe it happens because that param is not relevant for all the tasks in the table? it shouldnt through an error though, just show an empty value for the runs where is not relevant.
it also happens with other configuration values like this one which is a boolean. I think it happens in general with configuration values that are passed in your run command as flags (using the override syntax of hydra)
` ─ python run.py -m env=gpu clearml.task_name=connect_test "model=glob(*)" trainer_params.max_epochs=5
2022/09/14 01:10:07 WARNING mlflow.utils.autologging_utils: You are using an unsupported version of pytorch. If you encounter errors during autologging, try upgrading / downgrading pytorch to a supported version, or try upgrading MLflow.
/Users/juan/mindfoundry/git_projects/cvae/run.py:38: UserWarning:
The version_base parameter is not specified.
Please specify a compatability version level...
yes, the remote task is working 🙂
multirun is not working as expected
when I run python run.py -m env=gpu clearml.task_name=demo_all_models "model=glob(*)"
it should run remotely one run per model
this is the output I see locally
` ╰─ python run.py -m env=gpu clearml.task_name=demo_all_models "model=glob(*)"
2022/09/13 20:49:31 WARNING mlflow.utils.autologging_utils: You are using an unsupported version of pytorch. If you encounter errors during autologging, try upgrading / downgrading pytorch to a supported version, or...
my bad :man-facepalming: the hydra error is because the data config folder is not commited (gitignore)
I find this error if I try to run any of the runs generatedclearml_agent: ERROR: Could not find task id=a270d2a56feb475181ef3c9c82111b7f (for host: some_secret_host) Exception: __init__() got an unexpected keyword argument 'types'
waiting now for the run...
but I still have the problem if I try to run locally for debugging purposes clearml-agent execute --id ...
Yes, so here you have the three task (here is a slight refactor using task_func instead of task but the result is the same)
1- all different (status pending)
2- two equal (those which started)
3- all equal (all running or completed)
I guess one solution would be to write a clearml https://hydra.cc/docs/advanced/plugins/overview/ for hydra, like the one with ray.
I leave it here though for now (end of POC)
using 1.3.0
ok, yes, but this will install the package of the branch specified there.
So If im working on my own branch and want to run an experiment, I would have to manually put in the git path my current branch name. I guess I can add some logic to get the current branch from the env. Thank you
if you are doing logs i imagine these are done using Logger.report_scalar
if so. iteration is an argument of that method
im running them with python my_script.py -m my_parameter=value_1,value_2,value_3
(using hydra multirun)
1.- The script im running uses qiskit.providers
but as installed by when you install qiskit. If you try to install the submodules independently, it doesnt work. How do I use the full environment instead? cannot find this in the documentation. Also, I cannot configure the agents it seems because im using the aws autoscaler service so I dont spin them explicitly.
2.- My workflow would be that I usually, locally I run multiple sequential experiments using hydra multirun. What I want is th...
each of those runs finished producing 10 plots each but in clearml only 1, a few, or none got uploaded
or if you could point me to the part of the package that sets up the enviroment to figure out what=s worng, please
Im using the latest version of clearml and clearml-agenst and im seeing the same error
im trying to use https://clear.ml/docs/latest/docs/webapp/applications/apps_aws_autoscaler .
In the setup, I have to provide a personal access token (PAC) from git.
The agents when setting up the env to run the tasks from the queue cannot clone the repo using the pac
cloning: git@gitlab.com:<redacted>.git Using user/pass credentials - replacing ssh url 'git@gitlab.com:<redacted>.git' with https url '
` <redacted>.git'
Host key verification failed.
fatal: Could not read from remote repos...
found the env freeze. For the second workflow all I would need I guess then would be and env variable that would tell me whether this is being currently run by an agent or not
it doesnt happen with all the tasks of the multirun as you can see in the photo
ok, yes I mean the branch im working on. I can assume I;ve pushed it. So ill be using something like
def get_package_url() -> str: repo = Repo(Path(__file__).parent) branch_name = repo.active_branch.name remote_url = repo.remote().url return f"git+ssh://{remote_url.replace(':', '/')}@{branch_name}"
andTask.add_requirements("my_package", "@ {get_package_url()}")
basically running_locally()
ok, I think I have everything I need. Will give it a try.