Reputation
Badges 1
53 × Eureka!Unfortunately, I am not running on a community server
I don't know if it has anything to do with it but I now see that the repo which is cloned and save in the cache is actually a different branch than the one which is pulled by the agent.
From the log file:repository =
https://gitlab.com/data_science_team/PROJECT_NAME branch = MYBRANCH
SOMENUMBER IP### DEBUG
warning: redirecting to https://gitlab.com/data_science_team/PROJECT_NAME.git/
yes of course I specified it with :torch.save(state, f_path)
where f_path = os.path.join(tempfile.gettempdir(), 'trained_models') + '\
http://my_model.pt '
As it seems torch.save()
just saves to the disk, so it seems there is no need for (server) parent path, just the name of the file , in my case : '
http://my_model.pt '
.
Thanks for you help CostlyOstrich36
Thank you for the clarification, everything is clear now 🙂
Thanks! the second link is exactly that what I was looking for 🙂
Hi, adding the requirements to the code doesn't help because the task fails beforehand. CostlyOstrich36
Sending you to private CostlyOstrich36
The problem is with the path I am trying to save the model to.Therefore my question How do I extract paths inside ClearML?
EDIT
I have disabled VCS-cache and it seems that the multiple cache files are still created when running a new task. Also still the lock is created once a new experiment is run: first image - cache after removing lock, second image - a few seconds later after running a new task. Also attached log output of the task uploaded (with ### replacing non relevant details).
I have some info that I wouldn't like to post here (due to security reasons), is there a way to share the link only with your user ? 🙂
And afterwards, I have the following output that continues for 300 iterations without further reports of metrics
Hi, joining in into this thread. I just have the same error with my task, which is not an optimization one.created virtual environment CPython3.7.5.final.0-64 in 232ms
creator CPython3Posix(dest=/home/ubuntu/.clearml/venvs-builds/3.7, clear=False, no_vcs_ignore=False, global=False)
seeder FromAppData(download=False, pip=bundle, setuptools=bundle, wheel=bundle, via=copy, app_data_dir=/home/ubuntu/.local/share/virtualenv)
` added seed packages: pip==22.0.4, setuptool...
also tried to connect from to dataset from CLI and recieved connection error:
Hi, the URL contains some details which I wouldn't like to share on this thread. Can I send it to one of you in private message?
CostlyOstrich36 The application problem was indeed solved 🙂 but the plots one didn't
Clearing my cookies solved the issue, Thanks 🙂
Interesting I am only now seeing **optimizer_kwargs
it seems that it will fix my problem. Is it too much to ask if you could add an example of how to initiate the optuna object with the kwargs (mainly how to initiate 'trial', 'study', 'objective' arguments) ? 🙂
I would to delete a tag name from list of tags not from a task, ie from here:
In the child dataset task I see the following :
ARTIFACTS - > STATE:Dataset state
Files added/modified: 1 - total size 518.78 MB
Current dependency graph: {
"0385db....": [],
()"94f4....": ["0385db..."]
}
child task is 94f4..
and parent task is "0385db..."
but what does the () line means?
where should I look to see this metric? at the scalars tab?
Another question: Is there a way to group together Dataset tasks (i.e redefine their parent) after the tasks have been finalized? In the same context: is there a way to change the dependency graph in the clearml dashboard after the task creation and finalization ?