you can this description as the preview, can this help?
task.upload_artifact(name='artifact name', artifact_object=artifact_object, preview="object description")
the controller task? same as here - https://github.com/allegroai/clearml/blob/master/examples/pipeline/pipeline_controller.py
TrickyFish46 I tried https://clear.ml/ and http://app.clear.ml and both works for me, which one is causing you the issues?
How did you create task B? cloned from other task?
The agent will run the task according to the commit in the execution tab (you can choose commit, branch or tag)
Hi OddShrimp85 , Do you get any errors from the server?
Hi NuttyOctopus69 ,
I’m getting the same, suspect its some pypi server issues (from https://status.python.org/ ).
You can install it the latest version from GitHub withpip install git+
Hi DeliciousBluewhale87 ,
You can try to configure the files server in your ~/clearml.conf
file. could this work?
BTW, what about running trains-agent in docker mode? That can solve all your cuda issues
try pip install clearml==0.17.6rc1
Hi GrievingTurkey78
If you like to have the same environment in trains-agent
, you can use on your local machine the detect_with_pip_freeze
option, on you ~/trains.conf
file.
Just change detect_with_pip_freeze: true
( https://github.com/allegroai/trains/blob/master/docs/trains.conf#L168 is an example)
Hi UnsightlySeagull42 ,
The clearml-agent use the credentials from your ~/clearml.conf
file, if you changed those, you will need to re-run the clearml-agent.
Can you verify that your clearml-agent is running with the credentials of your https://app.community.clear.ml/dashboard ? if so, can you re-run it with config-file
option?
clearml-agent --config-file <path to your clearml.conf file> daemon …
how can i check if it is loaded?
When a task is starting, the configuration will be print first
it worked with trains-agent init
Do you have 2 configuration files? ~/trains.conf
and ~/clearml.conf
?
👍
Can you upgrade from trains
to ClearML
?
pip install clearml
for installing it, and from your code changefrom trains import task
to from clearml import task
GrievingTurkey78 all the packages should have a version, do you have some without?
Which one? If the package is located in additional artifact repositories, you can add it
Hi JitteryCoyote63 , what commit and branch do you see in the UI?
Great 🙂
If you do wanna change the commit/branch/tag, you can change it from the data.script
section in the cloned_task object
Thanks ImpressionableAlligator9 and MagnificentWorm7 for reporting this, I will double check it
seems like an issue with pypi, when trying to install a package with pypi server, it fails
This seems to be the same issue like in https://clearml.slack.com/archives/CTK20V944/p1633599511350600
Whats the pyjwt
version you are using?
thanks for the answer, so for example (to make sure I understand) with the example you gave above when I’ll print the config I’ll see the new edited parameters?
Correct
What about the second part of the question, would it be parsed according to the type hinting?
It should
Hi GleamingGiraffe20 ,
The example in the documentation is missing a filename at the end of remote URL (an error I gotten locally when I tried to upload).
In https://allegro.ai/docs/examples/examples_storagehelper/#uploading-a-file example, the filename is /mnt/data/also_file.ext
, did I miss the example you talked about? If so, can you send a link to it?
When using a trains task to track my run AND changing my scripts output directory, I get: ‘TRAINS Monitor: Could not d...
For 'TRAINS Monitor: Could not detect iteration reporting, falling back to iterations as seconds-from-start'
message - the iteration reporting is automatically detected if you are using tensorboard
, matplotlib
, or explicitly with trains.Logger
Assuming there were no reports, so the monitoring falls back to report every 30 seconds.
Thanks for the examples, will try to reproduce it now.
You have to define it, but this can be done really quickly under the task, addingtask.set_base_docker(docker_image="your docker image", docker_arguments='-e CLEARML_AGENT_SKIP_PYTHON_ENV_INSTALL=1')
for example, or you can also add it to the agent’s configuration if you want to set this always with agent.default_docker.arguments
https://clear.ml/docs/latest/docs/configs/clearml_conf/#agentdefault_docker
Hi AbruptCow41 ,
also, is there a way for it to not install the requirements, and simply run the task?
Yes, you can specify the env you like to use and disable the requirements installation:CLEARML_AGENT_SKIP_PIP_VENV_INSTALL
env var to define the python environment you are working withCLEARML_AGENT_SKIP_PYTHON_ENV_INSTALL
to skip the installations
how do I mount my local ssh folder into
/root/.ssh/
docker when running clearml-agent?
this shou...
Hi SoggyDog52
- can you add, after the task has completed, some free text to write down my conclusion of this run?
What kind of information you like to add? You can add a tag to a task. If you like a free text, you can change the description part in the INFO tab. Can this do the trick?
- I’m having troubles copying the config file from the UI. A simple copy past that’s all. When I try to mark the whole config with the courser it manege to catch just some part.
Do you have...
Hi GracefulDeer63 ,
What trains
and trains-server
versions are you using?
Hi UnevenDolphin73 ,
Which region are you using? a machine with or without gpu(s)?
The wizard is part of trains, this is the part you need - https://allegro.ai/docs/examples/services/aws_autoscaler/aws_autoscaler/#running-using-the-script
About
I should first create a auto scaling group in AWS?
you don’t need to, but if you want, you can do it and pass the credentials to the wizard