Hi JitteryCoyote63 ,
Sure you can, you have many https://allegro.ai/docs/use_cases/trains_agent_use_case_examples/ , just pick to one you need π
Hi UnsightlySeagull42 ,
The clearml-agent use the credentials from your ~/clearml.conf
file, if you changed those, you will need to re-run the clearml-agent.
Can you verify that your clearml-agent is running with the credentials of your https://app.community.clear.ml/dashboard ? if so, can you re-run it with config-file
option?
clearml-agent --config-file <path to your clearml.conf file> daemon β¦
π
Can you upgrade from trains
to ClearML
?
pip install clearml
for installing it, and from your code changefrom trains import task
to from clearml import task
If this is the case (you have results
and you want a new task to connect to each result), you can just clone the base task, update task parameters and enqueue it for execution (similar to https://github.com/allegroai/trains/blob/master/examples/automation/manual_random_param_search_example.py example), can this do the trick?
Hi WackyRabbit7
You can get all the agents PIDs byps -ef | grep "trains-agent"
and kill -9 <pid>
for the requested agent.
You can also pkill -f "trains-agent --gpus 0"
Β - This will kill a process that started trains-agent --gpus 0
.
Notice it matches the cmd pattern so it has to match the way you executed the trains-agent. This can be checked withΒ ps -Af | grep trains-agent
Hi ReassuredTiger98 ,
try:
` from clearml.config import running_remotely
if running_remotely():
... `
Hi ReassuredTiger98 ,
For Model
you can try:
` from clearml import Task
local_model = Model(<YOUR MODEL ID>).get_local_copy() `
Hi CheekyToad28 ,
None of the options https://clear.ml/docs/latest/docs/deploying_clearml/clearml_server#deployment works for you?
if you are using add_function_step
you can pass packages=["protobuf<=3.20.1"]
(there is an example in the sdk docs https://clear.ml/docs/latest/docs/references/sdk/automation_controller_pipelinecontroller#add_function_step-1 )
Thanks GiganticTurtle0 , I was able to reproduce it, a fix will be out shortly, will keep you update about it in this thread
GiganticTurtle0 can you try with 1.1.4rc0
version? pip install clearml==1.1.4rc0
Hi GiganticTurtle0 ,
Can you send a small example how can I reproduce this issue?
If you want to get the pipeline task from a pipeline step, try Task.current_task().parent
Hi GiganticTurtle0 ,
You have all the tasks that are part of the pipeline in an execution table (with links) under plots
section, does it helps?
When connecting a nested dict the keys will be in the struct of period/end
and period/start
, so those are the keys you need to change, in additional to the section name, General
if name not given.
This should work for example in your example:
` cloned_task = Task.clone(source_task=template_task,
name=template_task.name+' for params', parent=template_task.id)
put back into the new cloned task
cloned_task.set_parameters({"General/period/start": "...
Hi GiganticTurtle0 ,
Does it happen when you change the parameters from the UI too? or only from code? same flow as in https://github.com/allegroai/clearml/blob/master/examples/automation/manual_random_param_search_example.py#L47 ?
can you try those? Do you have an example for the cloning code?
Hi GracefulDeer63 ,
What trains
and trains-server
versions are you using?
I hope you understand what I mean
yes π
let me check that
HI JitteryCoyote63 , so just the print is double?
Hi ShinyLobster84 , where do you usually install XXXXX package from? or some artifactory?
can you attach the full log of the instance? Did the aws scalar output any logs?
Hi JitteryCoyote63 , which ec2 type and AMI are you using?
agree
E: Could not get lock /var/lib/apt/lists/lock - open (11: Resource temporarily unavailable)
Another process is using the lock, can you specify the ami (and region) so I can try to reproduce it?
How did you add it? Just edited the configuration part of the task or with the wizard?