Yes. More exactly I'm gzip.open them but I don't believe it should matter

let me try

Run a remote task with trains agent that would create inside another task that would again run remotely as well and check the permissions of the second task created file?

Something else, If I want to designate only some of the GPUs of a worker, how can I do that?

The file content by the way contained only the worker's name

I aborted the task because of a bug on my side

Actually two machines with shared filesystem

Will do 🙂

AgitatedDove14
The easiest example for such use case as I describe is for example trying to run the full pipeline but in this experiment I wish to try Batch Norm which I haven't used in the pre executed Task. How can I do that without running this Task by it's own? (Which is quite problematic for me since it runs as a part of a pipeline, therefore using DAG)

So what can I do?

Changing the mountpoint for the agent is not possible

Yes!

Will try, thanks

Including this?
auto_connect_frameworks={"matplotlib": False} I think Mushon has told me otherwise a while ago

Logger.current_logger().report_media(title=f"visualization images f{output_category}", series=output_path.split('.')[-2].split('/')[-1], iteration=1, local_path=output_path)

I understand how this is problematic. This might require more thinking if you guys wish to support this.

I see, will keep that in mind. Thanks Martin!

Well, I do exactly that but it still puts them under plots

Also, why there is a project id where there is a project name that exists? I don't even know how to display a project's id haha

Hmm
AttributeError: 'Task' object has no attribute 'tags'

it uses the api credentials generated by the trains dashboard

It's important to say that this happens when I have more than like 4 workers but when I run the
trains-agent daemon --stopWith less than 4 workers it works well

Matplotlib

Nope, I've run them with the command I've written here

I see, I'll try that

On another topic, I've just now copied a Task that ran successfully yesterday and tried to run it. It failed to run and I got a
ERROR! Failed applying git diff, see diff above.Why is that?

If I'd be exact that's a trains agent task that creates in a new subprocess another trains agent task

I think so. The issue is that I want to report only a sub set of the images (for example I create an image for every sample in the dataset but I want to display on trains only the top 10 with highest score) but when it's magically logged I have no control over this. What can be done?

Let me check this out

And how can I tell which TRAINS_WORKER_ID I'm using?