i run all seslf-hosted and without docker, with pipe.start_locally(run_pipeline_steps_locally=True)
It worked ok on my local machine but failed on remote, only difference i can think of is huge git diff on which clearml if complaining, can this be the reason?
Can you check if there are any errors in Elastic container when you're running a task?
You need to inspect the ES container directly
At this moment i somehow made it work, at least with debug sample
i think its actually a bug anyways, since there are no even task creation log in console, and still it's marked as succesfully completed
You mentioned you are self deployed. When you deploy the server, one of containers deployed is the ES container. Did you not deploy the server via docker compose?
I installed ClearML Server with tutorial, yes i did it through docker, as i understood i need to look for Elastic logs in /var/log/ecs/ecs-agent.log but i have no such file or even ecs folder in this location on my ClearML Server machine
since i do not use docker and run with pipe.start_locally(run_pipeline_steps_locally=True)
at both local and server, do i still have a some kind of containers? how can i view logs of it?
Hi @<1623491856241266688:profile|TenseCrab59> , are you self deployed? Can you provide some logs/screenshots? If you go directly into the task information of each step there console is empty?