
Reputation
Badges 1
212 × Eureka!It will then parse the above information from my local workstation?
When I run this line locally, it works finefrom sfi.imagery.models.chip_classifier.eval import eval_chip_classifier
How does a task specify which docker image it needs?
It takes about 30 seconds here for that step
Its a legacy code base. There was issues around the memory not being cleared in the GPU when subprocesses were not used. At this point I refactored out the subprocess as it just adds more complexity.
I'm getting import errors when I do, from project.utils import tool
all from the working directory of project
After proving we can run our training, I would then advise we update our code base
Yea the "-e ." seems to fit this problem the best. On another note, It seems like whatever I add to docker_bash_setup_script
is having no effect.
Would be great if the docker_bash_setup_script
had output I could see
Yea I've done that already but I can do it again
Then it tries to curl the files API and gets a 405
I can see this log message in the nginx controller"GET / HTTP/1.1" 405 178 "-" "curl/7.79.1" 95 0.003 [clearml-clearml-fileserver-8081] [] 10.36.1.61:8081 178 0.004 405 b4f5caf7665ffa1e8823a195ae41ec26
curl --insecure -sw %{http_code}
` -o /dev/null │
│ init-k8s-glue waiting for apiserver ...
I don't see any requests
maybe a cors issue?
I used the values from the dashboard/configuration/api keys
I verified in the pod yaml it is set correctly
` * Serving Flask app 'fileserver' (lazy loading)
- Environment: production
WARNING: This is a development server. Do not use it in a production deployment.
Use a production WSGI server instead. - Debug mode: off
[2022-09-08 13:24:25,822] [8] [WARNING] [werkzeug] * Running on all addresses.
WARNING: This is a development server. Do not use it in a production deployment. `
so its not the files server, its every server
SuccessfulKoala55 It looks like it should eval to True?
and removed the duplicate Task.init()
This would be a short term solution as we build a proof of concept