In compare view you need to switch to 'Last Values' to see these scalars. Please see screenshot
Are you getting some errors? Did you run an agent?
VexedCat68 hi!
Hopefully will have updates soon
Then add a screenshot of the info section
ColorfulRaven45 Hi!
I'm afraid this is kind of a plotly limitation. Currently you can switch to full screen view OR hit the maximize graph button (it shows on over) for a better view.
We'd be happy to take a suggestion though 🙂
How long did you let it sit for?
Please try like Kirill mentioned. Also please note that there is no file target in the snippet you provided 🙂
Do you have resource monitoring on that machine? Any chance that that something ran out of space or memory or cpu?
Well it sounds like it makes some sense. Try the following on the machine running the agent - In ~/clearml.conf
edit the following section:agent.vcs_cache.enabled=False
I don't think you need to mix. For example if you have a pre-prepared environment then it should something like export
CLEARML_AGENT_SKIP_PIP_VENV_INSTALL=<PATH_TO_ENV_BINARY>
It intermittently reads the requirements.txt between my repo and the cache
Can you please elaborate?
Hi @<1533159639040921600:profile|JoyousReindeer30> , is it possible that the wheel it's trying to install is internal and not possible to install via regular pip install?
Hi @<1724960468822396928:profile|CumbersomeSealion22> , what was the structure that worked previously for you and what is the new structure?
Hi ObedientToad56 🙂
My question is on how the deployment would be once we have verified the endpoints are working in a local container.
I isn't the deployment just running the inference container? You just open up the endpoints towards where you wanna server, no?
Hi @<1590514584836378624:profile|AmiableSeaturtle81> , did you try the solution in GitHub? Did it not help?
Hi @<1590514584836378624:profile|AmiableSeaturtle81> , did you have a chance to try out the solution suggested in GitHub and play with it a bit?
Hi @<1730033904972206080:profile|FantasticSeaurchin8> , can you add a code snippet that reproduces this + a log of the run?
Hi @<1573119955400921088:profile|CloudyPelican46> , you can certainly do this. You can find all the related api calls here - None
I suggest opening developer tools (F12) and seeing what is sent in the UI to fetch the various metrics you're looking for
TartSeagull57 , can you please open a github issue for tracking? 🙂
Hi @<1846360397620187136:profile|DashingSealion19> , do you have a standalone code snippet that reproduces this behaviour?
Hi @<1539417873305309184:profile|DangerousMole43> , I think you can do it if add some code to the pipeline controller to extract the console logs from a failed step
Please do 🙂
Hi PunyWoodpecker71 ,
Regarding your questions:
We have an existing EKS cluster. So I'm wondering if I should deploy ClearML on the EKS cluster, or deploy on EC2 using AMI. Is there an advantage of one over the other?I think it's a matter of personal preference. Maybe SuccessfulKoala55 , can add some information.
We have a pipeline that need to run once a month to train a model. Is there an scheduler option we can config to enqueue the pipeline once a month? (It look like the Pro plan has ...
There are no role based access controls in the open source version. This feature exists only in the Scale/Enterprise licenses.
Fair enough 🙂
BTW I noticed that your minio access is misconfigured, check here for the proper syntax - None
Can you check up on the dockers and see if they're all up and running?
Hi CrabbyKoala94 ,
Are you running a self hosted server?