Interesting idea. From the looks of it even by searching for the task id manually archived experiments aren't fetched. Maybe open a github issue for this, really cool feature idea 🙂
Hi @<1523702459048923136:profile|SmugSnake6> , what framework are you using? Do you have a stand alone snippet that reproduces this?
Hi CostlyFox64 ,
Can you try configuring your ~/clearml.conf with the following?agent.package_manager.extra_index_url= [ "https://<USER>:<PASSWORD>@packages.<HOSTNAME>/<REPO_PATH>" ]
difficult to verify correctness without a publicly available test suite
What'd you mean?
Any chance you have a toy script to play with?
Hi @<1810121608967229440:profile|NonchalantWhale65> , can you provide a short code snippet that reproduces the problematic behaviour?
Hi @<1541954607595393024:profile|BattyCrocodile47> , I'm happy to hear you're excited!
You certainly can replace 1 & 2 by ClearML and still use BentoML for serving. ClearML is very modular so you can select which parts you want to integrate into your existing solution. Hopefully in the end you yourself would want to fully adopt ClearML in all 4 aspects 🙂
Hope it answers the question!
You can, but if it's a large organization having a dedicated account for this would probably be best
Hi @<1571308003204796416:profile|HollowPeacock58> , do you have a self contained code snippet that reproduces this?
I would also suggest using pipelines if you want to do several actions with a task controlling the progress.
Hi @<1535069219354316800:profile|PerplexedRaccoon19> , yes! Here is an example:
None
But I believe you can use your user/group if you prefer 🙂
In the UI when looking at a task under 'execution' tab, if you scroll down you have a 'container' option. If you define an image there the agent will use it if you use the '--docker' argument
Hi @<1544853721739956224:profile|QuizzicalFox36> , from the error you're getting it looks like a permissions issue with the credentials. Check if your credentials have read/write/delete permissions
Are you using a self hosted server or the SaaS solution?
Hi @<1691983266761936896:profile|AstonishingOx62> , I'm not sure I understand what you're trying to do. You have some python code unrelated to ClearML. Does it run without issues? Did you afterwards add Task.init() to that code?
Hi @<1882599179692281856:profile|FriendlyBluewhale89> , you can use the services queue on PRO
I'm not sure I understand. Can you give a more specific example?
How do you bring down agents currently? I usually kill the process or send tasks.abort via the API
You mean only show children when there is nothing inside the parent?
Hi UpsetTurkey67 ,
Is this what you're looking for?
https://clear.ml/docs/latest/docs/references/sdk/trigger#add_model_trigger
Hi @<1523701260895653888:profile|QuaintJellyfish58> , if you run in docker mode you can easily add environment variables.
Can you elaborate a bit on your use case? If it's python code, why not just put it in the original file or import from the repo?
Hi @<1768447000723853312:profile|RipeSeaanemone60> , can you please provide the full log? Is it the pipeline controller that is getting stuck or some step?
RotundSquirrel78 , do you have an estimate how much RAM the machine running ClearML server? Is it dedicated to ClearML only or are there other processes running?
UpsetBlackbird87 , I couldn't reproduce the issue on my end. Can you please send me a self contained example code to try and recreate?
You still have the AWS/GCP autoscalers which are great 🙂
Hi @<1523701868901961728:profile|ReassuredTiger98> , in the end the container mounts to some volumes on the original machine so it has to be somewhere. Are you basically asking about 'cleaning' the data once a session finishes?
It would work from your machine as well, but the machine needs to be turned on... like when an ec2 instance that is running.