Which mode? It is indeed vague 🙂
WackyRabbit7 , please skim over here 🙂
https://clear.ml/docs/latest/docs/references/api/tasks#post-tasksget_all
Hi FlatOctopus65 , are you trying to run on the same machine or a different one?
JitteryCoyote63 what browser/os are you on?
SoreDragonfly16 You can disable this with the following argument in task.init() - auto_connect_frameworks=False for example:task = Task.init(..., auto_connect_frameworks={'pytorch': False})You can refer to this documentation for further reading at this https://clear.ml/docs/latest/docs/references/sdk/task#taskinit 🙂
VexedCat68 , I was about to mention it myself. Maybe only keeping last few or last best checkpoints would be best in this case. I think SDK also supports this quite well 🙂
Can you access the model in the UI and see the uri there?
Because that seems to be connected to data
Thanks for the info! This happened when you had 2 spot instances running something, correct?
Hi @<1653932438834909184:profile|LackadaisicalSwallow14> , can you add some information please? Are you using a self deployed server or the community? Has something changed recently? Is the issue occurring for all users or only specific ones?
Hi @<1523701457835003904:profile|AbruptHedgehog21> , what happens if you use a different size?
VexedCat68 , this is really simple ! 🙂
Add from clearml import Task and task=Task.init() to your script Run the script In the UI: Clone the experiment by right clicking it and selecting clone (or from the hamburger menu) Enqueue experiment in UI: Right click on the experiment and select enqueue 🙂
Hi @<1523701260895653888:profile|QuaintJellyfish58> , I think where your code runs depends on where the clearml cache is. Search clearml.conf for cache under agent configuration 🙂
EcstaticGoat95 , thanks a lot! Will take a look 🙂
Also can you provide the configuration of the autoscaler? You can export it through the webUI just make sure to scrape off any credentials
And the same can be done with the autoscaler :)
You can create multiple templates
I think this is what you're looking for 🙂
https://clear.ml/docs/latest/docs/references/sdk/dataset#datasetlist_datasets
@<1709740168430227456:profile|HomelyBluewhale47> , how did you set the output_uri ?
Hi FierceHamster54 , is this an old autoscaler instance? What is the version? You can see the version when you're on the application and click on 'More' at the top left text area
I think it is one of the parameters of the task. Fetch a Task and see what properties the artifact has 🙂
@<1529271085315395584:profile|AmusedCat74> , what happens if you try to run it with clearml 1.8.0?
Hi @<1695969549783928832:profile|ObedientTurkey46> , this capability is only covered in the Hyperdatasets feature. There you can both chunk and query specific metadata.
None
Hi @<1784754456546512896:profile|ConfusedSealion46> , in that case you can simply use add_external_files to the files that are already in your storage. Or am I missing something?
Hi @<1828241063677005824:profile|ReassuredAlligator91> , I think as long as you have access to the email account that signed up to the original workspace, you should be OK. Just pass down the credentials to the account to the relevant people (yourself for example) and manage it from there.
WDYT?
Does any exit code appear? What is the status message and status reason in the 'INFO' section?
ResponsiveHedgehong88 , please look here:
https://clearml.slack.com/archives/CTK20V944/p1660142477652039
Is this what you're looking for?
Hi @<1724960475575226368:profile|GloriousKoala29> , to address your questions:
- No, that is not possible currently. Think of the Datasets feature as a catalogue of data, meaning you can see what data is saved but you can only see what's inside when you pull it locally.
- I'm afraid not, ClearML basically saves links to the data but doesn't directly "look" at the data
Can you try with Task.connect() ?
https://clear.ml/docs/latest/docs/references/sdk/task#connect
Hi ExuberantParrot61 , if it's on the same machine you can use different configuration files. for example, when running the agent you can use --config-file <PATH_TO_USER_CONFIG_FILE>