Hi @<1590514584836378624:profile|AmiableSeaturtle81> , can you please add the log? What version of clearml
are you using?
Hi @<1590514584836378624:profile|AmiableSeaturtle81> , the reason for this is because each file is hashed and this is how the feature compares between versions. If you're looking to keep track of specific links then the HyperDatasets might be what you're looking for - None
I think you would have to re-register it
Hi @<1742355077231808512:profile|DisturbedLizard6> , you can achieve this using the following env var:
CLEARML_AGENT_FORCE_EXEC_SCRIPT
None
How were you saving the model with pytorch?
Hi @<1742355077231808512:profile|DisturbedLizard6> , I think this is what you're looking for:
None
Not really, you can even point the files_server in clearml.conf
to s3. the files server is there so there would be some basic storage solution attached.
Hi, yes it is possible. You can specify the python binary you want to run in clearml.conf
Hi, I think this is the default behavior but I think you can probably edit the source code ( output_uri
parameter of Task.init
would be a good lead).
In what format would you like it saved?
Hi @<1691983266761936896:profile|AstonishingOx62> , its not only the output destination field but where all artifacts/debug/datasets were saved. This is usually logged in Mongo so you would need to run some migration script to change all the urls to the new ip
It looks like there is a mistake on the website. I'll let the ones in charge to fix it ASAP, thanks for the heads up!
@<1574931891478335488:profile|DizzyButterfly4> , what do you feel was lacking from the documentation? A usage example?
Hi @<1531807732334596096:profile|ObliviousClams17> , I think for your specific use case it would be easiest to use the API - fetch a task, clone it as many times as needed and enqueue it into the relevant queues.
Fetch a task - None
Clone a task - None
Enqueue a task (or many) - [None](https://clear.ml/docs/latest/docs/references/api/ta...
Hi @<1638712150060961792:profile|SilkyCrocodile89> , can you please add the log and an example of a failure and of it working?
@<1719524641879363584:profile|ThankfulClams64> , the Genesis autoscaler feature is currently disabled. You can still use the AWS and GCP autoscalers available though
Hi GiganticMole91 ,
Can you please elaborate on this part?I can easily make ClearML treat encoder_layers as a hyperparameter, but the variables are no longer linked when they hit ClearML. I would then see Args/model.encoder_layers: 12 and Args/model.decoder_layers: 12. Is there any way to link hyperparameters in the HyperParameterOptimizer ?
What are you seeing in the UI and what were you expecting to see?
Hi @<1523701601770934272:profile|GiganticMole91> , how is the task being stopped in your case? Is it aborted via the web UI or through some other method? Is the task running via the agent?
But for sure it was aborted via the webUI? Is it possible that your method method might be interfering with this somehow? Can you disable it and check the behaviour?
Just make sure you make regular backups
What version of ClearML-Serving are you using? Are you running on a self hosted server?
So you're using the community server? Response time really depends on the resources of the machine that is running the server and amount of data to filter
Hi @<1747428509627715584:profile|CumbersomeDuck6> , are you using a self hosted server?
Just adding this here for easier readability
` ClearML results page: https:/xxxxt/projects/xxx/experimentsxxx
2022-11-21 11:02:07.590338: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX_VNNI FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2022-11-21 11:02:07.733169: I tensor...
What version of clearml
/ clearml-agent
are you using? Are you running in docker mode? Can you add your agent command here?
Can you verify you ~/.clearml.conf
has proper configuration. If you dofrom clearml import Task t=Task.init()
Does this work?
Hi @<1753589101044436992:profile|ThankfulSeaturtle1> , I think this is what you're looking for - None