Hi, they aren't auto generated, this is just written code.
Maybe @<1523701087100473344:profile|SuccessfulKoala55> has more insight into this 🙂
Did you provide an entry point?
Is it possible the machines are running out of memory? Do you get this error on the pipeline controller itself? Does this constantly reproduce?
You can even decide individually per step
Hi StraightParrot3 , you can get a list of users & ids using the endpoint users.get_all
Hi!
Can you say what's the size of your clearml folders?
Hi ExuberantParrot61 , that's a good question. This is a bit hacky but what if you try to catch the task with Task.current_task()
from inside the step and try to change the output_uri
attribute there?
For configuration, please look here:
https://clear.ml/docs/latest/docs/integrations/storage
Hi @<1644147961996775424:profile|HurtStarfish47> , Do you have some basic code snippet that reproduces this behavior?
Hi @<1523701168822292480:profile|ExuberantBat52> , I think someone should review this soon enough 🙂
Hi @<1688721797135994880:profile|ThoughtfulPeacock83> , can you add a standalone script that reproduces this?
Hi @<1579280543999070208:profile|SourFly7> , this index holds scalars of some experiments. You can reduce it by deleting some experiments. Do you have any other large scalar indices?
Hi @<1603198153677344768:profile|ExasperatedSeaurchin40> , I think this is what you're looking for - None
Hi @<1695969549783928832:profile|ObedientTurkey46> see below 🙂
Hi, I have two instances of clearml-server that I would like to merge into one. Is there any way to do that without loosing tracked experiments, datasets or artefacts?
This is not trivial, you would have to merge the databases somehow.
Additionally, do you if it is possible to backup clearml-server
without
shutting it down? If shutdown is mandatory, I have to force the Datascientists to stop traini...
from src.net import Classifier
ModuleNotFoundError: No module named 'src'
Hi @<1590514584836378624:profile|AmiableSeaturtle81> , the reason for this is because each file is hashed and this is how the feature compares between versions. If you're looking to keep track of specific links then the HyperDatasets might be what you're looking for - None
Hi @<1664079296102141952:profile|DangerousStarfish38> , looks like an issue with docker on your machine. Are you able to run that container manually?
I'm not sure I understand your second request. Can you please elaborate on the exact process you're thinking of?
Clone task via UI -> Edit a config section in UI -> Enqueue it to a queue -> Worker picks it up and starts running the task -> Task is finished
What am I missing here?
UpsetBlackbird87 , thanks! I'll play with it a bit to see if it reproduces on my side as well 🙂
Hi @<1674226153906245632:profile|PreciousCoral74> , you certainly can, just use the Logger
module 🙂
None
Python 2 is no longer supported, I'd suggest finding an AMI that already has python3 built in (Or install it using the init script, not suggested though) and also CUDA enabled to avoid that installation to support cuda images
ClearML only handles code that way when the code is standalone (Single script) and not part of a repository. To include multiple files you need to have it in a repository. If you put your package as part of your repo this will be handled automatically
CumbersomeParrot30 , try setting the following environment variable to true:CLEARML_SKIP_PIP_VENV_INSTALL
Hi @<1715175986749771776:profile|FuzzySeaanemone21> , what if you try to register them as https?
Where did clearml-init create the clearml.conf
?
Interesting, what version are you running?