Can you please add here what you're sending + what is received?
Can you add the log printout of the controller?
Or are you just trying to run clearml-agent?
Hi @<1534344462161940480:profile|QuaintSeal61> , have you upgraded to a new version? Are you self hosted or using the community server? Also, can you elaborate on which part of it is slow? 🙂
I'm not sure it's not possible in the open version. I think this is because the users are loaded into the server when the server loads all the config files. This usually happens on server startup.
However, even if you simply restart the apiserver, any running experiments should continue running and resume communication with the backend once the apiserver is back up.
There is also the option of manually creating documents directly on mongodb - but it is unadvisable.
If you don't have many users you can see which user ID fits which name. If you want to make it automatic I think you'll need to use the API endpoint users.get_all
Hi PunyWoodpecker71 , what are you trying to do?
Do you have K8s?
DepressedChimpanzee34 , Hi!
The part you want to do faster is the code snippet you provided? Also, I'll check regarding the verbosity 🙂
Hi @<1688721775728267264:profile|VastGiraffe70> , the self hosted version is completely unrestricted from the usage perspective
Were you able to do clearml-init and create a clearml.conf ?
GrievingTurkey78 , the default is 3 minutes. You can try setting to a long enough time to make sure it doesn't skip the epoch 🙂
Did you try fetching the same data or from the same source?
@<1544853695869489152:profile|NonchalantOx99> , it seems like the server isn't reachable. Isn't self hosted?
Are you sure that the file is on the server? Can you access it?
I'm being silly. You're actually directing it to the file itself to where it resides
o, if I pull this file from s3 bucket, I can conclude which chunk I should download to get a specific file. Am I wrong?
I think you're right. Although I'm not sure if you can decompress individual chunks - worth giving it a try!
I also though clearML writes this mapping (
state.json
) into one of its databases: Mongo, Redis, Elasticsearch.
I think the state.json is saved like an artifact so the contents aren't really exposed into one of the dbs
@<1547028031053238272:profile|MassiveGoldfish6> , what do you mean you have to run it every morning? What happens otherwise?
RoughTiger69 , can you please elaborate a bit on your use case?
Hi SmugSnake6 , interesting point! Maybe open a Github issue to track this 🙂
Hi RattyLouse61 , how are you adding users? Are you adding them as fixed users in one of the configuration files?
GiganticTurtle0 , which ClearML version are you using? From what I can see in the documentation to add the new parameters, you'll have to task.connect() again to add the new args
Hi @<1643785593177509888:profile|FrustratingSeagull27> , do you have some sample code that recreates this behavior?
ContemplativeGoat37 , I'm curious about your implementation. Which method was more relevant - config file change or using an environment variable or are both useful?
LethalCentipede31 , it appears we had an internal issue with a load balancer, it was fixed a couple of minutes after your comment 🙂
I think this is what you're looking for - None
No, but I think it would make sense to actually share reports outside of your workspace, similar to experiments. I'd suggest opening a GitHub feature request
Hi CluelessFlamingo93 . This is indeed a capability within ClearML.
I think this is what you're looking for:
https://www.youtube.com/watch?v=k5e-E5oEFUw
There is a CLI for working with datasets but nothing specific for task artifacts I think, only the SDK. What is your use case?
Hi @<1552101474769571840:profile|DepravedLion86> , do you have something that reproduces this behavior?