but have our own custom logging of metrics etc.
Are those custom metrics reported to the ClearML server or stored somewhere else?
Just wondering how tricky integrating a trigger would be for that
I guess it really depends on your current implementation currently
VexedCat68 Hi 🙂
Please try with pip install clearml==1.1.4rc0
You can mix and match various buckets in your ~/clearml.conf
BoredBat47 , can you add the logs?
Possible, do you see any errors in ES? Also, what do you see in developer tools when navigating to the Plots tab?
Hi @<1544853695869489152:profile|NonchalantOx99> , as the error states:
raise ValueError('Could not find queue named "{}"'.format(queue_name))
ValueError: Could not find queue named "services"
It couldn't find the queue services. This is for the pipeline controller to run on. Pipelines consist of steps and the controller and they all can run on different machines. By default, the controller will try to run on the services queue. Makes sense? 🙂
UpsetBlackbird87 , thanks! I'll play with it a bit to see if it reproduces on my side as well 🙂
JitteryCoyote63 Hello 🙂
So That I understand correctly you have a task where you pull data from us-east-1 and then want to upload the data on eu-central-1 but it's failing due to the region change, correct? Can you please give an example of the failure in console?
Can you try running it via agent without the docker?
When the docker runs, does it print out the aws user key correctly?
You ran the same exact command for agent one with --docker and one without --docker and the one without managed to reach the files?
You can view all projects and search there 🙂
WackyRabbit7 Hey, sorry for the delay 🙂 Hopefully I'll have an answer in a couple of hours
Hi @<1523702786867335168:profile|AdventurousButterfly15> , do you have a short standalone script that reproduces this?
What version of clearml are you using? Is it a self hosted or the community server
You can, but if it's a large organization having a dedicated account for this would probably be best
Hi @<1600661428556009472:profile|HighCoyote66> , the UI uses the same REST API to communicate with the backend. I would suggest opening developer tools (F12) and seeing what requests are being sent in the network tab. I think it might be auth.login
VexedCat68 , that's a good question! I'm not sure that ClearML keeps track of that, I need to check on that.
However, I think a neat solution could be using the datasets as task configuration parameters. This way you can track which datasets were used and you can set up new runs with different datasets.
VexedCat68 , correct. But not only arg parse. The entire configuration section 🙂
@<1533159639040921600:profile|JoyousReindeer30> , you need to run the agent with the -- cpu-only tag as well 🙂
Hi ConvolutedSealion94 , I think you're right. Maybe open a github issue for this to be added?
Hi FierceHamster54 , I'm afraid currently this is not possible. Maybe open a Github issue to track this 🙂
Hi @<1578555761724755968:profile|GrievingKoala83> , are you using a self hosted server?
Hi RoughTiger69 , how are you running the pipeline? Locally or on agents? How is the controller running?
Hi @<1654294828365647872:profile|GorgeousShrimp11> , it appears the issue is due to running with different python versions. It looks like the python you're running the agent on, doesn't have virtualenv
Yeah I see it too! I'll ask someone to take a look at it
Hi MoodyCentipede68 ,
What versions of ClearML & Agent are you using?