Sorry about the inconvenience...We are updating our website and the docs are the victims...should be resolved soon

Yeah I get what you're saying, but when developing ClearML we did not view it like that. when we run it locally or debug it, we thought of it more "This is running just on my local computer without an agent to make sure everything works before I use an agent to run the parts". Sorry that it confuses you 🙂

What you can do is run it in offline mode though 😄

I actually don't think that it's supported at the moment...I'll talk to the devs and see if that's something we can add to a future release

Thanks! 😄 As i've mentioned above, these features were chosen because of users feedback so keep it up and Thanks again!

Hi CourageousKoala93 , not 100% sure I understand what graphmode is, I see it's a legacy option maybe from TF1? If you can put a small snippet so I can try it on my side that'll be helpful!

This is what I'm seeing the > is the title - series relation. I'm not 100% clear why the iteration is a problem, could you elaborate?

Hi DepressedFish57 , as Martin said either the next version or the next-next version will have this feature 😄 We'll update here when it's out 🙂

Hi DepressedFish57 clearml v1.5.0 (pip install clearml==1.5.0) is out with a fix for this issue 🙂
Let us know if it works as expected 😄

TrickySheep9 Tough question 😄 We are working on a major change to pipelines. We are now documenting pre\post step callbacks (so people can write custom code that interacts with the pipeline that's independent of the script's code).
We're working on adding the ability to run small code snippets directly on the pipeline controller task (so you don't have to wait for an agent to setup).
AND we are working on a new UI soon 🙂
A tiny spoiler is that we'll soon improve our visibility and...

get_local_copy() would download the file to your cache and return it's path

Just wanted to highlight that you can now schedule your tasks for later execution!!!!

Hi Itay! I know JitteryCoyote63 played with it a bit, I'm not sure what was his ultimate conclusion 🙂
We are now working adding such feature to ClearML-Pro (That is soon-to-be released), I suggest to stay tuned 😄

Thanks MotionlessMonkey27 , we're looking into that! Thanks for the info

Hadrien, just making sure I get the terminology, stopped instance meaning you don't pay for it, but just its storage, right? Or is it up and idling (and then Martin's suggestion is valid)? Do you get stopped instances instantely when you ask for them?

I think you should call dataset.finalize()

@<1541954607595393024:profile|BattyCrocodile47> Thanks a lot for the explanation! These inputs help us a lot building our tools, and eventually, building user's trust in them 🙂 Let us know with what orchestrator you ended up with and how it's going!

Just making sure, you're running the server locally and run the script on jupyter also locally, right?

EnviousStarfish54 BTW, as for absolute reproducibility, you are obviously right. If you use S3 to store the data, and you changed the data in S3 then we can't catch it.
Our design compresses (zips) the files and store them in a version somewhere. If this is modified than you are trying hard to break stuff 🙂 (Although you can). This is not the most efficient space-wise when it comes to images \ videos, for these, you can save links, but I think it's only in the enterprise version but then,...

EnviousStarfish54 VivaciousPenguin66 Another question if we're in a sharing mood 😉 Do you think a video \ audio session with one of our experts, where you present a problem you're having (let's say large size of artifacts) and he tries to help you, or even can give some example code \ code skeleton. Would something like that be of interest? Would you spend some time in such monthly session?

https://clear.ml/docs/latest/docs/clearml_data#upload-dataset-content

I think there was a slight mixup between our automatic logging (let's say, when you report images to tensorboard and ClearML just automatically captuers it and logs it) to explicitly reporting images (with the Logger object)

As for DAG workflow, I saw someone who integrated Clearml with Luigi but couldn't find the post anywhere! 😄

Once defined, the new dataset will have the content of all it's parents. then you can add \ modify \ remove files from it and commit a new dataset.

Hi RotundSquirrel78 that indeed doesn't look right...What server version are you using? From the "t" icon it seems it's still a trains server?

Hi, in addition to natanM's question, does it fail on trigger or by running the script? if running with worker, please share worker logs as well!

Hey There SlimyRat21
We did a small integration of Trains with a Doom agent that uses reinforcement learning.
https://github.com/erezalg/ViZDoom
What we did is basically change a bit the strcuture of how parameters are cought (so we can modify them from the UI), then logged stuff like loss, location on the map, frame buffers at certain times and information about end of episode that might be helpful for us.
You can see how it looks on the demoapp (as long as it lasts 🙂 )
Let me know if...

To add onto what Martin wrote, you can see here: https://clear.ml/docs/latest/docs/guides/data%20management/data_man_cifar_classification
How it's interfaced with a torch dataloader. You only replace the path for where the files come from

As for the git, I'm no git expert but having your own git server is doable. I can't tell you what it means in terms of how does it work in your organization though as every one has their own limitations and rules. And as I said, you can use SVN but the connection between it and ClearML won't be as good as with git.

Yes definitely. As I said, if you like kedro continue using it. Both tools live happily side by side.