So I added the snippet above to the code,
and now the preview for the first 10 rows shows up. However, the automatic preview is still not working.
CostlyOstrich36 The latest clearml package, installed these days - 1.9.0
The dataset view is also empty:
CostlyOstrich36 Do you have any idea how I could debug that?
@<1523701070390366208:profile|CostlyOstrich36> It looks like this:
ProudElephant77 , I think you might need to finalize the dataset for it to appear
Actually, datasets should have an automatic preview...
Thanks a lot, I will have a look at that!
CostlyOstrich36 I have used ds.get_logger().report_image()
in a loop in order to upload all the images from the dataset as previews. Then I called flush()
, which returned True
. However, the images are still not shown. Any ideas - how could I debug that?
CostlyOstrich36 WebApp: 1.9.1-312 • Server: 1.9.1-312 • API: 2.23
I am currently running the scripts on WSL ubuntu
The thing is, even on the community server, not all the datasets have automatic previews. So for the same code/dataset, some of the runs have previews and some of them don't.
I don't think datasets don't have visualization out of the box, you need to add these previews manually. Only HyperDatasets feature from the Scale & Enterprise versions truely visualizes all the data.
According to your code snippet there isn't any visualization add on top of the dataset
@<1523701168822292480:profile|ExuberantBat52> , did you add debug samples in a similar fashion? What version of the clearml
sdk are you using? Also what server?
Can you please paste the response from events.debug_images
?
This is strange. Exactly same code works for me. What version of clearml are you using? What version is your server?
CostlyOstrich36 I do see the new "image" in the metric drop down, so something has changed - but there are no preview images there.
I have been using them for a while, they've always had autopreviews.
It isn't a bug, you have to add the previews manually through reporting. For example:
ds = Dataset.create(...) ds.add_files(...) ds.get_logger().report_media(...)
What if you add images to the dataset? Can you see them being previewed? @<1523701168822292480:profile|ExuberantBat52>
This is how I usually add visualization
#Report data preview
ds.get_logger().report_table(title="Data Sample", series="First Ten Rows", table_plot=data1[:10])
ds.upload()
ds.finalize()
How about when you view it in the datasets view? Also what version of clearml
package do you have?
Also when in this view, open developer tools (F12) and see what calls you get back for debug samples
CostlyOstrich36 Unfortunately that didn't helped 😞
Looping in @<1523703436166565888:profile|DeterminedCrab71> & @<1523701435869433856:profile|SmugDolphin23> for visibility
Might need to refresh page after opening dev tools 🙂
ProudElephant77 , can you please add a code snippet of what you did?