Might need to refresh page after opening dev tools 🙂
Looping in DeterminedCrab71 & SmugDolphin23 for visibility
I don't think datasets don't have visualization out of the box, you need to add these previews manually. Only HyperDatasets feature from the Scale & Enterprise versions truely visualizes all the data.
According to your code snippet there isn't any visualization add on top of the dataset
Above is the response for the events.debug_images
ExuberantBat52 , did you add debug samples in a similar fashion? What version of the clearml
sdk are you using? Also what server?
Actually, datasets should have an automatic preview...
How about when you view it in the datasets view? Also what version of clearml
package do you have?
This is how I usually add visualization
#Report data preview
ds.get_logger().report_table(title="Data Sample", series="First Ten Rows", table_plot=data1[:10])
ds.upload()
ds.finalize()
The above output is on the clearml community server
CostlyOstrich36 Do you have any idea how I could debug that?
CostlyOstrich36 Unfortunately that didn't helped 😞
CostlyOstrich36 The latest clearml package, installed these days - 1.9.0
The dataset view is also empty:
ProudElephant77 , can you please add a code snippet of what you did?
CostlyOstrich36 WebApp: 1.9.1-312 • Server: 1.9.1-312 • API: 2.23
CostlyOstrich36 I am facing the same issue:
{"meta":{"id":"90841d05dfb1431a8d9dfc6bfdb39f9e","trx":"90841d05dfb1431a8d9dfc6bfdb39f9e","endpoint":{"name":"events.debug_images","requested_version":"2.23","actual_version":"2.7"},"result_code":200,"result_subcode":0,"result_msg":"OK","error_stack":"","error_data":{}},"data":{"metrics":[]}}
` from clearml import Dataset
IMG_PATH = "/home/mfb/Temp/sample-ds/50-ok.jpg"
Create dataset and add sample image
ds = Dataset.create(dataset_name="Test", dataset_project="Dataset-Test")
ds.add_files(path=IMG_PATH)
ds.upload()
Add and report image
logger = ds.get_logger()
logger.report_image("image", "sample image", iteration=0, local_path=IMG_PATH)
logger.flush()
Finalize the dataset
ds.finalize() `
Also when in this view, open developer tools (F12) and see what calls you get back for debug samples
CostlyOstrich36 I do see the new "image" in the metric drop down, so something has changed - but there are no preview images there.
Please check what you get for events.debug_images
in network section of developer tools (F12) when trying to view the preview in the dataset
So I added the snippet above to the code,
and now the preview for the first 10 rows shows up. However, the automatic preview is still not working.
This is strange. Exactly same code works for me. What version of clearml are you using? What version is your server?
Can you please paste the response from events.debug_images
?
Yes, I am using a virtualenv that has pandas and clearml installed.
I have been using them for a while, they've always had autopreviews.