@<1523701070390366208:profile|CostlyOstrich36> Hi John, I have posted that in the screenshot above. Isn't that what you meant?
How about when you view it in the datasets view? Also what version of clearml
package do you have?
Actually, datasets should have an automatic preview...
@<1523701168822292480:profile|ExuberantBat52> , did you add debug samples in a similar fashion? What version of the clearml
sdk are you using? Also what server?
` from clearml import Dataset
IMG_PATH = "/home/mfb/Temp/sample-ds/50-ok.jpg"
Create dataset and add sample image
ds = Dataset.create(dataset_name="Test", dataset_project="Dataset-Test")
ds.add_files(path=IMG_PATH)
ds.upload()
Add and report image
logger = ds.get_logger()
logger.report_image("image", "sample image", iteration=0, local_path=IMG_PATH)
logger.flush()
Finalize the dataset
ds.finalize() `
ProudElephant77 , can you please add a code snippet of what you did?
This is strange. Exactly same code works for me. What version of clearml are you using? What version is your server?
What if you add images to the dataset? Can you see them being previewed? @<1523701168822292480:profile|ExuberantBat52>
I have been using them for a while, they've always had autopreviews.
Looping in @<1523703436166565888:profile|DeterminedCrab71> & @<1523701435869433856:profile|SmugDolphin23> for visibility
The thing is, even on the community server, not all the datasets have automatic previews. So for the same code/dataset, some of the runs have previews and some of them don't.
@<1523701070390366208:profile|CostlyOstrich36> It looks like this:
Above is the response for the events.debug_images
@<1523701168822292480:profile|ExuberantBat52> Do you have pandas installed on your machine?
So I added the snippet above to the code,
and now the preview for the first 10 rows shows up. However, the automatic preview is still not working.
Please check what you get for events.debug_images
in network section of developer tools (F12) when trying to view the preview in the dataset
Can you please paste the response from events.debug_images
?
This is how I usually add visualization
#Report data preview
ds.get_logger().report_table(title="Data Sample", series="First Ten Rows", table_plot=data1[:10])
ds.upload()
ds.finalize()
CostlyOstrich36 I do see the new "image" in the metric drop down, so something has changed - but there are no preview images there.
I am using the latest version clearml server
and I am using version 1.9.1
for the sdk.
Here is the code that I am currently using:
if __name__ == "__main__":
# create clearml data processing task
dataset = Dataset.create(
dataset_name="palmer_penguins",
dataset_project="palmer penguins",
dataset_tags=["raw"]
)
dataset_path = "data/raw/penguins.csv"
# add the downloaded files to the current dataset
dataset.add_files(path=dataset_path)
# upload data to clearml server
dataset.upload(verbose=True)
# close the dataset
dataset.finalize(verbose=True)
This is a simple dummy example that I use for testing deployments of clearml server
Here is the output that I would expect:
CostlyOstrich36 The latest clearml package, installed these days - 1.9.0
The dataset view is also empty:
Might need to refresh page after opening dev tools 🙂
It isn't a bug, you have to add the previews manually through reporting. For example:
ds = Dataset.create(...) ds.add_files(...) ds.get_logger().report_media(...)
CostlyOstrich36 WebApp: 1.9.1-312 • Server: 1.9.1-312 • API: 2.23
Also when in this view, open developer tools (F12) and see what calls you get back for debug samples