What if you add images to the dataset? Can you see them being previewed? @<1523701168822292480:profile|ExuberantBat52>

Yes, I am using a virtualenv that has pandas and clearml installed.

@<1523701168822292480:profile|ExuberantBat52> Do you have pandas installed on your machine?

My server is hosted on AWS Fargate

So I added the snippet above to the code,
and now the preview for the first 10 rows shows up. However, the automatic preview is still not working.

This is how I usually add visualization

#Report data preview
ds.get_logger().report_table(title="Data Sample", series="First Ten Rows", table_plot=data1[:10])
ds.upload()
ds.finalize()

Hmm my bad, I wasn't aware of this 🙂

22.04

I am currently running the scripts on WSL ubuntu

I have been using them for a while, they've always had autopreviews.

What OS are you running the scripts on, Abed?

Actually, datasets should have an automatic preview...

I don't think datasets don't have visualization out of the box, you need to add these previews manually. Only HyperDatasets feature from the Scale & Enterprise versions truely visualizes all the data.

According to your code snippet there isn't any visualization add on top of the dataset

The thing is, even on the community server, not all the datasets have automatic previews. So for the same code/dataset, some of the runs have previews and some of them don't.

The above output is on the clearml community server

I am using the latest version clearml server and I am using version 1.9.1 for the sdk.

Here is the code that I am currently using:

if __name__ == "__main__":
    # create clearml data processing task
    dataset = Dataset.create(
        dataset_name="palmer_penguins",
        dataset_project="palmer penguins",
        dataset_tags=["raw"]
    )
    dataset_path = "data/raw/penguins.csv"
    # add the downloaded files to the current dataset
    dataset.add_files(path=dataset_path)
    # upload data to clearml server
    dataset.upload(verbose=True)
    # close the dataset
    dataset.finalize(verbose=True)

This is a simple dummy example that I use for testing deployments of clearml server

Here is the output that I would expect:

@<1523701168822292480:profile|ExuberantBat52> , did you add debug samples in a similar fashion? What version of the clearml sdk are you using? Also what server?

Looping in @<1523703436166565888:profile|DeterminedCrab71> & @<1523701435869433856:profile|SmugDolphin23> for visibility

Above is the response for the events.debug_images

@<1523701070390366208:profile|CostlyOstrich36> I am facing the same issue:

{"meta":{"id":"90841d05dfb1431a8d9dfc6bfdb39f9e","trx":"90841d05dfb1431a8d9dfc6bfdb39f9e","endpoint":{"name":"events.debug_images","requested_version":"2.23","actual_version":"2.7"},"result_code":200,"result_subcode":0,"result_msg":"OK","error_stack":"","error_data":{}},"data":{"metrics":[]}}

@<1523701070390366208:profile|CostlyOstrich36> Hi John, I have posted that in the screenshot above. Isn't that what you meant?

Can you please paste the response from events.debug_images ?

And here the same in Chrome:

@<1523701070390366208:profile|CostlyOstrich36> It looks like this:

Might need to refresh page after opening dev tools 🙂

Please check what you get for events.debug_images in network section of developer tools (F12) when trying to view the preview in the dataset

CostlyOstrich36 The latest clearml package, installed these days - 1.9.0

The dataset view is also empty:

Also when in this view, open developer tools (F12) and see what calls you get back for debug samples

How about when you view it in the datasets view? Also what version of clearml package do you have?

CostlyOstrich36