Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi, When I Use Task.Get_Logger().Report_Table, I Go The Ui After The Experiment Finishes And I Download The Table (Under Results > Plots), It Gives Me A Json File. How Can I Use It? It Seems To Follow A Structure Specific To Clearml, How Can I For Example

Hi, when I use task.get_logger().report_table, I go the UI after the experiment finishes and I download the table (under RESULTS > PLOTS), it gives me a json file. How can I use it? It seems to follow a structure specific to clearml, how can I for example convert it back to a pandas dataframe?

  
  
Posted 3 years ago
Votes Newest

Answers 14


cool, thanks AgitatedDove14 !

  
  
Posted 3 years ago

I am doing:
try: score = get_score_for_task(subtask) except: score = pd.NA finally: df_scores = df_scores.append(dict(task=subtask.id, score=score, ignore_index=True) task.upload_artifact("metric_summary", df_scores)

  
  
Posted 3 years ago

nothing wrong from ClearML side 🙂

  
  
Posted 3 years ago

So I want to be able to visualise it quickly as a table in the UI and be able to download it as a dataframe, which of report_media or artifact is better?

  
  
Posted 3 years ago

mmmh there is no closing of the task happening at that point. Note that just before the task.upload_artifact, I call task.logger.report_table("Metric summary", "Metric summary", 0, df_scores) , if that matters

  
  
Posted 3 years ago

It seems to follow a structure specific to clearml,

Actually plotly.js 🙂

  
  
Posted 3 years ago

how can I for example convert it back to a pandas dataframe?

You can always report csv file with report_media as well, or if this is not for debugging maybe an artifact ?

  
  
Posted 3 years ago

haha my bad i found the error

  
  
Posted 3 years ago

artifact I guess

  
  
Posted 3 years ago

I have no idea what's going on

  
  
Posted 3 years ago

Are you trying to upload an artifact post execution ?

  
  
Posted 3 years ago

ValueError('Task object can only be updated if created or in_progress')

It seems the task is not "running" hence the error, could that be

  
  
Posted 3 years ago

I am trying to upload an artifact during the execution

  
  
Posted 3 years ago

Ok, I got the following error when uploading the table as an artifact:
ValueError('Task object can only be updated if created or in_progress')

  
  
Posted 3 years ago
1K Views
14 Answers
3 years ago
one year ago
Tags
Similar posts