Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi Everyone, I'M Trying To Deploy My First Clearml Pipeline With A Configuration For Logging And Caching To Avoid Repeating Already Computed Steps. However, The Caching Doesn'T Seem To Be Working Correctly. Despite Not Changing The Configuration, The Firs

Hi everyone,
I'm trying to deploy my first ClearML pipeline with a configuration for logging and caching to avoid repeating already computed steps. However, the caching doesn't seem to be working correctly. Despite not changing the configuration, the first step runs every time.
I've attached two images showing the pipeline executions. Both executions used the same configuration:

  • In the first execution, the stage_data_retrieving step took 44 seconds.
  • In the second execution, the same stage_data_retrieving step ran again, indicating that the caching did not work for this step.
  • The second step, stage_data_preprocessing , was cached correctly and did not re-run but is based on the first step so it's kind of stupid.I suspect the issue might be related to the global_config and processors parameters. These parameters are dictionaries of specific configurations (dict of dict) that are the same but might not be taken into account properly by the caching mechanism.
    Can anyone help with this issue? I use the pipeline and call my step from functions !
    Thanks!
    image
    image
  
  
Posted 4 months ago
Votes Newest

Answers


Hi @<1730396272990359552:profile|CluelessMouse37>

However, the caching doesn't seem to be working correctly. Despite not changing the configuration, the first step runs every time.

How are you creating the cached component?
is this a standalone script or a git repo link?

These parameters are dictionaries of specific configurations (dict of dict) that are the same but might not be taken into account properly by the caching mechanism.

hmm for the component to be cached (or reused specifically) the arguments passed have to be exactly the same. Is this the case here ?

  
  
Posted 4 months ago
363 Views
1 Answer
4 months ago
4 months ago
Tags
Similar posts