@<1523701070390366208:profile|CostlyOstrich36> Any suggestions?

I encounter this unstable behavior also with other scenarios. For example, with a function step which just tries to get an existing dataset. for the line:

dataset = Dataset.get(dataset_project='test_pipelines', dataset_name=dataset_name, only_published=True)

I sometimes get:

Traceback (most recent call last):
  File "/tmp/tmpnndxzv32.py", line 66, in get_dataset
    dataset = Dataset.get(dataset_project='test_pipelines', dataset_name=dataset_name, only_published=True)
              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/conda/lib/python3.11/site-packages/clearml/datasets/dataset.py", line 1782, in get
    raise ValueError(
ValueError: Could not find Dataset project/name/version ('test_pipelines', 'test', None)

But in some runs it finds the dataset.