Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
I Have A Function That Runs Normally. Its Job Is To Monitor A Specific Folder, And When I Execute The Script Locally It Works Fine. When I Make A Taskscheduler And Pass That Function To The Scheduler, Then Run Remotely, Then I Get An Error: Clearml Resul

I have a function that runs normally. Its job is to monitor a specific folder, and when I execute the script locally it works fine. When I make a TaskScheduler and pass that function to the scheduler, then run remotely, then I get an error:

ClearML results page: http://apiserver:8080/projects/334bb4c9972c4abf9eade0957d1fda07/experiments/a46716c723a743c59dcc885841631fe3/output/log
Syncing scheduler
Failed deserializing configuration: the JSON object must be str, bytes or bytearray, not 'NoneType'
Syncing scheduler
Failed deserializing configuration: the JSON object must be str, bytes or bytearray, not 'NoneType'
Waiting for next run, sleeping for 1.00 minutes, until next sync.

  
  
Posted 3 years ago
Votes Newest

Answers 5


VexedCat68 , are you running the scheduler from the same machine? Where is the folder located?

  
  
Posted 3 years ago

Additional Error info

Launching job: ScheduleJob(name='Watch Checkbox Detector Buffer Folder', base_task_id='', base_function=<function watch_folder at 0x7f6e308b6840>, queue=None, target_project=None, single_instance=False, task_parameters=None, task_overrides=None, clone_task=True, _executed_instances=['140111227815680', '140111227815680', '140111227815680', '140111227815680'], execution_limit_hours=None, recurring=True, starting_time=datetime.datetime(2021, 11, 25, 9, 45, 41, 175873), minute=1, hour=None, day=None, weekdays=None, month=None, year=None, _next_run=datetime.datetime(2021, 11, 25, 9, 50, 41, 388037), _execution_timeout=None, _last_executed=datetime.datetime(2021, 11, 25, 9, 49, 41, 388037))
Scheduling Job 'Watch Checkbox Detector Buffer Folder', Task '<function watch_folder at 0x7f6e308b6840>' on background thread
Exception in thread Thread-6:
Traceback (most recent call last):
File "/usr/lib/python3.6/threading.py", line 916, in _bootstrap_inner
self.run()
File "/usr/lib/python3.6/threading.py", line 864, in run
self._target(*self._args, **self._kwargs)
File "/root/.clearml/venvs-builds/3.6/code/data_publisher_scheduler.py", line 22, in watch_folder
classes = os.listdir(folder)
FileNotFoundError: [Errno 2] No such file or directory: '/mnt/mlops/MLOps/ClearML/OCR/OCR - project/Data Repository/Checbox Detector/buffer'

  
  
Posted 3 years ago

I'm using start for now.

  
  
Posted 3 years ago

Should I not run the scheduler remotely if I'm monitoring a local folder?

  
  
Posted 3 years ago

Set up is on a single machine, I have a nas mounted where I'm watching a folder, if there are sufficient images, it should publish the data but since I was using start_remotely, the code was running somewhere else and couldn't access folder.

  
  
Posted 3 years ago
1K Views
5 Answers
3 years ago
one year ago
Tags