Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi, I Run 'Manually' On My Local Machine With No Errors. Then, I Clone The Completed Task And Enqueue It. I Get To Stage When 'Environment Setup Completed Successfully'. But Right After I Get An Error Related To 'Connect' Method - Task.Connect(Config.Mode

Hi,
I run 'manually' on my local machine with no errors.
Then, I clone the completed task and enqueue it.
I get to stage when 'Environment setup completed successfully'.
But right after I get an error related to 'connect' method -
task.connect(config.model,name='model params')
Which never occurred before.
when removing that line, and repeating the flow (run locally, clone, enqueue) I get error somewhere else. Feels like essential problem, enviroment maybe, not related to specific method.
How would you approach solving this? Tnx

  
  
Posted 10 months ago
Votes Newest

Answers 19


I'm assuming your dictionary is made from non basic types (like object of a sort)
What do you have inside this dict?

  
  
Posted 10 months ago

Hi @<1571308003204796416:profile|HollowPeacock58>
could you share the full log ?

  
  
Posted 10 months ago

Ok..so I should generally avoid connecting complex objects? I guess I would create a 'mini dictionary' with a subset of params, and connectvthis instead.

In theory it should always work, but this specific one fails on a very pythonic paradigm (see below)

from copy import copy
an_object = copy(object)

A good rule of thumb is to connect any object/dict that you want to track or change later

  
  
Posted 10 months ago

image

  
  
Posted 10 months ago

Just to be clear, regarding the task.connect I have no solution. I can't keep these line commented out. Tnx in advance

  
  
Posted 10 months ago

@<1571308003204796416:profile|HollowPeacock58> when do you mean by "debug mode"?

  
  
Posted 10 months ago

@<1571308003204796416:profile|HollowPeacock58> seems like an internal issue copying this object config.model
This is a complex object, and it seems that for some reason
None

As a workaround just do not connect this object. it seems you cannot pickle it / copy it (see GH issue)

  
  
Posted 10 months ago

Ok..so I should generally avoid connecting complex objects? I guess I would create a 'mini dictionary' with a subset of params, and connectvthis instead.

  
  
Posted 10 months ago

Hi, I rerun now after minor updates. Get similar error in the same part of code-
Traceback (most recent call last):
File "main.py", line 84, in <module>
task.connect(config.model,name='model params')
File "/home/rakefet/.clearml/venvs-builds/3.8/lib/python3.8/site-packages/clearml/task.py", line 1455, in connect
return method(mutable, name=name)
File "/home/rakefet/.clearml/venvs-builds/3.8/lib/python3.8/site-packages/clearml/task.py", line 3573, in _connect_dictionary
dictionary = nested_from_flat_dictionary(dictionary, flat_dict)
File "/home/rakefet/.clearml/venvs-builds/3.8/lib/python3.8/site-packages/clearml/utilities/proxy_object.py", line 216, in nested_from_flat_dictionary
org_dict = copy(a_dict)
File "/home/rakefet/.clearml/venvs-builds/3.8/lib/python3.8/copy.py", line 92, in copy
rv = reductor(4)
KeyError: 'getstate'

  
  
Posted 10 months ago

I don't see why the dictionary is special

  
  
Posted 10 months ago

from einops import rearrange, repeat
ModuleNotFoundError: No module named 'einops'

  
  
Posted 10 months ago

image

  
  
Posted 10 months ago

What about the second issue I had regarding unrecognized package?

  
  
Posted 10 months ago

After removing the task.connect lines, it encountered another error related to 'einops' that is not recognized. It does exist on my environment file but was not installed by the agent (according to what I see on 'Summary - installed python packages'. should I add this manually?

  
  
Posted 10 months ago

After removing the task.connect lines, it encountered another error related to 'einops' that is not recognized. It does exist on my environment file but was not installed by the agent (according to what I see on 'Summary - installed python packages'. should I add this manually?

  
  
Posted 10 months ago

Ok. Thanks. will try

  
  
Posted 10 months ago

ClearML results page: None
Traceback (most recent call last):
File "main.py", line 85, in <module>
task.connect(config.hparas,name='hyper params')
File "/home/rakefet/.clearml/venvs-builds/3.8/lib/python3.8/site-packages/clearml/task.py", line 1455, in connect
return method(mutable, name=name)
File "/home/rakefet/.clearml/venvs-builds/3.8/lib/python3.8/site-packages/clearml/task.py", line 3573, in _connect_dictionary
dictionary = nested_from_flat_dictionary(dictionary, flat_dict)
File "/home/rakefet/.clearml/venvs-builds/3.8/lib/python3.8/site-packages/clearml/utilities/proxy_object.py", line 216, in nested_from_flat_dictionary
org_dict = copy(a_dict)
File "/home/rakefet/.clearml/venvs-builds/3.8/lib/python3.8/copy.py", line 92, in copy
rv = reductor(4)
KeyError: 'getstate'

  
  
Posted 10 months ago

After removing the task.connect lines, it encountered another error related to 'einops' that is not recognized. It does exist on my environment file but was not installed by the agent (according to what I see on 'Summary - installed python packages'. should I add this manually?

Yes, I'm assuming this is a derivative package that is needed by one of your packages?

Task.add_requirements("einops")
task = Task.init(...)
  
  
Posted 10 months ago

Hi @<1571308003204796416:profile|HollowPeacock58> , do you have a self contained code snippet that reproduces this?

  
  
Posted 10 months ago
560 Views
19 Answers
10 months ago
10 months ago
Tags