Hi Community, I Might Have A Misunderstanding Of The Use Of Task.Connect Method. It Seems Like The Object I Connect Is Immutable, While It Should Be Mutable.

Answered

Hi community,
I might have a misunderstanding of the use of task.connect method.
It seems like the object I connect is immutable, while it should be mutable.

import time
import clearml

args = {"seed": None, "batch_size": 32}

# ClearML stuff
clearml.Task.add_requirements('clearml')
tsk = clearml.Task.init(project_name="combo_model/train", task_name='test', reuse_last_task_id=True)
tsk.execute_remotely(queue_name='rtx3090')
args = tsk.connect(args)

args['batch_size'] = 64
print("Pre modification ", args)
if args['seed'] is None:
    print("No seed provided, using current time as seed")
    args['seed'] = int(time.time())

print("Post modification ", args)

Using this mini test, the dict args doesn't seem to be modified in the last few rows.
The output is
Pre modification {'seed': None, 'batch_size': 32}
No seed provided, using current time as seed
Post modification {'seed': None, 'batch_size': 32}
Any idea someone?

  				
Posted 
	9 months ago

					More
				  		
  Report
		
					CrookedWalrus33
				
					0
					 × 1

Votes Newest

Answers 3

Hi @<1523703961872240640:profile|CrookedWalrus33> ! The way connect works by default is:
While running locally, all the values (and value changes) of a connected object are sent to the backend.
While running remotely (in your case here), all the values sent in the local run are fetched from the backend and the connected dictionary is populated with these values. The values are readonly, chaning them will not have any effect.
To avoid this behaviour, you could use the ignore_remote_overrides=True argument in connect , which will make the connect behave as if it is running locally.

  				
Posted 
	9 months ago

					More
				  		
  Report
		
					SmugDolphin23
				
					0

Hi @<1523701070390366208:profile|CostlyOstrich36> ,
The idea is indeed to control the object via API, but in that particular case, if I don't want the seed to be specified by the API but just set it to be current timestamp.
Could you think of a better use?

  				
Posted 
	9 months ago

					More
				  		
  Report
		
					CrookedWalrus33
				
					0
					 × 1

Hi @<1523703961872240640:profile|CrookedWalrus33> , I think by "mutable" it means that the object itself is mutable when connecting.

I'm curious, what is your use case that you want to change the values in the code itself? The intended usage is to connect the config object and then control it via the webUI / API

  				
Posted 
	9 months ago

					More
				  		
  Report
		
					CostlyOstrich36
				
					0

Write your answer

742 Views

3 Answers

9 months ago