In the installed packages section it includes
pywin32 == 303
even though that is not in my requirements.txt.
So for some reason it is being detected (meaning your code base actually imports it in code)
But you can just remove it, either by manually editing the cloned Task (right click, reset, then you can edit the section), or via codeTask.ignore_requirements("pywin32") task = Task.init(...)
yall thought of everything. this fixed it! Having another issue now, but will post seperately
yes. i think the problem is that its trying to recreate the environment the task was spun up on - which was on a windows machine - on a linux ec2 instance
pywin32 isnt in my requirements file,
CloudySwallow27 whats the OS/env ?
(pywin32 is not in the direct requirements of the agent)
no 64 bit. but do you mean the PC where I am spinning the task up or the machine where I am running the task
ohh, could it be a 32bit version of python ?
the latter is an ec2 instance
and the agent fails to install on the ec2 machine ?
yes, on my windows machine I am running:cloned_task = Task.clone(source_task=base_task, name="Auto generated cloned task") Task.enqueue(cloned_task.id, queue_name='test_queue')
I see the task successfully start in the clearml server. In the installed packages section it includes pywin32 == 303
even though that is not in my requirements.txt.
In the results --> console section, I see the agent is running and trying to install all packages, but then stops at pywin32. Some lines from that output below:2022-03-24 11:27:25 task 1c810a6a9b6d42af93c7ffa1a188b08a pulled from 683574f13506440f91b5284107380943 by worker ip-172-31-40-218:0 2022-03-24 11:27:30 Current configuration (clearml_agent v1.1.2, location: /tmp/.clearml_agent.af2pyy2q.cfg): ... Successfully installed pip-20.1.1 ... ERROR: Could not find a version that satisfies the requirement pywin32==303 (from -r /tmp/cached-reqsnj14ni7v.txt (line 22)) (from versions: none) ERROR: No matching distribution found for pywin32==303 (from -r /tmp/cached-reqsnj14ni7v.txt (line 22)) clearml_agent: ERROR: Could not install task requirements!
So the agent installed okay. It's the specific Task that the agent is failing to create the environment for, correct?
if this is the case, what do you have in the "Installed Packages" section of the Task (see under the Execution tab)
is there a way to explicitly make it some install certain packages, or at least stick to the requirements.txt file rather than the actual environment
or at least stick to the requirements.txt file rather than the actual environment
You can also for it to log the requirements.txt withTask.force_requirements_env_freeze(requirements_file="requirements.txt") task = Task.init(...)