Reputation
Badges 1
89 × Eureka!In a cloned run with new container ultralytics/ultralytics:latest
I get this error:
clearml_agent: ERROR: Could not install task requirements!
Command '['/root/.clearml/venvs-builds/3.10/bin/python', '-m', 'pip', '--disable-pip-version-check', 'install', '-r', '/tmp/cached-reqs7171xfem.txt', '--extra-index-url', '
', '--extra-index-url', '
returned non-zero exit status 1.
Hi @<1523701070390366208:profile|CostlyOstrich36> I am not specifying a version 🙂
What I dont understand is how to tell clearml to install this version of pytorch and torchvision, with cu118
This has been resolved now! Thank you for your help @<1523701070390366208:profile|CostlyOstrich36>
I can install on the server with this command
As I get a bunch of these warnings in both of the clones that failed
Setting agent.venvs_cache
path
back to ~/.clearml/venvs-cache
seems to have done the trick!
It was pointing to a network drive before to avoid the local directory filling up
The original run completes successfully, it's only the runs cloned from the GUI which fail
Resetting and enqueuing task which has built successfully also fails 😞
Trying this:
clearml_dataset = Dataset.get(
dataset_id=config.get("dataset_id"), alias=config.get("dataset_alias")
)
dataset_dir = clearml_dataset.get_local_copy()
destination_dir = os.path.join("/datasets", os.path.basename(dataset_dir))
shutil.copytree(dataset_dir, destination_dir)
results = model.train(
data=destination_dir + "/data.yaml", epochs=config.get("epochs"), device=0
)
@<1717350332247314432:profile|WittySeal70> what's strange is I can import the package in the docker container when I run it outside of clearML
How are you getting:
beautifulsoup4 @ file:///croot/beautifulsoup4-split_1681493039619/work
This comes with the docker image ultralytics/ultralytics:latest
Thank you so much for your help @<1523701205467926528:profile|AgitatedDove14> !
Thanks @<1523701205467926528:profile|AgitatedDove14> , will take a look
Container nvcr.io/nvidia/pytorch:22.12-py3
agent.package_manager.pip_version=""
@<1523701205467926528:profile|AgitatedDove14> if we go with the ultralytics case:
INSTALLED PACKAGES for working manual execution
absl-py==2.1.0
albucore==0.0.13
albumentations==1.4.14
anaconda-anon-usage @ file:///croot/anaconda-anon-usage_1710965072196/work
annotated-types==0.7.0
anyio==4.4.0
archspec @ file:///croot/archspec_1709217642129/work
astor==0.8.1
asttokens @ file:///opt/conda/conda-bld/asttokens_1646925590279/work
astunparse==1.6.3
attrs @ file:///croot/attrs_169571782329...
Yes, sure!
Hey, yes I can see machine statistics on the experiments themselves
Hey yes it's self deployed
Looks okay there
WebApp: 1.16.0-494 • Server: 1.16.0-494 • API: 2.30
Final answer was
docker="ultralytics/ultralytics:latest",
docker_args=["--network=host", "--ipc=host"],
It's hanging at
Installing collected packages: zipp, importlib-resources, rpds-py, pkgutil-resolve-name, attrs, referencing, jsonschema-specifications, jsonschema, certifi, urllib3, idna, charset-normalizer, requests, pyparsing, PyYAML, six, pathlib2, orderedmultidict, furl, pyjwt, psutil, python-dateutil, platformdirs, distlib, filelock, virtualenv, clearml-agent
Successfully installed PyYAML-6.0.2 attrs-23.2.0 certifi-2024.7.4 charset-normalizer-3.3.2 clearml-agent-1.8.1 distlib-0.3....