Reputation
Badges 1
64 × Eureka!@<1523701070390366208:profile|CostlyOstrich36> am I doing anything wrong here?
@<1523701070390366208:profile|CostlyOstrich36>
from clearml import Task
from clearml.automation import HyperParameterOptimizer, UniformIntegerParameterRange, DiscreteParameterRange
task = Task.init(
project_name="examples",
task_name="HP optimizer",
task_type=Task.TaskTypes.optimizer,
reuse_last_task_id=False,
)
task.execute_remotely(queue_name="services")
an_optimizer = HyperParameterOptimizer(
base_task_id="c7618e30ff5c4955b4942971b410f72d",
...
Hi @<1523701070390366208:profile|CostlyOstrich36> ,
The idea is indeed to control the object via API, but in that particular case, if I don't want the seed to be specified by the API but just set it to be current timestamp.
Could you think of a better use?
The script is intended to be executed remotely.
Can I declare an absolute path in this case?
Why do you have this part? isn’t it the same code, the script entry point is auto detected ?
Because I don’t always run the script locally from it’s directory and I have additional modules in the same directory that I import.
Sure this will work
I’ll make sure to update it
AgitatedDove14
Yes, I'd like to point to a specific binary, which is in a conda environment.
(b.t.w how can I specify the python version on the Task?)
It didn't work either. Still same error.
conda command was already in PATH and the conda activate
is executed properly, but it prompts to run conda init
(i.e conda wasn't configures at that shell):
` You should consider upgrading via the '/usr/bin/python3 -m pip install --upgrade pip' command.
CommandNotFoundError: Your shell has not been properly configured to use 'conda activate'.
To initialize your shell, run
$ conda init <SHELL_NAME>
Currently supported shells are:
- ba...
Im afraid there's something with my account, since it won't login on other browser as well, but logging with a different email works
AgitatedDove14 ,
From the experiment’s console log:
` - boto3==1.16.2
- botocore==1.19.2 `
Thanks ExasperatedCrab78
AgitatedDove14 - attached
I did found this:
from clearml.backend_api.session.client import APIClient
client = APIClient()
client.events.get_task_metrics(tasks=['some_task_id'], event_type='log')
but it returns an empty 'metrics' object
@<1523701070390366208:profile|CostlyOstrich36>
Well, I doubt that it is the case in my situation.
Is there any API where I can get read the metrics per experiment?
SuccessfulKoala55
we are using the fileserver which is configured at clearml.conf to a path on a network drive (i.e the NAS) -files_server: file:///mnt/clearml_storage
Because we want all our data to be stored on premises.
/mnt/clearml_storage
is the mount point of the NAS on one linux machine.
On macos it would be /Volumes/clearml_storage,
On windows - //NAS/clearml_storage
SuccessfulKoala55
Is it a rare use case to use a NAS as the fileserver?
What would you suggest?
UnevenDolphin73 Thanks! Ill look into and reach out if needed
SuccessfulKoala55
Were using the community server
SuccessfulKoala55
I'm not sure I understand your suggestion
clearml
numpy
pandas
pycocotools
tqdm
boto3
torch
torchvision
bbox_utils
xmltodict
scikit-video
onnxruntime
flask
Its mounted automatically.
The local .ssh folder is copied to a temp folder which is mounted by the agent in the docker run command -Executing: ['docker', 'run', '-t', ......., '-v', '/tmp/clearml_agent.ssh.fuu4r8ta:/root/.ssh', .... , '--rm', 'nvidia/cuda:10.1-cudnn7-runtime-ubuntu18.04', ....]
Maybe I should understand better how this actually works.
It's not a rare use case to use conda environments, but install some packages using pip (when they're not available at any conda channel). Will that use case be supported on clearml?
AgitatedDove14 , here's the log
Yes.
Its kwcoco
This is my conda env export
:
name: clearml
channels:
- defaults
dependencies: - ca-certificates=2021.10.26=hecd8cb5_2
- certifi=2021.10.8=py39hecd8cb5_0
- libcxx=12.0.0=h2f01273_0
- libffi=3.3=hb1e8313_2
- ncurses=6.3=hca72f7f_2
- openssl=1.1.1l=h9ed2024_0
- pip=21.2.4=py39hecd8cb5_0
- python=3.9.7=h88f2d9e_1
- readline=8.1=h9ed2024_0
- setuptools=58.0.4=py39hecd8cb5_0
- sqlite=3.36.0=hce871da_0
- tk=8.6.11=h7bc2e8c_0
- tzdata=2021e=hda174b...
No. But this isn't the only package that was installd using pip inside a conda env.
Compare it with Pandas as an example - was installed using pip nad it's actually instaled inside the worker as well (using pip).
AgitatedDove14
It was installed by 'pip install kwcoco' while my conda env was active.
Not sure if it answers your question..