Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
TrickyFox41
Moderator
8 Questions, 37 Answers
  Active since 10 January 2023
  Last activity one year ago

Reputation

0

Badges 1

37 × Eureka!
0 Votes
5 Answers
510 Views
0 Votes 5 Answers 510 Views
Hi, When i create a task using clearml-task specifying some hydra arguments the task correclty shows up in the web app with its arguments. But when i enqueue...
one year ago
0 Votes
16 Answers
522 Views
0 Votes 16 Answers 522 Views
Anyone experiencing this with a custom S3 bucket in the debug samples? The S3 configuration in the webapp is correct
one year ago
0 Votes
0 Answers
471 Views
0 Votes 0 Answers 471 Views
I have initialized the Task as so task = Task.init( project_name=cfg.clearml.project, task_name=cfg.clearml.task, tags=cfg.clearml.tags, output_uri=f" /", )
one year ago
0 Votes
1 Answers
483 Views
0 Votes 1 Answers 483 Views
Hi again everybody, is there a way to cache the docker containers used by the agents? as far as i understood every time it spawns a new container with a shar...
one year ago
0 Votes
20 Answers
472 Views
0 Votes 20 Answers 472 Views
Hey since Hydra does not work with clearml-task does it work with the hyperparameter optimization?
one year ago
0 Votes
0 Answers
503 Views
0 Votes 0 Answers 503 Views
one year ago
0 Votes
8 Answers
542 Views
0 Votes 8 Answers 542 Views
Hi everybody, when using a custom S3 bucket (a minio one) the webapp cant load the debug samples. It displays "Unable to load image". When checking the devel...
one year ago
0 Votes
6 Answers
600 Views
0 Votes 6 Answers 600 Views
Hey! i was trying to use my minio instance for artifacts storage but there is not way of making it work. Maybe i am missing something. This is my clearml.con...
aws
one year ago
0 Anyone Experiencing This With A Custom S3 Bucket In The Debug Samples? The S3 Configuration In The Webapp Is Correct

Ok i did some investigations and the bug appear from version 1.8.0. In version 1.7.0 there is not. I open a issue in GitHub

one year ago
0 Anyone Experiencing This With A Custom S3 Bucket In The Debug Samples? The S3 Configuration In The Webapp Is Correct

I also save the models in the s3 bucket using output_uri=cfg.clearml.output_uri, in the Task.init

one year ago
0 Hey Since Hydra Does Not Work With

--args param.ovveride=value does not work with clearml-task

one year ago
0 Hey Since Hydra Does Not Work With

I tried like that clearml-task --script train.py --args overrides="log.clearml=True train.epochs=200 clearml.save=True" --project mornag-plain-dense --name mornag-plain-dense-training --queue tesla-t4 --skip-task-init

one year ago
0 Hey Since Hydra Does Not Work With

same result. in print(cfg) there are no overrides

one year ago
0 Hey Since Hydra Does Not Work With

Yes the task is running on a remote agent with the --docker flag
this is the config on the machine(s) running the agent
`
agent {
venvs_cache: {
max_entries: 50
free_space_threshold_gb: -1
path: ~/.clearml/venvs-cache
}
extra_docker_arguments: [
"--network", "host",
"-v", "/home/ubuntu/.ssh:/root/.ssh:ro",
"-v", "/home/ubuntu/.cache:/root/.cache",
]

docker_internal_mounts {
    sdk_cache: "/clearml_agent_cache"

...

one year ago
0 Hey Since Hydra Does Not Work With

By the way, since if i create the task locally, reset it and enqueue it, it works. This is the workaround that i'm using right now

one year ago
0 Hi, When I Create A Task Using

This is the full print(cfg)
` {'dataset': {'name': '<my-dataset-name>', 'path': '', 'target_shape': [128, 128]}, 'model': 'unet', 'models': {'unet': {'dim': 8, 'dim_mults': [1, 2, 4], 'num_blocks_per_stage': [2, 2, 2], 'num_self_attn_per_stage': [0, 0, 1], 'nested_unet_depths': [0, 0, 0], 'nested_unet_dim': 16, 'use_convnext': False, 'resnet_groups': 2, 'consolidate_upsample_fmaps': True, 'weight_standardize': False, 'attn_heads': 2, 'attn_dim_head': 16}}, 'train': {'accelerator': 'auto...

one year ago
0 Anyone Experiencing This With A Custom S3 Bucket In The Debug Samples? The S3 Configuration In The Webapp Is Correct

I specified the upload destination in the logger. Logger.current_logger().set_default_upload_destination(cfg.clearml.media_uri) . Yes Minio with no special config. The s3 config is in the clearml.conf

one year ago
0 Hey Since Hydra Does Not Work With

No luck with --args overrides="['dataset.path=abcd']"

one year ago
0 Hey Since Hydra Does Not Work With

AgitatedDove14 Yes exactly!

one year ago
0 Hi, When I Create A Task Using

When enqueued the configuration tab still shows the correct arguments

one year ago
0 Hey Since Hydra Does Not Work With

i printed cfg in the script and the config has not been overwritten 😢

one year ago
0 Anyone Experiencing This With A Custom S3 Bucket In The Debug Samples? The S3 Configuration In The Webapp Is Correct

The debug samples are correctly uploaded in the bucket (is a minio bucket) i can see them from the minio webapp. I have used logger.report_image

one year ago
0 Hey! I Was Trying To Use My Minio Instance For Artifacts Storage But There Is Not Way Of Making It Work. Maybe I Am Missing Something. This Is My Clearml.Conf Everything Else Is Working Fine.

The error is
2022-11-28 14:40:17,099 - clearml.storage - ERROR - Failed creating storage object Reason: Missing key and secret for S3 storage access ( )

one year ago
0 Hey! I Was Trying To Use My Minio Instance For Artifacts Storage But There Is Not Way Of Making It Work. Maybe I Am Missing Something. This Is My Clearml.Conf Everything Else Is Working Fine.

if i print config_list from def from_config(cls, s3_configuration): in file bucket_config.py line 121 i get
{'key': '', 'secret': '', 'region': '', 'multipart': True, 'use_credentials_chain': False, 'bucket': 'clearml', 'host': 's3.myhost.tld:443', 'token': '', 'extra_args': ConfigTree()}

one year ago
one year ago
Show more results compactanswers