Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
CooperativeFox72
Moderator
11 Questions, 91 Answers
  Active since 10 January 2023
  Last activity one year ago

Reputation

0

Badges 1

91 × Eureka!
0 Votes
17 Answers
455 Views
0 Votes 17 Answers 455 Views
Hi again, I tried to upgrade Trains package to 15.1 from 13.1 that I was using for a while.. After the upgrade my code stuck when trying to use "Pool" (from ...
3 years ago
0 Votes
30 Answers
495 Views
0 Votes 30 Answers 495 Views
Hi all, I am starting to use clearml-agent. run it with clearml-agent daemon --foreground --gpus 3 --queue default --docker MyDockerImage:v0then I enqueued n...
3 years ago
0 Votes
22 Answers
509 Views
0 Votes 22 Answers 509 Views
Hi all, I have a trains-server (self-host) on a EC2 machine. The version of it is older then 0.16. I like to move to ClearML-server on different machine but ...
3 years ago
0 Votes
10 Answers
462 Views
0 Votes 10 Answers 462 Views
Hi all 🙂 I have a question regarding task.connect_configuration() . Does it possible to update the file on the server when running remotely or locally? for ...
3 years ago
0 Votes
6 Answers
579 Views
0 Votes 6 Answers 579 Views
Hi all, I think their is a UI bug. When trying to add experiment to compare:
3 years ago
0 Votes
5 Answers
474 Views
0 Votes 5 Answers 474 Views
Hi, I upgraded the ClearML client to 1.0.5 and now I am getting an upload log message: ... 2021-08-12 17:47:59,188 - clearml.storage - INFO - Uploading: 150....
2 years ago
0 Votes
17 Answers
483 Views
0 Votes 17 Answers 483 Views
Hi, I am new here, can I ask question on trains-server also?
3 years ago
0 Votes
6 Answers
457 Views
0 Votes 6 Answers 457 Views
Hi all 🙂 , There is a way to freeze the iteration monitoring? I like to download my data/model at the start of my code, but it takes a while and I am gettin...
2 years ago
0 Votes
12 Answers
485 Views
0 Votes 12 Answers 485 Views
Hi, Another question There is a way to know if a job is running locally or remotely? Like execute_remotely knows ... > Note If the > task > is running remote...
3 years ago
0 Votes
30 Answers
500 Views
0 Votes 30 Answers 500 Views
Hi all, I like to upgrade trains-server:0.16.1 to clearml-server:0.17 In the https://github.com/allegroai/clearml-server#upgrading- the process looks the sam...
3 years ago
0 Votes
20 Answers
500 Views
0 Votes 20 Answers 500 Views
Hey, I am trying to move the fileserver to S3. As here: https://github.com/allegroai/trains-server/issues/35 I update the trains.conf with my s3 bucket and t...
3 years ago
0 Hi All, I Like To Upgrade

the index creation:
[ec2-user@ip-172-31-26-41 ~]$ sudo docker exec -it clearml-mongo /bin/bash root@3fc365193ed0:/# mongo MongoDB shell version v3.6.5 connecting to: mongodb://127.0.0.1:27017 MongoDB server version: 3.6.5 Welcome to the MongoDB shell. For interactive help, type "help". For more comprehensive documentation, see Questions? Try the support group `
Server has startup warnings:
2021-01-25T05:58:37.309+0000 I CONTROL [initandlisten]
2021-01-25T05:58:37.309+0000 I C...

3 years ago
0 Hey, I Am Trying To Move The Fileserver To S3. As Here:

Hi SuccessfulKoala55 , yes for now I will like to start moving what inside the /opt/trains/data/fileserver..
because as I understand the logs and graphs are saved in elastic so I think it will not be easy to move them as well right?

3 years ago
0 Hey, I Am Trying To Move The Fileserver To S3. As Here:

Thanks for the reply,
I saw that it prefer to change the fileserver in trains.conf to s3://XXX
So, I changed this as I wrote before.

3 years ago
0 Hey, I Am Trying To Move The Fileserver To S3. As Here:

If I will mount the S3 bucket to the trains-server and link the mount to /opt/trains/data/fileserver does it will work?

3 years ago
0 Hi All, I Like To Upgrade

I did it and still getting the same error 😥

3 years ago
0 Hi All, I Like To Upgrade

SuccessfulKoala55 and AppetizingMouse58 Thanks you very much!!

I have a future question:
Does this fix should harm in future cleraml-server upgrade?
Or what the best practice to upgrade after doing it?

3 years ago
0 Hi Again, I Tried To Upgrade Trains Package To 15.1 From 13.1 That I Was Using For A While.. After The Upgrade My Code Stuck When Trying To Use "Pool" (From Multiprocessing Import Pool) The Code Snip:

Thanks AgitatedDove14 ,
I need to check with my boss that it is OK to share more code, will let you know..

But I will give 0.16 a try when it will release.
🙏

3 years ago
0 Hi Again, I Tried To Upgrade Trains Package To 15.1 From 13.1 That I Was Using For A While.. After The Upgrade My Code Stuck When Trying To Use "Pool" (From Multiprocessing Import Pool) The Code Snip:

I reproduced the stuck with this code..
But for now only with my env , when I tried to create new env only with the packages that this code needed it wont stuck.
So maybe the problem is conflict between packages?

3 years ago
3 years ago
0 Hi All, I Like To Upgrade

does it ok that it looks for files in /opt/trains ? since we move all to /opt/clearml no?
File "/opt/trains/apiserver/mongo/initialize/migration.py"

3 years ago
0 Hi All

Thanks for the quick replay.
This will set more time before the timeout right?

Maybe there is a way to do something like:
task.freeze_monitor() download() task.defrost_monitor()

2 years ago
0 Hi All

I am sure you add this timeout for a reason.

Probably since increasing the timeout can affect other functionality. .

Am I wrong?

2 years ago
0 Hi All

OK thanks for the answer.. I will use
task.set_resource_monitor_iteration_timeout(seconds_from_start=1800)as you suggested for now..

If you will add something like I suggest can you notify me?

2 years ago
0 Hey, I Am Trying To Move The Fileserver To S3. As Here:

Does it still work if I will keep trains.conf like this, and mount the S3 also?

3 years ago
0 Hi All

Hi SuccessfulKoala55 and AgitatedDove14 ,
Thanks for the quick replay.

I'm not sure I understand your use-case - do you always want to change the contents of the file in your code? Why not change it before connecting?

Changing the file before the connect will make sense only when I am running locally and the file exists. Remotely I must get the file with connect_configuration(path, name=name) before I am reading it.

"local_path" is ignored, path is a temp file, and the c...

3 years ago
0 Hi All

I tried you solution but since my path is to a YAML file,
and task.set_configuration_object(name=name, config_taxt=my_params) upload this not in the same format task.connect_configuration(path, name=name) it not working for me 😞
(even when I am using config_type='yaml' )

3 years ago
0 Hi All

I tried without yaml.dump(my_params_dict) will try with it..
so the file was not the same as the connect_configuration uploaded
Thanks

3 years ago
0 Hi All, I Have A

it stuck on Creating the backup file: /opt/trains/data/elastic_5.tar.gz

3 years ago
0 Hey, I Am Trying To Move The Fileserver To S3. As Here:

SuccessfulKoala55 Thanks 🙏 I will give it a try tomorrow 🙂

3 years ago
0 Hi All, I Have A

Hi AppetizingMouse58 , I had around 200GB when I started the migration now I have 169GB/
And yes, It looks it is growing was 9.4GB and now 9.5G

3 years ago
0 Hi All, I Like To Upgrade

hope this is better

3 years ago
0 Hi All, I Have A

how long? 😅
I am now stuck in
Copying index events-training_stats_scalar-d1bd92a3b039400cbafc60a7a5b1e52b
for more then 40 min 😥

3 years ago
0 Hi All, I Have A

yes it looks like this.. I just wanted to understand if it is should be so slow.. or I did something wrong

3 years ago
0 Hi All, I Have A

the elastic folder is around 30GB

3 years ago
3 years ago
Show more results compactanswers