Thanks, its works!

also i found, i cannot delete project, even the project is show empty experiment.

Hi AgitatedDove14 ,
right now i can delete, i set configuration to see hidden project/file on UI, and it show task related (e.g pipeline, dataset) on that project. but yeah, every time i make project with subproject inside, there is [undefined] there. i create project using code and UI, the result is same.

this is my docker-compose conf. i change all port 8XXX to 7XXX nad also change /opt/cleaml to /mnt/hdd_2/clearml.
` version: "3.6"
services:

apiserver:
command:
- apiserver
...

` {"meta":{"id":"17c6e609ace54bf8bfdf3113c39fd470","trx":"17c6e609ace54bf8bfdf3113c39fd470","endpoint":{"name":"projects.get_all_ex","requested_version":"2.20","actual_version":"1.0"},"result_code":200,"result_subcode":0,"result_msg":"OK","error_stack":"","error_data":{}},"data":{"projects":[{"id":"75d04598197a445ebef533814022c58d","company":{"id":"d1bd92a3b039400cbafc60a7a5b1e52b"},"user":{"id":"a174c4e36b0446a7b3b5dd1ff5261962"},"name":"ex-1","basename":"ex-1","description":"","created":"20...

Thanks guys, i will try to learn that first. i will updates when executing these ideas. @<1523701087100473344:profile|SuccessfulKoala55> @<1590514584836378624:profile|AmiableSeaturtle81> 🙌

nope, still looking away to set AWS S3 secret_key without doing clearml-agent init

yeah, we cannot do anything to that [undefined]. i got this when i click that.

i feel pain to make it as form if so much varible want to changes.

Hi @<1523701070390366208:profile|CostlyOstrich36> , thanks for response, sorry for late replay,

this is my configuration in yaml, i facing difficulty when there is params in list. somehow, form to display bunch list not easy to see. do you have suggestion? Thanks!

download-data:
  dataset_train:
  - 

  - 

  - 

  dataset_test:
  - 

  - 

  - 

train:
  data:
    batch: 4
    input_size: 224
    split:
      t...

my case more like there is a task/process that running but somehow its takes too long to completed. it can be because connection issue forgot to put connection timeout, a problem connection database, etc that makes status still running, but its traped in a situation like that.

so i want to force shutdown a task to failed if that happen

it seems your clearml-agent didn't setup the right git account. are you sure setup on your agent conf?

i want to download model before i run the my inference code. i can actually make simple script using cleaml-sdk before that, but i just look for CLI based solution.

Hi @<1523701205467926528:profile|AgitatedDove14> , Thanks for rresponse!
this my simple code to test scheduler

import datetime
from clearml.automation import TaskScheduler
  
def test_make():
    print('test running', datetime.datetime.now())

if __name__ == '__main__':
    task_scheduler = TaskScheduler(
        sync_frequency_minutes=30,
        force_create_task_name='controller_feedback',
        force_create_task_project='Automation/Controller',
    )

    print('\n[utc_timestamp]...

projects.get_all_ex API call

` {"meta":{"id":"369cbeafb3ec4b36ae7c07e781be5941","trx":"369cbeafb3ec4b36ae7c07e781be5941","endpoint":{"name":"projects.get_all_ex","requested_version":"2.20","actual_version":"1.0"},"result_code":200,"result_subcode":0,"result_msg":"OK","error_stack":"","error_data":{}},"data":{"projects":[{"company":{"id":"d1bd92a3b039400cbafc60a7a5b1e52b"},"created":"2022-09-26T01:33:28.216000+00:00","id":"5664bd88f48d4868a80805f6d824d5a9","name":"ex-1/sub-ex-1","user":{"id":"a174c4e36b0446a7b3b5dd1ff5261...

{"meta":{"id":"37a8d7b26c534f9da20682801f9bd2bd","trx":"37a8d7b26c534f9da20682801f9bd2bd","endpoint":{"name":"projects.get_all_ex","requested_version":"2.20","actual_version":"1.0"},"result_code":200,"result_subcode":0,"result_msg":"OK","error_stack":"","error_data":{}},"data":{"projects":[]}}

https://github.com/allegroai/clearml/issues/865#issue-1517283786

Hi AppetizingMouse58 , this is when in Team's Work View :

`

Payload

{"id":["75d04598197a445ebef533814022c58d"],"include_stats":true,"check_own_contents":true,"search_hidden":true}

Response

{"meta":{"id":"c4ee9cb1c4594040bd0b44499d5e9970","trx":"c4ee9cb1c4594040bd0b44499d5e9970","endpoint":{"name":"projects.get_all_ex","requested_version":"2.20","actual_version":"1.0"},"result_code":200,"result_subcode":0,"result_msg":"OK","error_stack":"","error_data":{}},"data":{"projects":[{"id":"7...

yeah, it seems i will try option 2 that you mentioned.
i upload my full my configuration, and when done using google colab my configuration will gone too.

Hi AppetizingMouse58 , this is from My Work View
` # Payload
{"meta":{"id":"4ff606b50768402495674f4a2b37bdf4","trx":"4ff606b50768402495674f4a2b37bdf4","endpoint":{"name":"projects.get_all_ex","requested_version":"2.20","actual_version":"1.0"},"result_code":200,"result_subcode":0,"result_msg":"OK","error_stack":"","error_data":{}},"data":{"projects":[{"id":"75d04598197a445ebef533814022c58d","company":{"id":"d1bd92a3b039400cbafc60a7a5b1e52b"},"user":{"id":"a174c4e36b0446a7b3b5dd1ff5261962"},...

Thanks @<1523701205467926528:profile|AgitatedDove14> , right now i just use trigger to send notification and do it manually. ClearML Superb!

hi @<1523701087100473344:profile|SuccessfulKoala55> , it solved! thanks for information CLEARML_ENV ! I just accidently write environment varible CLEARML_ENV on every clearml-agent.conf. 🎉

hi @<1576381444509405184:profile|ManiacalLizard2> thanks for the answer, i will try that!

AgitatedDove14 , yes. i tried 3 times, and it always happen.

it seems only happen if i change the user preference to My Works , if set Team's Work it will show like this.

its auto to fileserver instance

I’m running the agent in ‘pip’ mode. I need to fetch certain secret values, which would be best done using Python code. If I incorporate it into the script (repository), others could deduce the path to retrieve the environment or secret value. Storing the environment variables in the clearml.config isn’t very flexible either.

Hi @<1523701087100473344:profile|SuccessfulKoala55> ,
We have successfully created a sample for the migration. Here are the changes:

• URL for MongoDB from s3:// to azure://
• Elasticsearch as you suggested
  However, our main focus is that most of our production fetches models from ClearML, which are configured with s3:// URLs.

There is an issue/bug in the UI when downloading via Azure. Here are the details: None .

i see,
thanks for clarify. i just want to find other solutions to storing secret value. rightnow i just storing secret value on env in clearml.conf in my workers. but it will complicated if there is new value, i need update workers conf and redeploy workers.

Hi, @<1523701070390366208:profile|CostlyOstrich36> ,yes! correct! how to achive that? it will save my storage.