Hi @<1523701070390366208:profile|CostlyOstrich36>
i mean we can do a form dropdown for others configuration like hyperparameters (task.connect)

I see, yeah my alternative solution right now is just to show the list of options outside on ClearML UI.

Hi SmugDolphin23 , i have try 1.8.4rc1, and yeah its working! Thanks!

still i need do this?
dataset.upload() dataset.finalize()
i have another question,
if we have uploaded data clearml, how we add data?
this is my way right now.

dataset = Dataset.create( dataset_project=metadata[2], dataset_name=metadata[3], description=description, output_uri=f" ", parent_datasets=[id_dataset_latest] )

Thanks, its works!

yes, so far i know, if we want to upload dataset on clearml, we need provide local_path to data, then clearml will upload to the platform.

my data not on local, but s3 bucket.
is there a way to point s3 url ? my currently workflow is download my data from s3 bucket to local, then upload to clearml.

Thanks @<1523701205467926528:profile|AgitatedDove14> , right now i just use trigger to send notification and do it manually. ClearML Superb!

Thanks guys, i will try to learn that first. i will updates when executing these ideas. @<1523701087100473344:profile|SuccessfulKoala55> @<1590514584836378624:profile|AmiableSeaturtle81> 🙌

Hi @<1523701087100473344:profile|SuccessfulKoala55> ,
We have successfully created a sample for the migration. Here are the changes:

• URL for MongoDB from s3:// to azure://
• Elasticsearch as you suggested
  However, our main focus is that most of our production fetches models from ClearML, which are configured with s3:// URLs.

There is an issue/bug in the UI when downloading via Azure. Here are the details: None .

Hi AgitatedDove14 ,
right now i can delete, i set configuration to see hidden project/file on UI, and it show task related (e.g pipeline, dataset) on that project. but yeah, every time i make project with subproject inside, there is [undefined] there. i create project using code and UI, the result is same.

this is my docker-compose conf. i change all port 8XXX to 7XXX nad also change /opt/cleaml to /mnt/hdd_2/clearml.
` version: "3.6"
services:

apiserver:
command:
- apiserver
...

it seems only happen if i change the user preference to My Works , if set Team's Work it will show like this.

AgitatedDove14 , yes. i tried 3 times, and it always happen.

projects.get_all_ex API call

also i found, i cannot delete project, even the project is show empty experiment.

Hi AppetizingMouse58 , this is when in Team's Work View :

`

Payload

{"id":["75d04598197a445ebef533814022c58d"],"include_stats":true,"check_own_contents":true,"search_hidden":true}

Response

{"meta":{"id":"c4ee9cb1c4594040bd0b44499d5e9970","trx":"c4ee9cb1c4594040bd0b44499d5e9970","endpoint":{"name":"projects.get_all_ex","requested_version":"2.20","actual_version":"1.0"},"result_code":200,"result_subcode":0,"result_msg":"OK","error_stack":"","error_data":{}},"data":{"projects":[{"id":"7...

` {"meta":{"id":"17c6e609ace54bf8bfdf3113c39fd470","trx":"17c6e609ace54bf8bfdf3113c39fd470","endpoint":{"name":"projects.get_all_ex","requested_version":"2.20","actual_version":"1.0"},"result_code":200,"result_subcode":0,"result_msg":"OK","error_stack":"","error_data":{}},"data":{"projects":[{"id":"75d04598197a445ebef533814022c58d","company":{"id":"d1bd92a3b039400cbafc60a7a5b1e52b"},"user":{"id":"a174c4e36b0446a7b3b5dd1ff5261962"},"name":"ex-1","basename":"ex-1","description":"","created":"20...

` {"meta":{"id":"369cbeafb3ec4b36ae7c07e781be5941","trx":"369cbeafb3ec4b36ae7c07e781be5941","endpoint":{"name":"projects.get_all_ex","requested_version":"2.20","actual_version":"1.0"},"result_code":200,"result_subcode":0,"result_msg":"OK","error_stack":"","error_data":{}},"data":{"projects":[{"company":{"id":"d1bd92a3b039400cbafc60a7a5b1e52b"},"created":"2022-09-26T01:33:28.216000+00:00","id":"5664bd88f48d4868a80805f6d824d5a9","name":"ex-1/sub-ex-1","user":{"id":"a174c4e36b0446a7b3b5dd1ff5261...

{"meta":{"id":"37a8d7b26c534f9da20682801f9bd2bd","trx":"37a8d7b26c534f9da20682801f9bd2bd","endpoint":{"name":"projects.get_all_ex","requested_version":"2.20","actual_version":"1.0"},"result_code":200,"result_subcode":0,"result_msg":"OK","error_stack":"","error_data":{}},"data":{"projects":[]}}

`

payload

{"id":["75d04598197a445ebef533814022c58d"],"include_stats":true,"check_own_contents":true,"active_users":["a174c4e36b0446a7b3b5dd1ff5261962"],"search_hidden":true}

Response

{"meta":{"id":"8d18a89599db4d899ab40959a39970b3","trx":"8d18a89599db4d899ab40959a39970b3","endpoint":{"name":"projects.get_all_ex","requested_version":"2.20","actual_version":"1.0"},"result_code":200,"result_subcode":0,"result_msg":"OK","error_stack":"","error_data":{}},"data":{"projects":[{"id":"75d0459819...

    from src.net import Classifier
ModuleNotFoundError: No module named 'src'

hmm yeah i think, this is not possible to share a whole script here.

hi i have similar case, but can we scheduled new task here?

def trigger_task_func(task_id):
    print("trigger running...")
    try:
        previous_task = Task.get_task(task_id=task_id)
        print(previous_task.artifacts)
        try:
            fp = previous_task.artifacts['latest_condition'].get_local_copy()
            params = open_json(fp)
            last_index = params.get('last_index')
            day_n = params.get('iteration')
            print("Success Fetching", param...

yup correct. but the scheduler not created idk why. here my code and the log

from doctest import Example
from clearml.automation import TriggerScheduler, TaskScheduler
from clearml import Task
import json


def open_json(fp):
    with open(fp, 'r') as f:
        my_dictionary = json.load(f)
    return my_dictionary
    
    
def trigger_task_func(task_id):
    print("trigger running...")
    try:
        previous_task = Task.get_task(task_id=task_id)
        print(previous_task.artifact...

i see okay thanks

yeah, we cannot do anything to that [undefined]. i got this when i click that.

clearml is awsome ❤ 🤩

yup,
example just need choosing between SGD, Adam, AdamW on optimizer field

Hi @<1523701070390366208:profile|CostlyOstrich36> ,
i use vpn and set location in US still cannot access too.
when i set location to Germany, it can access.
any idea to solve this from user side?

Hi AppetizingMouse58 , this is from My Work View
` # Payload
{"meta":{"id":"4ff606b50768402495674f4a2b37bdf4","trx":"4ff606b50768402495674f4a2b37bdf4","endpoint":{"name":"projects.get_all_ex","requested_version":"2.20","actual_version":"1.0"},"result_code":200,"result_subcode":0,"result_msg":"OK","error_stack":"","error_data":{}},"data":{"projects":[{"id":"75d04598197a445ebef533814022c58d","company":{"id":"d1bd92a3b039400cbafc60a7a5b1e52b"},"user":{"id":"a174c4e36b0446a7b3b5dd1ff5261962"},...

hi @<1523701070390366208:profile|CostlyOstrich36> , i mean uv this None

my case more like there is a task/process that running but somehow its takes too long to completed. it can be because connection issue forgot to put connection timeout, a problem connection database, etc that makes status still running, but its traped in a situation like that.

so i want to force shutdown a task to failed if that happen