Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
QuaintJellyfish58
Moderator
37 Questions, 84 Answers
  Active since 10 January 2023
  Last activity 3 months ago

Reputation

0

Badges 1

76 × Eureka!
0 Votes
2 Answers
1K Views
0 Votes 2 Answers 1K Views
will self hosted version clearml have Reports features?
one year ago
0 Votes
1 Answers
1K Views
0 Votes 1 Answers 1K Views
Hello everyone! i quite confuse about update data using sdk without download it. first i create dataset and upload. dataset_path = 'dataset/batch_1' dataset ...
2 years ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
Hi, it seems there is a bug: StorageManager.list with_metadata not returning 'size' i am using minio ls_files = StorageManager.list( remote_url=remote_url, r...
one year ago
0 Votes
3 Answers
479 Views
0 Votes 3 Answers 479 Views
hi, can you help me with this? thanks in advance. problem : - could not run task - could not fetch from bitbucket/gitsetup : - clearml-agent: 1.7.0; 1.8.1 ag...
5 months ago
0 Votes
7 Answers
1K Views
0 Votes 7 Answers 1K Views
Hi, i am try to use TaskScheduler as cronjob, i want my task running every 2.40 am UTC everyday, task_scheduler.add_task( target_project='Automation/feedback...
one year ago
0 Votes
24 Answers
1K Views
0 Votes 24 Answers 1K Views
Hi All, i am creating sub project, for Experiment, but it seems there is [undefined] section created too (like picture) every i made subproject. also, can we...
2 years ago
0 Votes
6 Answers
1K Views
0 Votes 6 Answers 1K Views
Hi just to confirm, i set my default output_uri to s3, output_uri will upload just artifacs, console log, file server will save plot images like matplotlib/s...
one year ago
Show more results questions
0 Hi, Is Anyone Can Access

it just solved. Thanks!

one year ago
0 Hi, Is Anyone Can Access

Hi @<1523701070390366208:profile|CostlyOstrich36> ,
i use vpn and set location in US still cannot access too.
when i set location to Germany, it can access.
any idea to solve this from user side?
image

one year ago
0 Hi Everyone, I Have Two Issues With New Clearml-Server (1.14):

Hi @<1523701994743664640:profile|AppetizingMouse58> , i have update on #228. Thanks!

9 months ago
0 Hi Everyone, Is It Possible On Clearml, Before Run A Task Using By Agent/Remotely We Can Implement Some Script Python? The Usecase Here I Want To Export Some Env Settings Before Task Started Execute.

I’m running the agent in ‘pip’ mode. I need to fetch certain secret values, which would be best done using Python code. If I incorporate it into the script (repository), others could deduce the path to retrieve the environment or secret value. Storing the environment variables in the clearml.config isn’t very flexible either.

11 months ago
2 years ago
0 Hi Guys, I Have Data ( For Folder Tree Image Classification) And We Stored That On S3 Bucket Minio Can I Register Dataset To Clearml Without Downloading (Using Storage Manager) Data On S3 Bucket To My Local Then Upload To Clearml?

# downloading data from s3 manager = StorageManager() target_folder = manager.download_folder( local_folder='/tmp', remote_url=f' ` '
)

    # upload to clearml
    dataset = Dataset.create(
        dataset_project=metadata[2], 
        dataset_name=metadata[3],
        dataset_tags=tags,
        output_uri=" ` ` "
    )
    fp_target_folder = os.path.join(target_folder, minio_s3_url)
    print('>>...
one year ago
0 Hi Guys, I Have Data ( For Folder Tree Image Classification) And We Stored That On S3 Bucket Minio Can I Register Dataset To Clearml Without Downloading (Using Storage Manager) Data On S3 Bucket To My Local Then Upload To Clearml?

still i need do this?
dataset.upload() dataset.finalize()
i have another question,
if we have uploaded data clearml, how we add data?
this is my way right now.

dataset = Dataset.create( dataset_project=metadata[2], dataset_name=metadata[3], description=description, output_uri=f" ", parent_datasets=[id_dataset_latest] )

one year ago
0 Hi All. I'M Setting Up An Model Export Script That Will Export Trained Models For Edge Deployment. I Initially Thought About Setting It Up As A Trigger Scheduler, And To Have It Trigger On Tags On A Published Model, But As Time Goes By The Trigger Schedul

yup correct. but the scheduler not created idk why. here my code and the log

from doctest import Example
from clearml.automation import TriggerScheduler, TaskScheduler
from clearml import Task
import json


def open_json(fp):
    with open(fp, 'r') as f:
        my_dictionary = json.load(f)
    return my_dictionary
    
    
def trigger_task_func(task_id):
    print("trigger running...")
    try:
        previous_task = Task.get_task(task_id=task_id)
        print(previous_task.artifact...
8 months ago
0 Hi All. I'M Setting Up An Model Export Script That Will Export Trained Models For Edge Deployment. I Initially Thought About Setting It Up As A Trigger Scheduler, And To Have It Trigger On Tags On A Published Model, But As Time Goes By The Trigger Schedul

hi i have similar case, but can we scheduled new task here?

def trigger_task_func(task_id):
    print("trigger running...")
    try:
        previous_task = Task.get_task(task_id=task_id)
        print(previous_task.artifacts)
        try:
            fp = previous_task.artifacts['latest_condition'].get_local_copy()
            params = open_json(fp)
            last_index = params.get('last_index')
            day_n = params.get('iteration')
            print("Success Fetching", param...
8 months ago
0 Hi All. I'M Setting Up An Model Export Script That Will Export Trained Models For Edge Deployment. I Initially Thought About Setting It Up As A Trigger Scheduler, And To Have It Trigger On Tags On A Published Model, But As Time Goes By The Trigger Schedul

Hi @<1523701205467926528:profile|AgitatedDove14> ,
Yes i want to do that, but so far i know Task.enqueue will execute immediately, i need execute task to spesific time, and i see to do that i need scheduler and set recurring False, set time.

I tried that create scheduler, but the scheduler not created when the function executed.

8 months ago
0 [Issue With Minio] Hi, I Am Using Clearml=1.8.3, But It Seems Still Have Trouble With Minio Connection.

my config is same like issue #763

` import clearml
from clearml import StorageManager, Dataset
from rich import print

version_clearml = clearml.version

manager = StorageManager()

print(f'clearml: {version_clearml}')
try:
minio_s3_url = 'x/x/x/x/x/x/x'
print('\n-------------download folder-------------')
target_folder = manager.download_folder(
local_folder='tmp',
remote_url=f' '
)
except Exception as e:
print(e)
print('FAILED: download fold...

one year ago
0 Hey Guys,

https://github.com/mert-kurttutan/torchview
maybe can try this one, and can send to logger clearml at the end.

one year ago
0 Hi, I Am Try To Use Taskscheduler As Cronjob, I Want My Task Running Every 2.40 Am Utc Everyday,

i set like this: for init Task Scheduler

    task_scheduler = TaskScheduler(
        sync_frequency_minutes=5,
        force_create_task_name='controller_feedback',
        force_create_task_project='Automation/Controller',

    )
one year ago
0 Hi, I Am Try To Use Taskscheduler As Cronjob, I Want My Task Running Every 2.40 Am Utc Everyday,

i running this on 2.35 am, but the job not launching after 2.40 am

one year ago
0 Hi I Have Installed Clearml-Agent, But My Pip Saved In Hdd, If I Run Clearml-Agent To Ssd, Is It Mean, My Code Task Will Running In Ssd?

oh okay, so i need to set that to path ssd, yeah?
is it this one? or there is

    docker_internal_mounts {
        sdk_cache: "/clearml_agent_cache"
        apt_cache: "path/to/ssd/apt-cache"
        ssh_folder: "/root/.ssh"
        pip_cache: "path/to/ssd/clearml-cache/pip"
        poetry_cache: "/mnt/hdd_2/clearml-cache/pypoetry"
        vcs_cache: "path/to/ssd/clearml-cache/vcs-cache"
        venv_build: "path/to/ssd/clearml-cache/venvs-builds"
        pip_download: "path/to/ssd/cle...
one year ago
0 Hi Guys, I Have Problem Understanding To Set Requirements.Txt And Running Remotelty Using Clearml-Agent. So I Tried To Set Requirements, And Want To Execute Remotely. When In Draft Mode, The Installed Package Is Correct And Match Like Requirements.Txt, Bu

Hi @<1523701070390366208:profile|CostlyOstrich36>
i attach for complete log

here my structure:

.
├── app
│   ├── backend
│   └── frontend
├── assets
│   ├── demo-app-sample.png
│   └── workflow.png
├── config
│   ├── clearml.conf
│   ├── list_models.py
│   ├── list_optimizer.py
│   ├── __pycache__
│   └── train_config.py
├── docker
│   ├── Dockerfile
│   ├── Dockerfile.app
│   ├── requirements.prod.txt
│   ├── requirements.train.txt
│   └── requirements.txt
├── lightning_logs
├── Mak...
one year ago
0 Hi Guys, I Have Problem Understanding To Set Requirements.Txt And Running Remotelty Using Clearml-Agent. So I Tried To Set Requirements, And Want To Execute Remotely. When In Draft Mode, The Installed Package Is Correct And Match Like Requirements.Txt, Bu

Hi @<1523701070390366208:profile|CostlyOstrich36> , just want to update,
this is solve by

  • remove
-f 
  1. change Task.force_requirements_env_freeze(False, req_path) -> Task.add_requirements(req_path)
  2. change my clearml-agent settings
one year ago
0 Hello, Is It Possible To Install Clearml-Agent Without Using Pip? I Want To Use Docker, But Worried About When Clearml-Agent Execution In Docker Mode Cannot Create Container.

alright, will try, i just worried about if execution mode is docker mode? should i mount to /var/run/docker.sock?

one year ago
0 Hi, Just Curious, Is There Planning To Using

hi @<1523701070390366208:profile|CostlyOstrich36> , i mean uv this None
image

7 months ago
2 years ago
0 Hi All, I Am Creating Sub Project, For Experiment, But It Seems There Is

Hi AgitatedDove14 ,
right now i can delete, i set configuration to see hidden project/file on UI, and it show task related (e.g pipeline, dataset) on that project. but yeah, every time i make project with subproject inside, there is [undefined] there. i create project using code and UI, the result is same.

this is my docker-compose conf. i change all port 8XXX to 7XXX nad also change /opt/cleaml to /mnt/hdd_2/clearml.
` version: "3.6"
services:

apiserver:
command:
- apiserver
...

2 years ago
0 Hi All, I Am Creating Sub Project, For Experiment, But It Seems There Is

Hi AppetizingMouse58 , this is when in Team's Work View :

`

Payload

{"id":["75d04598197a445ebef533814022c58d"],"include_stats":true,"check_own_contents":true,"search_hidden":true}

Response

{"meta":{"id":"c4ee9cb1c4594040bd0b44499d5e9970","trx":"c4ee9cb1c4594040bd0b44499d5e9970","endpoint":{"name":"projects.get_all_ex","requested_version":"2.20","actual_version":"1.0"},"result_code":200,"result_subcode":0,"result_msg":"OK","error_stack":"","error_data":{}},"data":{"projects":[{"id":"7...

2 years ago
0 Hi All, I Am Creating Sub Project, For Experiment, But It Seems There Is

` {"meta":{"id":"369cbeafb3ec4b36ae7c07e781be5941","trx":"369cbeafb3ec4b36ae7c07e781be5941","endpoint":{"name":"projects.get_all_ex","requested_version":"2.20","actual_version":"1.0"},"result_code":200,"result_subcode":0,"result_msg":"OK","error_stack":"","error_data":{}},"data":{"projects":[{"company":{"id":"d1bd92a3b039400cbafc60a7a5b1e52b"},"created":"2022-09-26T01:33:28.216000+00:00","id":"5664bd88f48d4868a80805f6d824d5a9","name":"ex-1/sub-ex-1","user":{"id":"a174c4e36b0446a7b3b5dd1ff5261...

2 years ago
0 Hi All, I Am Creating Sub Project, For Experiment, But It Seems There Is

it seems only happen if i change the user preference to My Works , if set Team's Work it will show like this.

2 years ago
Show more results compactanswers