Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
TimelyPenguin76
Administrator Moderator
0 Questions, 711 Answers
  Active since 10 January 2023
  Last activity 2 years ago

Reputation

0
0 Can The

Hi TenseOstrich47 , the StorageManager does use boto3 for those upload (so if its not supported by boto3, same for StorageManager :/ )
Maybe you can use the 'wait_for_upload' and delete the local file after?

3 years ago
0 I'M Looking To Utilize The Trains Aws Autoscaler Functionality, But After Going Through Its Docs A Few Times I Still Don'T Get It. Ultimately, My Setup Is That I Have Multiple Data Scientists Working On Static Instances, And They Have Queues Available To

The AWS autoscaler doesn’t related to other tasks, you can think about it as a service running in your Trains system.

and are configured in the auto scale task?

Didn’t get that 😕

4 years ago
0 Hi, I Am Running Several Python Scripts But All For The Same Project/Task. Is It Possible To Task.Init To Existing Running/Completed Task And Adding On The Results?

So you mean args.lastiter is not the last iteration? Can you try replacing it with task.get_last_iteration() ?

3 years ago
0 Hi Everyone, If I Want To Run A Script That Has Trains Tracking Statements In It But Just This Time I Want To Disable All Logging, How Would I Go About That?

Hi IntriguedRat44

If you don’t want sending framework’s outputs, you can disable those with auto_connect_frameworks=False in your Task.init call.

You can find more options https://github.com/allegroai/trains/blob/master/trains/task.py#L328

4 years ago
0 I Have To Say I'M Totally Confused By The Pipeline I Want To Execute The Pipeline On My Local Computer. I Followed

this is the one from the original (template) task? I can’t see the package that raise the error, can you try adding it and re-run? do you have the imports analysis?

BTW you have both trains and clearml , can you try with clearml only? it should support all the trains imports

3 years ago
0 Can We Somehow Add A Column "Duration" To The List Of Experiments ?

Yap, you right the math part. You can add column from metrics and hyper-params too, but currently we don’t have total duration as a column.

Let me check about the duration and what we can do

4 years ago
0 Hi, When I Use The Autoscaler To Start Jobs, I Noticed Some Of Them Randomly Abort In The Middle Of The Jobs And Give The Following Error:

python invoked oom-killerOut of memory, CloudySwallow27 in the scaler app task, can you check if you have scalers reporting?

2 years ago
0 Hi, Another Issue Is Faced When Using Mmdetection/Mmcv With Clearml. The Automatic Uploading Of Checkpoint Meets The Following Error:

NonchalantDeer14 thanks for the logs, do you maybe have some toy example I can run to reproduce this issue my side?

3 years ago
0 Are Trains Able To Discover The Docker Image And Docker Command That Is Used For Running The Current Experiment, Or Do I Need To Set It Up Manually By

Hi HealthyStarfish45

If you are running the task via docker, we dont auto detect the image and docker command, but you have more than one way to set those:

You can set the docker manually like you suggested. You can configure the docker image + commands in your ~/trains.conf https://github.com/allegroai/trains-agent/blob/master/docs/trains.conf#L130 (on the machine running the agent). You can start the agent with the image you want to run with. You can change the base docker image...

4 years ago
0 Quick Question About The Cleanup Service: One Argument Is

Hi ElegantCoyote26 ,

` - cleanup_period_in_days (float): The time period between cleanups. Default: 1.

  • run_as_service (bool): The script will be execute remotely (Default queue: "services"). Default: True. so run_as_service will not run the script locally on your machine but just enqueue the script to the services ` queue (you should have clearml-agent in services mode listening to this queue, and the agent will run this service)
4 years ago
0 Hi, I Have A Question Regarding The Aws-Autoscaler: Am I Understanding Correctly That:

I want to verify it doesn’t start more than one instance for the same task

3 years ago
0 Hi, I Failed To Update The "Started At" And The "Completed At" Attributes In The "Info" Tab. I Tried To Do So By The Following Steps:

Hi SpotlessFish46

In order to mark task as completed, it should start first, can you try:

task = Task.create(project_name="projectX", task_name='YYY') task.mark_started() task.completed()?

4 years ago
0 Hi, I Would Like To Understand More On How Clearml Deal With Codes.

Hi SubstantialElk6 .

ClearML with add you entire script to the uncommitted changes section if its a standalone script (not part of a git repository).
If you run a script that is part of a git repository, the uncommitted changes section will contain the git diff of you work, along with the git repository address, branch, commit id or tag.

In order to re run a clone of this task, the agent running it will need to have the credentials to the repository (in order to clone it)

4 years ago
0 Quick Question About The Cleanup Service: One Argument Is

If run_as_service is False , the script will start running on your machine, once you will clone and enqueue it, it will run twice (on your machine and by clearml-agent)

i’m guessing the cleanup_period_in_days can only actually run every day or whatever if the script is enqueued to 

services

you can change this value if you like (e.g. 0.5 for every 12 hours)

4 years ago
0 I Am Currently Running A Clearml-Server And Have Few Questions About Dataset Management.

I think the only way you can get it is from the task attribute:

ds = Dataset.get(dataset_id="your dataset id") ds_uri = ds._task.artifacts.get("data").url

3 years ago
0 I Am Trying To Use Clearml In My Work And I Am Facing Some Problems So Could Anyone Help Me With That? I Have Connected My Workstation With The Clearml Server As An Agent And When I Run The Code In My Local Device Then Clone It And Enqueue It To Run The C

According to the message above, can you try installing nbconvert and re run it? You should be able to view the script in the uncommitted changed

` pip install nbconvert

OR

conda install nbconvert `

is there a resources like youtube videos or tuotorials about using clearML? I watched and learned from ClearML chaneel in youtube but I think I need more to see maybe I have done something wrong?

Yes,
ClearML Youtube (best ever) channel - https://www.youtube.com/c/ClearML/featur...

2 years ago
0 Hi, I Was Getting A Really Weird Error Due To Mismatch On The Versions Between The Installed Libraries In My Environment And The Ones Ran In The Node (I Manually Changed The Installed Packages And Everything Worked). How Can I Force Trains To Use Exactly

Hi GrievingTurkey78

If you like to have the same environment in trains-agent , you can use on your local machine the detect_with_pip_freeze option, on you ~/trains.conf file.
Just change detect_with_pip_freeze: true ( https://github.com/allegroai/trains/blob/master/docs/trains.conf#L168 is an example)

4 years ago
0 Another Question, How Can I Close A Task With A Specified Status? I Know I Am Able To Do Task.Close() But This Doesn'T Let Me Control The Task'S Status And I Want To Determine It

ImmensePenguin78 I think you can get it with the APIClient , you can add force to the call:
` from clearml import Task
from clearml.backend_api.session.client import APIClient

api_client = APIClient()
t = Task.init(project_name="Your project", task_name="Your task name")

t.close()
api_client.tasks.failed(t.id, force=True, status_reason="Your status reason", status_message="Your status message") `

4 years ago
0 Hi All, Is There Documentation \ Example Describing How Does Clearml Works With Hydra?

 thanks for the answer, so for example (to make sure I understand) with the example you gave above when I’ll print the config I’ll see the new edited parameters?

Correct

What about the second part of the question, would it be parsed according to the type hinting?

It should

3 years ago
0 Hi There. I'M Following The Training Instructions For Testing Clearml Agent (

BattyLion34 only add will also work, because it will be in the diff section

4 years ago
0 Hi. I Have A Task Executed On Clearml-Agent, Configured With

Hi HelpfulHare30 , can you try upgrade to the latest ClearML agent?

pip install clearml-agent==1.0.0

3 years ago
Show more results compactanswers