Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
TimelyPenguin76
Administrator Moderator
0 Questions, 711 Answers
  Active since 10 January 2023
  Last activity one year ago

Reputation

0
0 Hi, Is There A Way To Log

Hi PricklyJellyfish35 ,

You should have the OmegaConf file as part of the task configuration (under CONFIGURATION tab), do you have it there?

3 years ago
0 Hi, I'M Using Clearml Python Package On Sagemaker Notebook Instance. If I Want To Edit The Clearml.Conf On The Notebook Instance, How Could I Do That?

Hi SquareFish25 ,

I tried the follow and succeed to upload the file:

` import os

os.environ['AWS_ACCESS_KEY_ID'] = "***"
os.environ['AWS_SECRET_ACCESS_KEY'] = "***"
os.environ['AWS_DEFAULT_REGION'] = "***"

from clearml import StorageManager
remote_file = StorageManager.upload_file(<file to upload>, 's3://bucket_name/inner_folder/file_name') `Can you try it and update if it works for you?

3 years ago
0 Hi Clearml. I'M Trying To Look At Datasets Functionality (With The Help Of

Hi HelpfulHare30 ,

  1. Is dataset a separate object that can be used within different project or it is a project part?

You can use the dataset in every project you like. Dataset task is part of a specific project, but it can be shared between projects.
dataset_folder = Dataset.get(dataset_id="dataset_id").get_local_copy()

  1. Can I find a dataset created with cli in Web UI?

Yes. it should create a Data processing task.

  1. Can I configure clearml to store datasets by...
3 years ago
0 Hi, We Have Clearml On K8 Setup. Using The Below, We Run Dynamic Pods On The Cluster.

Hi DeliciousBluewhale87

Can you share the version you are using? Did you get any other logs? maybe from the pod?

3 years ago
0 Should Calling

Hi MammothGoat53 ,

which clearml version are you using? I run the same and all worked as expected (I changed the project_name and the task_name to be 4 chars length)

one year ago
0 Wondering Why My Plots Are Not In Plot Section But Under Debug Section

If you like to create a plot (not an image plot) use show without imshow

4 years ago
0 Hey Guys!

You can always clone a “template” task and change everything (it will be on draft mode), what is you use case? maybe we already have a solution for it

4 years ago
0 Hi, I Started My Agent Using. Clearml-Agent Daemon --Gpus 0 --Queue Gpu --Docker --Foreground, With The Following Parameters In Clearml.Conf.

ok, I think I missed something on the way then.

you need to have some diffs, because

Applying uncommitted changes Executing: ('git', 'apply', '--unidiff-zero'): b"<stdin>:11: trailing whitespace.\n task = Task.init(project_name='MNIST', \n<stdin>:12: trailing whitespace.\n task_name='Pytorch Standard', \nwarning: 2 lines add whitespace errors.\n"
can you re-run this task from your local machine again? you shouldn’t have anything under UNCOMMITTED CHANGES this time (as we ...

3 years ago
0 Hi, I'M Trying To Understand If Clearml Supports My Usecase: I Generate My Own Data (Problem-Specific) And Generation Process Is Uploading A Parquet Dataset (In Fact, Parquet Contains Multiple Files Obv.) To S3. Is There A Way To "Register" The Dataset In

Hi GreasyWalrus57 , sorry but didn’t get that.

You want to register the data? you can do it with clearml-data and then use this task to connect between tasks and data

3 years ago
0 Hi Guys, I Have 2 Question Regarding Usage Of Clearml Platform:

Hi ElatedTurtle20 ,

You can increase it in your configuration file - https://github.com/allegroai/clearml/blob/168074acd97589df58436a3ec122a95a077620c2/docs/clearml.conf#L332.

I added some custom fields to the tasks I am running

where did you add those? as part of the task’s parameters?

one year ago
0 Hi My Friend

Hi CooperativeSealion8 ,

Sure, we will check that and reactivate soon

4 years ago
0 Are Trains Able To Discover The Docker Image And Docker Command That Is Used For Running The Current Experiment, Or Do I Need To Set It Up Manually By

Hi HealthyStarfish45

If you are running the task via docker, we dont auto detect the image and docker command, but you have more than one way to set those:

You can set the docker manually like you suggested. You can configure the docker image + commands in your ~/trains.conf https://github.com/allegroai/trains-agent/blob/master/docs/trains.conf#L130 (on the machine running the agent). You can start the agent with the image you want to run with. You can change the base docker image...

3 years ago
0 Hi, Although

JitteryCoyote63 which version are you using?

3 years ago
0 Let'S Say I Have A Project Call Proj1 To Store Datasets With Type "Data Process".. What Is The Best Practice To Get The Latest Datasets ? Example, I Start The First Data (A). Then Using Clearml-Data, I Add Another Dataset (B) As Child To The Previous On

Hi DeliciousBluewhale87 ,

You can just get a local copy of the dataset with ds.get_local_copy() , this will download the dataset from the dataset task (using cache) and return a path to the downloaded files.

Now, in this path you’ll have all the files that you have in the dataset, you can go over the files in the dataset with ds.list_files() (or ds.list_files()[0] if you have only 1 file) and get the one you want

maybe something like:

` ds_path = ds.get_local_copy()
iri...

3 years ago
0 Hi, I Know There Is Cleanup Service To Delete Archived Experiments Periodically. For The Next Version, Can You Edit Ui So That We Can Delete Experiments That We Want To Delete. Because, I Want To Save Some Of Old Experiments In The Archive Folder.

Hi MysteriousBee56 ,

The https://github.com/allegroai/trains/blob/master/examples/services/cleanup/cleanup_service.py is an example how you can add services to manage your experiments.
You can change the criteria for fetching the tasks in this script (in the https://github.com/allegroai/trains/blob/master/examples/services/cleanup/cleanup_service.py#L72 call) to something like a specific tag you can add to the experiments ( delete tag?, you can add tag to multi tasks) and it should...

4 years ago
0 Hi, When I Use The Slack Monitoring Service It Creates A Link With

Hi GreasyPenguin14 ,

What is the web server configure in your ~/clearml.conf file ( api.web_server )?

3 years ago
0 Question, When Using

something like
2021-10-11 10:50:33,703 - clearml.util - WARNING - 123 task found when searching formy task name2021-10-11 10:50:46,494 - clearml.util - WARNING - Selected taskmy task name(id=1cd66581b6624518862306069d220c8b)

2 years ago
0 Hi, I Started My Agent Using. Clearml-Agent Daemon --Gpus 0 --Queue Gpu --Docker --Foreground, With The Following Parameters In Clearml.Conf.

where task is the value return from your Task.init call,

task = Task.init(project_name=<YOUR PROJECT NAME>, task_name=<YOUR TASK NAME>)

3 years ago
0 Hi, Could You Provide An Example Of Setting Up Sdk.Storage.Direct_Access?

Hi VictoriousPenguin97

sdk.storage.direct_access is part of the extended support in the paid version.
But I think its not required since ClearML will simply try to access the path directly as it is, and you don’t need to configure it.

3 years ago
3 years ago
Show more results compactanswers