Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
TrickySheep9
Moderator
71 Questions, 428 Answers
  Active since 10 January 2023
  Last activity one year ago

Reputation

0

Badges 1

383 × Eureka!
0 Votes
2 Answers
2K Views
0 Votes 2 Answers 2K Views
The
The execute_jupyter_notebook_server.py link in https://allegro.ai/clearml/docs/docs/examples/services/jupyter-service/execute_jupyter_notebook_server.html is...
4 years ago
0 Votes
12 Answers
2K Views
0 Votes 12 Answers 2K Views
Any Info On The Lifecycle Of Datasets Downloaded To $Home/.Clearml/Cache/Storage_Manager/Datasets Via Get_Local_Copy I Have A Task Running And I Was Watching The Above Path And Datasets Were Being Downloaded And Then They Are All Removed And For A Partic
Any info on the lifecycle of datasets downloaded to $HOME/.clearml/cache/storage_manager/datasets via get_local_copy I have a task running and I was watching...
4 years ago
0 Votes
2 Answers
2K Views
0 Votes 2 Answers 2K Views
Any Ideas Of Using Label Studio With Clearml Datasets - Base Dataset, Load To Label Studio, Annotate, Child Annotated Dataset Is The Kind Of Flow
Any ideas of using Label Studio with Clearml Datasets - base dataset, load to label studio, annotate, child annotated dataset is the kind of flow
4 years ago
0 Votes
30 Answers
2K Views
0 Votes 30 Answers 2K Views
Is It Possible To Add A Callback For A Pipeline From A Step?
Is it possible to add a callback for a pipeline from a step?
4 years ago
0 Votes
5 Answers
2K Views
0 Votes 5 Answers 2K Views
Seeing This Error When Trying To Run A Monitor In Services Queue (Agentservices Running On Kubernetes): Am I Missing Some Configuration I Need To Add Over Defaults?
Seeing this error when trying to run a Monitor in services queue (agentservices running on Kubernetes): Am I missing some configuration I need to add over de...
4 years ago
0 Votes
30 Answers
2K Views
0 Votes 30 Answers 2K Views
Is It Possible To Set An Environment Variable For A Task?
Is it possible to set an environment variable for a task?
4 years ago
0 Votes
12 Answers
2K Views
0 Votes 12 Answers 2K Views
Has Anyone Done This Exact Use Case - Updates To Datasets Triggering Pipelines?
Has anyone done this exact use case - updates to datasets triggering pipelines?
4 years ago
0 Votes
21 Answers
2K Views
0 Votes 21 Answers 2K Views
Clearml Server Deployment Uses Node Storage. If More Than One Node Is Labeled As App=Clearml, And You Redeploy Or Update Later, Then Clearml Server May Not Locate All Your Data.
ClearML Server deployment uses node storage. If more than one node is labeled as app=clearml, and you redeploy or update later, then ClearML Server may not l...
4 years ago
0 Votes
11 Answers
2K Views
0 Votes 11 Answers 2K Views
Need Some Help With Shell Script For A Task That Is Not Running From What I Can See: Have A
Need some help with shell script for a task that is not running from what I can see: Have a apt-get install -y poppler-utils and I don’t see it being install...
4 years ago
0 Votes
0 Answers
2K Views
0 Votes 0 Answers 2K Views
General Question Not Necessarily About Clearml - How Are People Handling Schema For Their Datasets?
General question not necessarily about ClearML - how are people handling schema for their datasets?
4 years ago
0 Votes
12 Answers
2K Views
0 Votes 12 Answers 2K Views
This Verify Param To Decode Of Pyjwt Seems To Be Removed And In A Fresh Intallation We Are Seeing This Error:
This verify param to decode of pyjwt seems to be removed and in a fresh intallation we are seeing this error: File "/usr/local/lib/python3.7/site-packages/cl...
4 years ago
0 Votes
6 Answers
2K Views
0 Votes 6 Answers 2K Views
Off Topic - Is There A Slack / Discord Community For General Ml Discussions?
Off topic - Is there a slack / discord community for general ML discussions?
4 years ago
0 Votes
3 Answers
2K Views
0 Votes 3 Answers 2K Views
What Is Parent Task For A Dataset? When Does It Get Populated?
What is parent task for a dataset? When does it get populated?
4 years ago
0 Votes
7 Answers
2K Views
0 Votes 7 Answers 2K Views
Anyway To Make A Job Fail If The Required Python Version (3.7 Vs 3.8 For Example) Is Not Available In The Agent?
Anyway to make a job fail if the required python version (3.7 vs 3.8 for example) is not available in the agent?
4 years ago
0 Votes
1 Answers
2K Views
0 Votes 1 Answers 2K Views
In 1.0.3, I Am Able To Do
In 1.0.3, I am able to do task.execute_remotely(clone=True, exit_process=False) and then enqueue. In 1.0.5, it says queue must be specified. Any reason for t...
4 years ago
0 Votes
2 Answers
2K Views
0 Votes 2 Answers 2K Views
What’S The Best Way To Get The List Of All Projects (While In A Notebook)? Hitting The Api?
What’s the best way to get the list of all projects (while in a notebook)? Hitting the API?
4 years ago
0 Votes
6 Answers
2K Views
0 Votes 6 Answers 2K Views
Does Clearml Have A Way To Do Human In The Loop Activities As Part Of A Pipeline That I Might Have Missed?
Does ClearML have a way to do Human In the Loop activities as part of a pipeline that I might have missed?
3 years ago
0 Votes
8 Answers
2K Views
0 Votes 8 Answers 2K Views
Is It Possible To Do Additional Setup (The
Is it possible to do additional setup (the extra_bash_init_script , container_bash_script etc per task? Say a task requires a system package, install it befo...
4 years ago
0 Votes
3 Answers
2K Views
0 Votes 3 Answers 2K Views
Sorry If This Is Addressed In Docs Somewhere - Does An Agent Map To One Worker (1:1) All The Time? Can I Have Multiple Workers In An Agent? Does Docker Mode Enable Multiple Workers Per Agent?
Sorry if this is addressed in docs somewhere - Does an agent map to one worker (1:1) all the time? Can I have multiple workers in an agent? Does docker mode ...
4 years ago
0 Votes
3 Answers
2K Views
0 Votes 3 Answers 2K Views
Wondering How The Services To Access Can Be Setup
Wondering how the services to access can be setup
4 years ago
0 Votes
8 Answers
2K Views
0 Votes 8 Answers 2K Views
Is It Not Possible To Add Artifacts To A Completed Task?
Is it not possible to add artifacts to a completed task?
4 years ago
0 Votes
15 Answers
2K Views
0 Votes 15 Answers 2K Views
Anyone Doing Sagemaker With Clearml - Something Like The K8S Glue But The Tasks Are Pulled Into Sagemaker Training Jobs
Anyone doing sagemaker with Clearml - something like the k8s glue but the tasks are pulled into sagemaker training jobs
4 years ago
0 Votes
12 Answers
2K Views
0 Votes 12 Answers 2K Views
How Do People Solve This? If I Am Pip Installing A Custom Package From .Tar.Gz, How Can I Ensure That If I Run The Experiment (Initially Run From A Notebook) Via The Queueing It Can Be Properly Installed Steps - Notebook -> Get A Tar.Gz From S3 -> Pip I
How do people solve this? If i am pip installing a custom package from .tar.gz, how can i ensure that if i run the experiment (initially run from a notebook)...
4 years ago
0 Votes
9 Answers
2K Views
0 Votes 9 Answers 2K Views
When Using Docker Mode (And Specifically K8S Glue), What Are The Options For Caching? One Option Is Definitely Having A Base Image That Has The Things Needed. Anything Else? Thanks!
When using docker mode (and specifically k8s glue), what are the options for caching? One option is definitely having a base image that has the things needed...
4 years ago
0 Votes
7 Answers
2K Views
0 Votes 7 Answers 2K Views
When Running An Experiment From A Notebook, It Knows It’S A Notebook And Automatically Adds The Notebook As An Artifact Right? And The Uncommited Changes Becomes The Nottebook Converted To A Script? In One Case I Am Seeing Actual Git Diff Coming In Instea
When running an experiment from a notebook, it knows it’s a notebook and automatically adds the notebook as an artifact right? And the uncommited changes bec...
4 years ago
0 Votes
27 Answers
2K Views
0 Votes 27 Answers 2K Views
Playing Around With Hpo For First Time. I Am Giving This As Hyperparameter:
Playing around with HPO for first time. I am giving this as hyperparameter: DiscreteParameterRange("General/num_iterations", values=[10, 20, 30]), Is it expe...
4 years ago
0 Votes
30 Answers
2K Views
0 Votes 30 Answers 2K Views
Sorry Folks Too Many Questions - If I Have A Project (And I Set The Output Uri In It While Creating, To A S3 Folder) How Can I Ensure That A Experiment (Task) That I Run On My Local Outputs The Model To The Uri?
Sorry folks too many questions - if i have a project (and i set the output uri in it while creating, to a s3 folder) how can i ensure that a experiment (task...
4 years ago
0 Votes
0 Answers
2K Views
0 Votes 0 Answers 2K Views
@AgitatedDove14 - similarly seeing some difference in way packages are installed. How does clearml agent cache packages? having issues with Click 7 vs 8.
AgitatedDove14 - similarly seeing some difference in way packages are installed. How does clearml agent cache packages? having issues with Click 7 vs 8.
4 years ago
0 Votes
0 Answers
2K Views
0 Votes 0 Answers 2K Views
Can I Do These From A Notebook?
Can I do these from a notebook? https://github.com/allegroai/clearml/blob/master/examples/pipeline/step2_data_processing.py
4 years ago
0 Votes
12 Answers
2K Views
0 Votes 12 Answers 2K Views
What’S The Easiest Way To Update The Repo Url Alone For A Task? Need - In My Ci, The Url Used Is Https But I Need The Ssh Url To Be Used. I See That We Can Pass Repo To Task.Create But Not Task.Init
What’s the easiest way to update the repo url alone for a task? Need - in my CI, the url used is https but I need the ssh url to be used. I see that we can p...
4 years ago
Show more results questions
0 Hi

AgitatedDove14 you had mentioned some pipeline related changes coming, are they in?

4 years ago
0 Is It Possible To Add A Callback For A Pipeline From A Step?

What happens if I do blah/dataset_url ?

4 years ago
0 How Do People Generally Handle Moving From Experimental Mode With Notebooks And Then Running Pipelines For Production Training And Beyond?

Would like to get to the Maturity Level 2 here

https://cloud.google.com/architecture/mlops-continuous-delivery-and-automation-pipelines-in-machine-learning#mlops_level_2_cicd_pipeline_automation

4 years ago
0 Can Someone Help Me With Deploying This Example Model (From Triton Inference Server) Deployed In Clearml-Serving? Too Many Random Errors For Me To Figure It Out

Without some sort of automation on top feels a bit fragile

4 years ago
0 How Can I Clone A Task And Execute_Remotely The Cloned Task With Exit_Process=False. It Currently Kills The Notebook Kernel. If I Say Exit_Process=False, It Says Clone Cannot Be False. Why The Restriction? What To Do In A Notebook To Run A Task Remotely

It might be better suited than execute remotely for your specific workflow 

Exactly

4 years ago
0 Is It Possible To Set An Environment Variable For A Task?

I get other things from the project like the dataset

4 years ago
0 Is It Possible To Add A Callback For A Pipeline From A Step?

As per - https://clear.ml/docs/latest/docs/references/sdk/task#connect

4 years ago
0 Has Anyone Done This Exact Use Case - Updates To Datasets Triggering Pipelines?

AgitatedDove14 - any thoughts?

4 years ago
0 Has Anyone Done This Exact Use Case - Updates To Datasets Triggering Pipelines?

What could those triggers be?

4 years ago
0 How Do People Generally Handle Moving From Experimental Mode With Notebooks And Then Running Pipelines For Production Training And Beyond?

GrumpyPenguin23 both in general and clearml 🙂

4 years ago
0 Has Anyone Done This Exact Use Case - Updates To Datasets Triggering Pipelines?

or atleast a way to register these

4 years ago
0 Has Anyone Done This Exact Use Case - Updates To Datasets Triggering Pipelines?

Which would also mean that the system knows which datasets are used in which pipelines etc

4 years ago
0 Is It Possible To Set An Environment Variable For A Task?

Is there a good way to get the project of a task?

4 years ago
0 How Can I Clone A Task And Execute_Remotely The Cloned Task With Exit_Process=False. It Currently Kills The Notebook Kernel. If I Say Exit_Process=False, It Says Clone Cannot Be False. Why The Restriction? What To Do In A Notebook To Run A Task Remotely

do not limit the clone on execute_remotely,

Yes

4 years ago
0 Does Clearml-Session Work In A Kubernetes Environment?

How is clearml-session intended to be used?

4 years ago
0 Has Anyone Done This Exact Use Case - Updates To Datasets Triggering Pipelines?

More interested in some way for doing this ssytem wide

4 years ago
0 After I Have Create A Task And Closed It In A Notebook, Any Activity Seems To Trigger Another Task. For Example:

close it

4 years ago
0 Is It Possible To Set An Environment Variable For A Task?

It’s a task, it’s running in context of a project, but I don’t have a way to get the project name

4 years ago
0 Apart From Having Packages In Requirements.Txt, Does Clearml Expect Them To Be Actuall Installed To Add Them As Installed Packages For A Task?

AgitatedDove14 ^^

4 years ago
0 Is It Possible To Add A Callback For A Pipeline From A Step?

barebones, can a step in a pipeline refer to a previous step by name and get it?

4 years ago
0 I Saw Some Talk Of Clearml + Kedro On Reddit. Is That A Good Approach?

I am going to be experimenting a bit as well, will get back on this topic in a couple of weeks 🙂

4 years ago
0 Is It Possible To Add A Callback For A Pipeline From A Step?

Thanks

4 years ago
0 Is It Possible To Increase The Polling Interval For K8S Glue? Currently It Is 5 Seconds I Believe. Would Adding An Argument For It Help? Can Do A Pr If So

I am using the clearml-agent from pypi version

4 years ago
0 When Running An Experiment From A Notebook, It Knows It’S A Notebook And Automatically Adds The Notebook As An Artifact Right? And The Uncommited Changes Becomes The Nottebook Converted To A Script? In One Case I Am Seeing Actual Git Diff Coming In Instea

Is there some doc or relevant code on exactly what's happening? The behaviour has been random

4 years ago
0 Is It Not Possible To Fire And Forget A Pipeline? In This Example, What’S The Step To Just Trigger A Pipeline Without Waiting? Without The Pipe.Wait() I Don’T See The Stages Running

AgitatedDove14 - is my understanding right that we have to call pipe.wait() ?

4 years ago
0 Is It Possible To Schedule Pipelines On Events Like Dataset Update?

Essentially, if I have a dataset on which I am performing transformations and then creating other downstream datasets

4 years ago
0 Is It Possible To Schedule Pipelines On Events Like Dataset Update?

Got it, thanks

4 years ago
0 Does Clearml-Session Work In A Kubernetes Environment?

AlertBlackbird30 - i don’t understand why it can’t be a focus though. Probably missing some context.

4 years ago
0 Any Info On The Lifecycle Of Datasets Downloaded To $Home/.Clearml/Cache/Storage_Manager/Datasets Via Get_Local_Copy I Have A Task Running And I Was Watching The Above Path And Datasets Were Being Downloaded And Then They Are All Removed And For A Partic

AgitatedDove14 - this was an interesting one. I think I have found the issue, but verifying the fix as of now.

One of the devs was using shutil.copy2 to copy parts of dataset to a temporary directory in a with block - something like:

with TemporaryDirectory(dir=temp_dir) as certificates_directory: for file in test_paths: shutil.copy2(f"{dataset_local}/{file}", f"{certificates_directory}/file")
My suspicion is since copy2 copies with full data and symlin...

4 years ago
0 Is It Possible To Schedule Pipelines On Events Like Dataset Update?

My question is - I have this in a notebook now. How can i make it such that any update to the upstream database triggers this data transformation step

4 years ago
Show more results compactanswers