Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
TrickySheep9
Moderator
71 Questions, 428 Answers
  Active since 10 January 2023
  Last activity 8 months ago

Reputation

0

Badges 1

383 × Eureka!
0 Votes
4 Answers
979 Views
0 Votes 4 Answers 979 Views
When I Do Task.Init() And Then A Execute_Remotely(), The Task Is Being Aborted Rather Than Be In Draft. Am I Missing Something?
When I do Task.init() and then a execute_remotely(), the task is being Aborted rather than be in Draft. Am I missing something?
3 years ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
Is It Not Possible To Fire And Forget A Pipeline? In This Example, What’S The Step To Just Trigger A Pipeline Without Waiting? Without The Pipe.Wait() I Don’T See The Stages Running
Is it not possible to fire and forget a pipeline? In this example, what’s the step to just trigger a pipeline without waiting? Without the pipe.wait() I don’...
3 years ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
Is There A Way To Do S3 -> S3 Copy While Doing A Dataset? I Don’T Want To Get It To Local From S3 And Then Upload As A Dataset To S3
Is there a way to do s3 -> s3 copy while doing a dataset? I don’t want to get it to local from s3 and then upload as a dataset to s3
3 years ago
0 Votes
13 Answers
1K Views
0 Votes 13 Answers 1K Views
I Am Not Familiar With Pytorch, But Is It Expected That So Many “Models” Are Created? These Are Being Repeated As Well For A Single Task (This Is Training A T5_Model With Transformers):
I am not familiar with pytorch, but is it expected that so many “models” are created? These are being repeated as well for a single task (this is training a ...
3 years ago
0 Votes
21 Answers
1K Views
0 Votes 21 Answers 1K Views
After I Have Create A Task And Closed It In A Notebook, Any Activity Seems To Trigger Another Task. For Example:
After I have create a task and closed it in a notebook, any activity seems to trigger another task. For example:
3 years ago
0 Votes
11 Answers
1K Views
0 Votes 11 Answers 1K Views
Need Some Help With Shell Script For A Task That Is Not Running From What I Can See: Have A
Need some help with shell script for a task that is not running from what I can see: Have a apt-get install -y poppler-utils and I don’t see it being install...
3 years ago
0 Votes
30 Answers
1K Views
0 Votes 30 Answers 1K Views
Sorry Folks Too Many Questions - If I Have A Project (And I Set The Output Uri In It While Creating, To A S3 Folder) How Can I Ensure That A Experiment (Task) That I Run On My Local Outputs The Model To The Uri?
Sorry folks too many questions - if i have a project (and i set the output uri in it while creating, to a s3 folder) how can i ensure that a experiment (task...
3 years ago
0 Votes
2 Answers
946 Views
0 Votes 2 Answers 946 Views
The
The execute_jupyter_notebook_server.py link in https://allegro.ai/clearml/docs/docs/examples/services/jupyter-service/execute_jupyter_notebook_server.html is...
3 years ago
0 Votes
6 Answers
995 Views
0 Votes 6 Answers 995 Views
Does Clearml Have A Way To Do Human In The Loop Activities As Part Of A Pipeline That I Might Have Missed?
Does ClearML have a way to do Human In the Loop activities as part of a pipeline that I might have missed?
2 years ago
0 Votes
8 Answers
954 Views
0 Votes 8 Answers 954 Views
Is It Possible To Do Additional Setup (The
Is it possible to do additional setup (the extra_bash_init_script , container_bash_script etc per task? Say a task requires a system package, install it befo...
3 years ago
0 Votes
5 Answers
1K Views
0 Votes 5 Answers 1K Views
Seeing This Error When Trying To Run A Monitor In Services Queue (Agentservices Running On Kubernetes): Am I Missing Some Configuration I Need To Add Over Defaults?
Seeing this error when trying to run a Monitor in services queue (agentservices running on Kubernetes): Am I missing some configuration I need to add over de...
3 years ago
0 Votes
11 Answers
1K Views
0 Votes 11 Answers 1K Views
If I Have A Dataset And I Process It And I Want The Processed Data As Another Dataset, Is Parent The Right Approach?
If i have a dataset and i process it and I want the processed data as another dataset, is parent the right approach?
3 years ago
0 Votes
12 Answers
1K Views
0 Votes 12 Answers 1K Views
I Am Seeing That Some Steps In A Pipeline Are Being Skipped. Like For Example, In A Pipeline With 4 Steps, It’S Directly Starting At Step 3. Is There Some Reason For This, Some Optimization Kicking In?
I am seeing that some steps in a pipeline are being skipped. Like for example, in a pipeline with 4 steps, it’s directly starting at step 3. Is there some re...
3 years ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
Sorry If This Is Addressed In Docs Somewhere - Does An Agent Map To One Worker (1:1) All The Time? Can I Have Multiple Workers In An Agent? Does Docker Mode Enable Multiple Workers Per Agent?
Sorry if this is addressed in docs somewhere - Does an agent map to one worker (1:1) all the time? Can I have multiple workers in an agent? Does docker mode ...
3 years ago
0 Votes
7 Answers
1K Views
0 Votes 7 Answers 1K Views
How Do People Generally Handle Moving From Experimental Mode With Notebooks And Then Running Pipelines For Production Training And Beyond?
How do people generally handle moving from experimental mode with notebooks and then running pipelines for production training and beyond?
3 years ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
Are People Using Devcontainer + Clearml-Session?
Are people using devcontainer + clearml-session?
3 years ago
0 Votes
0 Answers
969 Views
0 Votes 0 Answers 969 Views
General Question Not Necessarily About Clearml - How Are People Handling Schema For Their Datasets?
General question not necessarily about ClearML - how are people handling schema for their datasets?
3 years ago
0 Votes
30 Answers
980 Views
0 Votes 30 Answers 980 Views
Is It Possible To Set An Environment Variable For A Task?
Is it possible to set an environment variable for a task?
3 years ago
0 Votes
9 Answers
982 Views
0 Votes 9 Answers 982 Views
When Using Docker Mode (And Specifically K8S Glue), What Are The Options For Caching? One Option Is Definitely Having A Base Image That Has The Things Needed. Anything Else? Thanks!
When using docker mode (and specifically k8s glue), what are the options for caching? One option is definitely having a base image that has the things needed...
3 years ago
0 Votes
29 Answers
979 Views
0 Votes 29 Answers 979 Views
Getting This Error At
Getting this error at task.execute_remotely()
3 years ago
0 Votes
18 Answers
1K Views
0 Votes 18 Answers 1K Views
Does Clearml-Session Work In A Kubernetes Environment?
Does clearml-session work in a Kubernetes environment?
3 years ago
0 Votes
16 Answers
970 Views
0 Votes 16 Answers 970 Views
Any Pointers On Running Gpu Tasks With K8S Glue?
Any pointers on running gpu tasks with k8s glue?
3 years ago
0 Votes
12 Answers
1K Views
0 Votes 12 Answers 1K Views
Has Anyone Done This Exact Use Case - Updates To Datasets Triggering Pipelines?
Has anyone done this exact use case - updates to datasets triggering pipelines?
3 years ago
0 Votes
12 Answers
1K Views
0 Votes 12 Answers 1K Views
What’S The Easiest Way To Update The Repo Url Alone For A Task? Need - In My Ci, The Url Used Is Https But I Need The Ssh Url To Be Used. I See That We Can Pass Repo To Task.Create But Not Task.Init
What’s the easiest way to update the repo url alone for a task? Need - in my CI, the url used is https but I need the ssh url to be used. I see that we can p...
3 years ago
0 Votes
12 Answers
1K Views
0 Votes 12 Answers 1K Views
When Using Something Like Pdf2Image Which Requires Poppler (Which Can Be Installed With Conda), How Can I Ensure That The Task Can Run On An Agent Correctly? As Of Now It Doesn’T Know About Poppler
When using something like pdf2image which requires poppler (which can be installed with conda), how can I ensure that the task can run on an agent correctly?...
3 years ago
0 Votes
17 Answers
1K Views
0 Votes 17 Answers 1K Views
Is It Possible To Increase The Polling Interval For K8S Glue? Currently It Is 5 Seconds I Believe. Would Adding An Argument For It Help? Can Do A Pr If So
Is it possible to increase the polling interval for k8s glue? Currently it is 5 seconds I believe. Would adding an argument for it help? Can do a PR if so
3 years ago
0 Votes
4 Answers
950 Views
0 Votes 4 Answers 950 Views
More An Internal Utilities Usage Question - If I Have A Script (.Py) Can I Use An Utility That Clearml Uses To Get The Packages Used By The Script? Was Looking At
More an internal utilities usage question - if I have a script (.py) can I use an utility that clearml uses to get the packages used by the script? Was looki...
3 years ago
0 Votes
12 Answers
1K Views
0 Votes 12 Answers 1K Views
This Verify Param To Decode Of Pyjwt Seems To Be Removed And In A Fresh Intallation We Are Seeing This Error:
This verify param to decode of pyjwt seems to be removed and in a fresh intallation we are seeing this error: File "/usr/local/lib/python3.7/site-packages/cl...
3 years ago
0 Votes
12 Answers
1K Views
0 Votes 12 Answers 1K Views
How Do People Solve This? If I Am Pip Installing A Custom Package From .Tar.Gz, How Can I Ensure That If I Run The Experiment (Initially Run From A Notebook) Via The Queueing It Can Be Properly Installed Steps - Notebook -> Get A Tar.Gz From S3 -> Pip I
How do people solve this? If i am pip installing a custom package from .tar.gz, how can i ensure that if i run the experiment (initially run from a notebook)...
3 years ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
When Running An Optimization Task, It Says Warning Parameter Not Found But Works Anyway. I Guess It’S Because It’S Looking For General/Param But Ends Up Using It As Default While Creating Tasks Anyway. If Default Is General, Can We Do Away With This Warni
When running an optimization task, it says warning parameter not found but works anyway. I guess it’s because it’s looking for General/param but ends up usin...
3 years ago
Show more results questions
0 I Am Not Familiar With Pytorch, But Is It Expected That So Many “Models” Are Created? These Are Being Repeated As Well For A Single Task (This Is Training A T5_Model With Transformers):

Does a pipeline step behave differently?

3 years ago
0 Apart From Having Packages In Requirements.Txt, Does Clearml Expect Them To Be Actuall Installed To Add Them As Installed Packages For A Task?

Thanks for the confirmation.

3 years ago
0 Is There A Way To Do S3 -> S3 Copy While Doing A Dataset? I Don’T Want To Get It To Local From S3 And Then Upload As A Dataset To S3

Yes using clearml-data.

Can I pass a s3 path to ds.add_files() essentially so that I can directly store a dataset without having to get the files to local and then upload again. Makes sense?

3 years ago
0 Is There A Way I Can Create A Dataset As Part Of A Pipeline And Be Able To See That This Dataset Came From This Pipeline / Task ?

Will try it out. Pretty impressed 🙂

3 years ago
0 When I Clone A Task, Is There A Way To Set Parameters That Override Rather Than Replace? As In, Original Task Parameters Is Param1 = {“A”: 1, “B”: 1} Can I Supply {“B”: 2} And It Overrides B Alone Without Removing A. Or Do I Have To Handle The Merge Mys

Ok got it, thanks

3 years ago
0 Hi

This is so cool!

2 years ago
0 Is There A Way I Can Create A Dataset As Part Of A Pipeline And Be Able To See That This Dataset Came From This Pipeline / Task ?

Ah…that’s great!

3 years ago
0 Can Someone Help Me With Deploying This Example Model (From Triton Inference Server) Deployed In Clearml-Serving? Too Many Random Errors For Me To Figure It Out

Initially it was complaining about it, but then when I did the connect_configuration it started working

3 years ago
0 Hi! When I’M Running An Experiment On A Local Machine, It Works Just Fine With The Clearml, But When Trying To Clone And Run (Enque) This Specific Experiment Directly From Clearml Server, There Are Errors In The Pip Installations. What Is The Best Way To

Is this this the issue?

https://github.com/pypa/pip/issues/8413

3 years ago
0 Is It Possible To Add A Callback For A Pipeline From A Step?

Name is default None though?

3 years ago
0 Is It Possible To Add A Callback For A Pipeline From A Step?

AgitatedDove14 is it possible to get the pipeline task running a step in a step? Is task.parent something that could help?

3 years ago
0 Playing Around With Hpo For First Time. I Am Giving This As Hyperparameter:

No, all of them completed!

3 years ago
0 Anyone Doing Sagemaker With Clearml - Something Like The K8S Glue But The Tasks Are Pulled Into Sagemaker Training Jobs

For different workloads, I need to habe different cluster scaler rules and account for different gpu needs

3 years ago
0 Anyone Doing Sagemaker With Clearml - Something Like The K8S Glue But The Tasks Are Pulled Into Sagemaker Training Jobs

Would this be a good use case to have?

3 years ago
0 Anyone Doing Sagemaker With Clearml - Something Like The K8S Glue But The Tasks Are Pulled Into Sagemaker Training Jobs

Running multiple k8s_daemon rightt? k8s_daemon("1xGPU") and k8s_daemon('cpu') right?

3 years ago
0 More An Internal Utilities Usage Question - If I Have A Script (.Py) Can I Use An Utility That Clearml Uses To Get The Packages Used By The Script? Was Looking At

Get the imports, yes.

3 years ago
0 More An Internal Utilities Usage Question - If I Have A Script (.Py) Can I Use An Utility That Clearml Uses To Get The Packages Used By The Script? Was Looking At

This is for building my model package for inference

3 years ago
0 Hi! I'Ve Been Trying Out The

Ok code suggests so. Looking for more powerful pipeline scheduling like on datasets publish, actions on model publish etc

3 years ago
0 Getting This Error At

PipelineController with 1 task. That 1 task passed but the pipeline says running

3 years ago
0 I Am Seeing That Some Steps In A Pipeline Are Being Skipped. Like For Example, In A Pipeline With 4 Steps, It’S Directly Starting At Step 3. Is There Some Reason For This, Some Optimization Kicking In?

Can I disable this cache?

3 years ago
0 Getting This Error At

Having a pipeline controller and running actually seems to work as long as i have them as separate notebooks

3 years ago
0 Is It Possible To Set An Environment Variable For A Task?

It’s essentially this now:

from clearml import Task print(Task.current_task())

3 years ago
0 Off Topic - Is There A Slack / Discord Community For General Ml Discussions?

A channel here would be good too 🙂

3 years ago
0 More An Internal Utilities Usage Question - If I Have A Script (.Py) Can I Use An Utility That Clearml Uses To Get The Packages Used By The Script? Was Looking At

Was able to use ScriptRequirements and get what I need. thanks!

3 years ago
0 Playing Around With Hpo For First Time. I Am Giving This As Hyperparameter:

Yeah, Curious - is a lot of clearml usecases not geared for notebooks?

3 years ago
0 Is It Possible To Add A Callback For A Pipeline From A Step?

AgitatedDove14 - mean this - says name=None but text says default is General.

3 years ago
0 Can Someone Help Me With Deploying This Example Model (From Triton Inference Server) Deployed In Clearml-Serving? Too Many Random Errors For Me To Figure It Out

AgitatedDove14 - looks like the serving is doing the savemodel stuff?

https://github.com/allegroai/clearml-serving/blob/main/clearml_serving/serving_service.py#L554

3 years ago
0 Hi, We Noted That Using K8S Glue, There Are Some Situations Where The Task Cannot Be Registered As Error And Will Be Stuck At Pending. An Example Of One Situation Is When The Task Is Pulling A Docker Image That Doesn'T Exist. Is There A Way To Catch Such

Lot of us are averse to using git repo directly

3 years ago
0 Playing Around With Hpo For First Time. I Am Giving This As Hyperparameter:

You mean the job with the exact same arguments ?

Yes

3 years ago
0 If I Have A Task And A Dataset Is Being Created In A Task, How Can I Get A “Link” That This Dataset Is Created In This Task, Similar To How Model Has The Task Where It Came From

But it seems to make the current task the data processing task. I don't want it to take over the task.

3 years ago
Show more results compactanswers