Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
ReassuredOwl55
Moderator
12 Questions, 42 Answers
  Active since 10 January 2023
  Last activity 10 months ago

Reputation

0

Badges 1

42 × Eureka!
0 Votes
7 Answers
657 Views
0 Votes 7 Answers 657 Views
[Pipeline] Hey, Is It Possible To Specify The Output Uri For Pipelines And Their Components Using Pipeline Decorators? I Would Like To Store Pipeline Artifacts And Component Artifacts On S3.
[Pipeline] Hey, is it possible to specify the output uri for Pipelines and their Components using Pipeline decorators? I would like to store Pipeline artifac...
one year ago
0 Votes
7 Answers
655 Views
0 Votes 7 Answers 655 Views
Hey All, We Are Trying To Clone A Task That Uses Custom Pip Installed Packages And Run It Via An Agent. When Running Locally, We Simply “
Hey all, We are trying to clone a Task that uses custom pip installed packages and run it via an Agent. When running locally, we simply “ pip install ./path/...
one year ago
0 Votes
13 Answers
661 Views
0 Votes 13 Answers 661 Views
[Pipeline] Am I Right In Saying A Pipeline Controller Can’T Include A Data-Dependent For-Loop? The Issue Is Not Spinning Up The Tasks, It’S Collecting The Results At The End. I Was Trying To Append The Outputs Of Each Iteration Of The For-Loop And Pass Th
[Pipeline] Am I right in saying a Pipeline controller can’t include a data-dependent for-loop? The issue is not spinning up the Tasks, it’s collecting the re...
one year ago
0 Votes
5 Answers
654 Views
0 Votes 5 Answers 654 Views
Hey, Here’S A Quickie – Is It Possible To Specify Different “Types” Of Input Parameters (“Args/…“) Such That They Are Handled Nicely On The Front End? Basically, I Have A Task That Needs A Datetime As Input And It Would Be Really Nice To Have A Gui To Do
Hey, here’s a quickie – is it possible to specify different “types” of input parameters (“Args/…“) such that they are handled nicely on the front end? Basica...
one year ago
0 Votes
3 Answers
585 Views
0 Votes 3 Answers 585 Views
Do Pandas
Do pandas pd.DataFrame s work with caching for Pipeline Components? I seem to be coming up against a weird issue where List[pd.DataFrame] is cached properly ...
one year ago
0 Votes
0 Answers
705 Views
0 Votes 0 Answers 705 Views
Hey, I’M Thinking Of Using A Clearml Pipeline To Compile A Dataset More Efficiently. My Hope Is That I Won’T Have To Run
Hey, I’m thinking of using a ClearML Pipeline to compile a dataset more efficiently. My hope is that I won’t have to run every step for every data point ever...
one year ago
0 Votes
1 Answers
683 Views
0 Votes 1 Answers 683 Views
[Clearml Task Querying] How Would I Find Tasks That Have The Same Code With Different Inputs/Parameters? I’M Interested In “Diff”Ing The Inputs To/Outputs From A Task To Do Pipeline “Caching” In A More Intelligent Way (For My Use Case) Than Clearml Does B
[ClearML Task Querying] How would I find Tasks that have the same code with different inputs/parameters? I’m interested in “diff”ing the inputs to/outputs fr...
one year ago
0 Votes
23 Answers
718 Views
0 Votes 23 Answers 718 Views
How Can I Run A New Version Of A Pipeline, Wait For It To Finish And Then Check Its Completion/Failure Status? I Want To Kick Off The Pipeline And Then Check Completion
How can I run a new version of a Pipeline, wait for it to finish and then check its completion/failure status? I want to kick off the pipeline and then check...
one year ago
0 Votes
4 Answers
643 Views
0 Votes 4 Answers 643 Views
Trying To Follow
Trying to follow https://github.com/abiller/events/blob/webinars/videos/the_clear_show/S02/E05/dataset_edit_00.ipynb by GrittyStarfish67 and getting the foll...
one year ago
0 Votes
4 Answers
714 Views
0 Votes 4 Answers 714 Views
[Datasets] Is It Possible To Get An Individual File From A Dataset? Example Would Be Accessing Only A Single Feature From A Feature Store Dataset When It Could Be Costly To Download The Entire Dataset
[Datasets] is it possible to get an individual file from a dataset? Example would be accessing only a single feature from a feature store Dataset when it cou...
one year ago
0 Votes
7 Answers
469 Views
0 Votes 7 Answers 469 Views
Outputs Of Final Few Colab Notebook Cells Not Logged
Outputs of final few colab notebook cells not logged Hey, We are creating a ClearML Task within a Google Colab notebook and using the Task, among other thing...
10 months ago
0 Votes
3 Answers
710 Views
0 Votes 3 Answers 710 Views
[Webapp : Pipeline] Hey, Me Again. When We Try And Delete A Pipeline On The Web App Pipelines Page, It Shows That It Is Trying To Do So With A Dialogue Box That Opens With A “Deleting” Bar Swishing Across, But Then It Just Hangs, And Becomes Completely Un
[WebApp : Pipeline] Hey, me again. When we try and delete a Pipeline on the Web App Pipelines page, it shows that it is trying to do so with a dialogue box t...
one year ago
0 [Datasets] Is It Possible To Get An Individual File From A Dataset? Example Would Be Accessing Only A Single Feature From A Feature Store Dataset When It Could Be Costly To Download The Entire Dataset

Ahh. This is a shame. I really want to use ClearML to efficiently compute features but it’s proving a challenge!
Thanks

one year ago
0 How Can I Run A New Version Of A Pipeline, Wait For It To Finish And Then Check Its Completion/Failure Status? I Want To Kick Off The Pipeline And Then Check Completion

The Pipeline is defined using PipelineDecorators, so currently to “build and run” it would just involve running the script it is defined in (which enqueues it and runs it etc).

This is not ideal, as I need to access the Task ID and the only methods I can see are for use within the Task/Pipeline ( Task.current_task and PipelineDecorator.get_current_pipeline )

The reason I want to check completion etc outside the Pipeline Task is that I want to run data validation etc once when the pipe...

one year ago
0 [Pipeline] Hey, Is It Possible To Specify The Output Uri For Pipelines And Their Components Using Pipeline Decorators? I Would Like To Store Pipeline Artifacts And Component Artifacts On S3.

The return objects were stored to S3 but PipelineDecorator.upload_artifact still uploaded to the file server. Not sure what was up with that but as explained in my next comment it did work when I tried again.

It also seems that PipelineDecorator.upload_artifact is not compatible with caching, sadly, but that is another issue for another thread that I will be starting on Monday.

Have a good weekend

one year ago
0 Outputs Of Final Few Colab Notebook Cells Not Logged

Hi John, we are using a self-hosted server with:

WebApp 1.9.2-317
Server: 1.9.2-317
API: 2.23

edit: clearml==1.11.0

10 months ago
0 Outputs Of Final Few Colab Notebook Cells Not Logged

I used task.flush(wait_for_uploads=True) in the final cell of the notebook

10 months ago
0 Outputs Of Final Few Colab Notebook Cells Not Logged

Yes, sorry, the final cell has the flush followed by the close

10 months ago
0 [Pipeline] Hey, Is It Possible To Specify The Output Uri For Pipelines And Their Components Using Pipeline Decorators? I Would Like To Store Pipeline Artifacts And Component Artifacts On S3.

I have added a lot of detail to this, sorry.

The inline comments in the code talk about that specific script/implementation.

I have added a lot of context in the doc string at the top.

one year ago
0 [Pipeline] Hey, Is It Possible To Specify The Output Uri For Pipelines And Their Components Using Pipeline Decorators? I Would Like To Store Pipeline Artifacts And Component Artifacts On S3.

Ahh that’s great, thank you.

And then I could use storage manager or whatever to get the files. Perfect

one year ago
0 [Pipeline] Hey, Is It Possible To Specify The Output Uri For Pipelines And Their Components Using Pipeline Decorators? I Would Like To Store Pipeline Artifacts And Component Artifacts On S3.

Hmm. Okay. Thanks

one year ago
0 Hey All, We Are Trying To Clone A Task That Uses Custom Pip Installed Packages And Run It Via An Agent. When Running Locally, We Simply “

To illustrate, here’s an example repo:

repo/
    package1/
    package2/ # installed separately to package1
    task_script.py # requires package1 and package2 to have been pip installed
one year ago
0 Hey All, We Are Trying To Clone A Task That Uses Custom Pip Installed Packages And Run It Via An Agent. When Running Locally, We Simply “

my colleague, @<1534706830800850944:profile|ZealousCoyote89> has been looking at this – I think he has used the relevant kwarg in the component decorator to specify the packages, and I think it worked but I’m not 100%. Connah?

one year ago
0 How Can I Run A New Version Of A Pipeline, Wait For It To Finish And Then Check Its Completion/Failure Status? I Want To Kick Off The Pipeline And Then Check Completion

The issue here is I don’t have the pipeline ID as it is a new version of the pipeline - i.e. the code has been updated, I want to run the updated pipeline (for the first time), get its ID, and then analyse the run/perform updates to tags (for example)

one year ago
Show more results compactanswers