Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
UnevenDolphin73
Moderator
106 Questions, 749 Answers
  Active since 10 January 2023
  Last activity 9 months ago

Reputation

0

Badges 1

662 × Eureka!
0 How Can I Send A Composed Chunk Of Code For Remote Execution

Maybe create_function_task ? šŸ¤”

11 months ago
2 years ago
0 For Remote Execution Where The Queue Has

The poetry.lock in github, it seems šŸ¤”

2 years ago
0 I'M Trying To Set Up Some Initial Experiments Within Our Stack, But When I Use The

From the log you shared, the task is picked up by theĀ 

worker_d1bd92a3b039400cbafc60a7a5b1e52b_4e831c4cbaf64e02925b918e9a3a1cf6_<hostname>:gpu0,1

Ā worker

I can try and target the default one if it helps..?

3 years ago
0 For Remote Execution Where The Queue Has

It's pulled from the remote repository, my best guess is that the uncommitted changes apply only after the environment is set up?

2 years ago
0 I Realize I'M Asking Many Niche Questions - My Apologies

Follow up on this btw, from the WebUI/Server POV, I see there's an "Admin" role, etc. Do those have additional views available, such as users etc?

2 years ago
0 Is There Any Testing Suite That Ships With Clearml? If We'D Like To Make Some Unit Tests For Our Code?

I'll try it out, but I would not like to rewrite that code myself maintain it, that's my point šŸ˜…

Or are you suggesting I Task.import_offline_session ?

2 years ago
0 What Would Be The Best Way To Approach This Flow?

Now, the original pyhocon does support include statements as you mentioned - https://github.com/chimpler/pyhocon

2 years ago
0 <Edited> Two Things:

The last kind when launching the agents.
The former on task execution.

2 years ago
0 Trying To Run Aws Autoscaler With

Sure SuccessfulKoala55 , and thanks for looking into it.

As an alternative (for now, or in general), we could consider reverting back to pip. The issue we encounter is that we have a monorepo, so frozen requirements should specify relative paths, but pip freeze does not seem to do that, so ClearML also fails in pip mode

one year ago
0 How Can I Send A Composed Chunk Of Code For Remote Execution

Thanks @<1537605940121964544:profile|EnthusiasticShrimp49> ! Thatā€™s definitely the route I was hoping to go, but the create_function_task is still a bit of a mystery, as Iā€™d like to use an entire class with relevant logic and proper serialization for inputs, and potentially Iā€™ll need to add more ā€œhelper functionsā€ (as in the case of DataTransformationStep , for example). Any thoughts on that? šŸ¤”

11 months ago
0 For Some Reason The Agent Is Now Trying To Use Python 2.7 All Of A Sudden, Any Idea Why?

Yes; I tried running it both outside venv and inside a venv. No idea why it uses 2.7?

2 years ago
0 For Some Reason The Agent Is Now Trying To Use Python 2.7 All Of A Sudden, Any Idea Why?

I also tried switching to dockerized mode now, getting the same issue šŸ¤”

2 years ago
0 Is There A Way To Set Precedence On Package Managers? If We Set An Agent To Use

Hmmm maybe šŸ¤” I thought that was expected behavior from poetry side actually

2 years ago
0 I Realize I'M Asking Many Niche Questions - My Apologies

Don't even need to specify json=... šŸ˜‰ Thanks!

2 years ago
0 Since V1.4.0, Our

It could be related to ClearML agent or server then. We temporarily upload a given .env file to internal S3 bucket (cache), then switch to remote execution. When the remote execution starts, it first looks for this .env file, downloads it using StorageManager, uses dotenv, and then continues the execution normally

2 years ago
3 years ago
0 Is There A Way To Set Precedence On Package Managers? If We Set An Agent To Use

Right so it uses whatever version is available on the agent.
Yeah it would be nice to have either a poetry_version (a-la https://github.com/allegroai/clearml-agent/blob/5afb604e3d53d3f09dd6de81fe0a494dacb2e94d/docs/clearml.conf#L62 ), rename the latter to manager_version , or just install from the captured environment, etc? šŸ¤”

2 years ago
0 Can Steps Be Removed From Pipelines, And/Or Can Pipelines Be Generally Modified Other Than Adding Steps To Them?

Oh nono, more like:

  • Create a pipeline
  • Add N steps to it
  • Run the pipeline
  • It fails/succeeds, the user does something with the output
  • The user would like to add/modify some steps based on the results now (after closer inspection).I wonder if at (5), do I have to recreate the pipeline every time? šŸ¤”
11 months ago
0 How Can I Ensure Tasks In A Pipeline Have The Same Environment As The Pipeline Itself? It Seems A Bit Counter-Intuitive That The Pipeline (Executed Remotely) Captures The Local Environment, But The Tasks (Executed Remotely) Do Not Use That Same Environmen

We have an internal mono-repo and some of the packages are required - theyā€™re all available correctly for the controller, only some are required for the individual tasks, but the ā€œmagicā€ doesnā€™t happen šŸ˜ž
That is, the controller does not identify them as a requirement, so theyā€™re not installed in the tasks environment.

one year ago
0 How Can I Ensure Tasks In A Pipeline Have The Same Environment As The Pipeline Itself? It Seems A Bit Counter-Intuitive That The Pipeline (Executed Remotely) Captures The Local Environment, But The Tasks (Executed Remotely) Do Not Use That Same Environmen

Iā€™ve tracked it down further, it seems the pigar utility does not apply any smart logic there.
The case we have is the following -

  • We have a monorepo, but all modules/libs share a common namespace foo ; so e.g. working on module mod , we use from foo.mod import ā€¦
  • This then looks for a module called foo , even though itā€™s just a namespace
  • In the dist-info requirement, it seems any hyphen, dot, etc are swapped for an underscore, so our site-packages represents this as `foo_m...
one year ago
0 How Can I Ensure Tasks In A Pipeline Have The Same Environment As The Pipeline Itself? It Seems A Bit Counter-Intuitive That The Pipeline (Executed Remotely) Captures The Local Environment, But The Tasks (Executed Remotely) Do Not Use That Same Environmen

Itā€™s just that for the packages argument, ClearML says:

If not provided, packages are automatically added based on the imports used inside the wrapped function.

Soā€¦ šŸ¤”

one year ago
Show more results compactanswers