![Profile picture](https://clearml-web-assets.s3.amazonaws.com/scoold/avatars/UnevenDolphin73.png)
Reputation
Badges 1
662 × Eureka!Perfect now π (also nice cleanup of default_new_data_root
duplicate code :D)
And agent too, I hope..?
I'd be happy to join a #releases channel just for these!
Just randomly decided to check and saw there's a server 1.4 ready π
The Task.init
is called at a later stage of the process, so I think this relates again to the whole setup process we've been discussing both here and in #340... I promise to try ;)
I... did not, ashamed to admit. The documentation says only boolean values.
And last but not least, for dictionary for example, it would be really cool if one could do:my_config = task.connect_configuration(my_config, name=name) my_other_config = task.connect_configuration(my_other_config, name=other_name) my_other_config['bar'] = my_config # Creates the link automatically between the dictionaries
Running a self-hosted server indeed. It's part of a code that simply adds or uploads an artifact π€
https://clear.ml/docs/latest/docs/references/sdk/services_monitor
Then you can run this as a task, see also this example https://clear.ml/docs/latest/docs/guides/services/slack_alerts
That's enabled; I was aiming if there are flags to add to pip install
CLI, such as --no-use-pep517
So basically I'm wondering if it's possible to add some kind of small hierarchy in the artifacts, be it sections, groupings, tabs, folders, whatever.
I can navigate through the projects, but selecting one task in one project, then navigating to another project and selecting a different task -> there is no suggestion to compare the tasks.
In the projects page if I show all - I just see the projects. If I search for a task of similar name, I get results, but I can't compare them via the UI.
The only way I managed so far was to create a pseudo-comparison between unrelated tasks in the same project, then remove one task from comparion, and u...
As the meme goes, well yes but actually no, since the input path is provided via argparse? I'm also not sure how this would help debug from the WebUI - you can't really see the contents of a zipped file/the configuration tab is too messy for such a nested configuration as the one we have. It's best suited as an artifact.
EDIT: Or am I missing something? Point being, when the remote execution begins, the entry point tries to run e.g. python train.py --config_file path/to/local/file.yaml
...
Always great to find a bug! I'll make relevant SDK updates then.
Latest (1.5.1 I believe?), full log incoming, but it's like I've posted elsewhere already π€
It just sets up the environment and immediately crashes when trying to run the code.
The setup itself is done correctly.
Another example - trying to validate dataset interactions ends with
` else:
self._created_task = True
dataset_project, parent_project = self._build_hidden_project_name(dataset_project, dataset_name)
task = Task.create(
project_name=dataset_project, task_name=dataset_name, task_type=Task.TaskTypes.data_processing)
if bool(Session.check_min_api_server_version(Dataset.__min_api_version)):
get_or_create_proje...
You mean at the container level or at clearml?
Yes, the container level (when these docker shell scripts run).
The per user ID would be nice, except I upload the .env
file before the Task
is created (it's only available really early in the code).
Interesting, why wonβt it be possible? Quite easy to get the source code using e.g. dill
.
I think also the script path in the created task will cause some issues, but letβs seeβ¦
After the task was initialized? π€
I have seen this quite frequently as well tbh!
Anything else youβd recommend paying attention to when setting the clearml-agent helm chart?
Weβre using karpenter
(more magic keywords for me), so my understanding is that that will manage the scaling part.
Much much appreciated π
What do you mean π Using logging.config.dictConfig(...)
I'll try it out, but I would not like to rewrite that code myself maintain it, that's my point π
Or are you suggesting I Task.import_offline_session
?
From our IT dept:
Not really, when you launch the instance, the launch has to already be in the right VPC/Subnet. Configuration tools are irrelevant here.
I'd like to set up both with and without GPUs. I can use any region, preferably some EU one.
I'll see if we can do that still (as the queue name suggests, this was a POC, so I'm trying to fix things before they give up π ).
Any other thoughts? The original thread https://clearml.slack.com/archives/CTK20V944/p1641490355015400 suggests this PR solved the issue
CostlyOstrich36 That looks promising, but I don't see any documentation on the returned schema (i.e. workers.worker_stats
is not specified anywhere?)