Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
LazyTurkey38
Moderator
17 Questions, 56 Answers
  Active since 10 January 2023
  Last activity one year ago

Reputation

0

Badges 1

54 × Eureka!
0 Votes
9 Answers
655 Views
0 Votes 9 Answers 655 Views
There is some specificity with the way we setup our environment at my company that prevents me from using the full features of clearml-agent and forces me to...
2 years ago
0 Votes
1 Answers
657 Views
0 Votes 1 Answers 657 Views
Also, since this Slack workspace only allows searching up to 10,000 messages, useful information will be lost overtime. It’s been very useful for me personal...
2 years ago
0 Votes
30 Answers
676 Views
0 Votes 30 Answers 676 Views
Is it possible to give the agent access to install private pip packages (needs to be installed from the repo)? ERROR: Could not find a version that satisfies...
2 years ago
0 Votes
2 Answers
650 Views
0 Votes 2 Answers 650 Views
Do you have some documentation on what https://app.community.clear.ml/applications are useful for and how to use them? Are they going to be available for sel...
2 years ago
0 Votes
1 Answers
776 Views
0 Votes 1 Answers 776 Views
If we’re using the same git repo over and over for almost all jobs, is it possible to have the agents keep a local version and only download the diff of the ...
2 years ago
0 Votes
17 Answers
694 Views
0 Votes 17 Answers 694 Views
I’m trying to use task.execute_remotely but the repo I’m trying to use is not being identified correctly. I have it setup to git pull from a master repo and ...
2 years ago
0 Votes
13 Answers
668 Views
0 Votes 13 Answers 668 Views
Another issue is the agent uses Python 2 for some reason even though locally I’m using python 3 and the agent is supposed to use a python 3 venv. $ /home/smj...
2 years ago
0 Votes
1 Answers
684 Views
0 Votes 1 Answers 684 Views
Is there an example of how to use standalone mode? As in, if the packages, venv and git repo will be provided by the user, will they still get tracked in the...
2 years ago
0 Votes
17 Answers
749 Views
0 Votes 17 Answers 749 Views
I’m getting these errors when using agent in docker mode -bash: /etc/apt/apt.conf.d/docker-clean: Permission denied chown: cannot access '/root/.cache/pip': ...
2 years ago
0 Votes
4 Answers
649 Views
0 Votes 4 Answers 649 Views
I see that in the default setup, this command is part of the docker bash setup script: chown -R root /root/.cache/pip Does the agent assume it will be runnin...
2 years ago
0 Votes
1 Answers
780 Views
0 Votes 1 Answers 780 Views
Can someone please explain the difference between clearml-agent-services (that comes with the official docker compose) and clearml-agent deamon?
2 years ago
0 Votes
7 Answers
649 Views
0 Votes 7 Answers 649 Views
Hey all! Great job on ClearML by the way 🙂 I’m currently exploring whether it could be a fit for me and my team and I have a few questions: If I want to sen...
2 years ago
0 Votes
3 Answers
638 Views
0 Votes 3 Answers 638 Views
Is it possible to interact with the job queues directly from the python SDK?
2 years ago
0 Votes
2 Answers
662 Views
0 Votes 2 Answers 662 Views
There’s a typo in this repo name: https://github.com/allegroai/nvidia-cleamrl-integration
2 years ago
0 Votes
5 Answers
812 Views
0 Votes 5 Answers 812 Views
Related to my above thread, I think there is some more customization that needs to be supported to use docker mode properly for different use-cases. It seems...
2 years ago
0 Votes
1 Answers
721 Views
0 Votes 1 Answers 721 Views
I’m running the clearml agent in standalone mode but it still installs the virtual env, is that the expected behavior? clearml-agent daemon --queue venv_queu...
2 years ago
0 Votes
3 Answers
647 Views
0 Votes 3 Answers 647 Views
When scheduling a job for remote execution, is it possible to decide whether to use the repo’s formal requirements sheet vs the currently installed venv libr...
2 years ago
0 When Scheduling A Job For Remote Execution, Is It Possible To Decide Whether To Use The Repo’S Formal Requirements Sheet Vs The Currently Installed

I’m not sure but it seems like you get different kinds of flexibility depending on whether you enqueue the task yourself or whether you rely on execute_remotely . I think ideally if I could choose to get the benefit of auto-scanning provided by execute_remotely as well as more flexibility it would be great.

2 years ago
0 Is It Possible To Give The Agent Access To Install Private Pip Packages (Needs To Be Installed From The Repo)?

... more-itertools==8.6.0 -e git+git@github.com:user/private_package.git@57f382f51d124299788544b3e7afa11c4cba2d1f#egg=private_package msgpack==1.0.2 msgpack-numpy==0.4.7.1 ...

2 years ago
0 Hi

I’m wondering, would an older version of the agent work well with a newer server version and vice-versa?

2 years ago
0 There Is Some Specificity With The Way We Setup Our Environment At My Company That Prevents Me From Using The Full Features Of

So when the repo is cloned and venv is created and activated I want to executed this from the repo: tools/setup_dependencies.sh

2 years ago
0 There Is Some Specificity With The Way We Setup Our Environment At My Company That Prevents Me From Using The Full Features Of

For your second question, those are generated using custom tooling, it relies on the build system to be setup which is guaranteed by the docker image used. So I don’t think this is a case of supporting a specific env setup or build tool but just allowing custom script for env setup step / building code.
WDYT?

2 years ago
0 Is It Possible To Interact With The Job Queues Directly From The Python Sdk?

Being able to create and remove queues as well as list their contents.

2 years ago
0 I’M Getting These Errors When Using Agent In Docker Mode

AgitatedDove14 should I try running the above command with privileged user?

2 years ago
0 I’M Getting These Errors When Using Agent In Docker Mode

I tried with and without. I’m having the issue where if I run the task from the queue it will complete as soon as it goes into docker but if I run the same docker run it works.

2 years ago
0 I’M Getting These Errors When Using Agent In Docker Mode

It’s not that I think because it works if I run the same command manually.

2 years ago
0 I’M Getting These Errors When Using Agent In Docker Mode

ugh, sudo actually makes it fail explicitly because
` error: Could not fetch origin
Repository cloning failed: Command '['git', 'fetch', '--all', '--recurse-submodules']' returned non-zero exit status 1.

  1. Make sure you pushed the requested commit:
    (repository='git@github.com:salimmj/clearml-demo.git', branch='main', commit_id='f76f3affd28d5558928d7ffd9a6797890ffdd708', tag='', docker_cmd='nvidia/cuda:11.4.0-runtime-ubuntu20.04', entry_point='mnist.py', working_dir='.')
  2. Check if remote-wo...
2 years ago
0 I’M Trying To Use

$ git remote -v fork git@github.com:salimmj/somerepo.git (fetch) fork git@github.com:salimmj/somerepo.git (push) origin git@github.com:mainuser/somerepo.git (fetch) origin git@github.com:mainuser/somerepo.git (push)I want to keep the above setup, the remote branch that will track my local will be on fork so it needs to pull from there. Currently it recognizes origin so it doesn’t work because the agent then can’t find the commit.

2 years ago
0 I’M Getting These Errors When Using Agent In Docker Mode

btw, AgitatedDove14 I launch the agent daemon outside docker (with --docker ) , that’s the way it is supposed to work right?

$ clearml-agent daemon --detached --queue manual_jobs automated_jobs --docker --gpus 0
And then the worker itself will run the docker run command for me and start another non-daemon agent inside.
I guess the failure happens when it tries to switch to docker because the same experiment works with agents not started with --docker flag

2 years ago
0 I’M Getting These Errors When Using Agent In Docker Mode

SuccessfulKoala55 I tried to make a docker image by combining one of our dockerfiles with this https://github.com/allegroai/clearml-agent/blob/master/docker/agent/Dockerfile . I modified the entrypoint to also be a combination of both.

Right now I’m not seeing that error, but the the process seems to exit (as completed) after the docker run . I’m wondering if my Dockerfile is not properly setup and it’s exiting before the deamon is started.

2 years ago
0 Is It Possible To Give The Agent Access To Install Private Pip Packages (Needs To Be Installed From The Repo)?

Is there a way to make it use ssh+git instead of git+git ? Maybe add a force_ssh_pip_install to the agent config?

2 years ago
0 I’M Trying To Use

It recognizes the main repo, but I want it to push and pull from another one (my own forked repo). AgitatedDove14

2 years ago
0 I’M Trying To Use

I already have that set to true and want that behavior. The issue is on the “committed” change set. When I push code to github I push to my fork and pull from the main/master repo (all changes go through PRs from fork to main).

Now when I use execute_remotely , whatever code does the git discovery, considers whatever repo I pull from the repo to use. But these changes haven’t necessarily been merged into main. The correct behavior would be to use the forked repo.

2 years ago
2 years ago
0 Do You Have Some Documentation On What

I think it’s great to let users build their own UI-connected apps, I’d use that for sure!

2 years ago
0 Is It Possible To Give The Agent Access To Install Private Pip Packages (Needs To Be Installed From The Repo)?

The private_package can be installed by doing pip install git+ssh://git@github.com/user/private_package.git but the agent is trying to do pip install private_package which won’t work.

2 years ago
0 I’M Getting These Errors When Using Agent In Docker Mode

AgitatedDove14 no I mean I can do:
` docker run -t --gpus "device=1" -dit -e APP_ENV=kprod -e CLEARML_WORKER_ID=ada:gpu1 -e CLEARML_DOCKER_IMAGE=922531023312.dkr.ecr.us-west-2.amazonaws.com/jym-coach:202108080511.7e8d6d1 -v /home/smjahad/.gitconfig:/root/.gitconfig -v /tmp/.clearml_agent.kjx6r9oo.cfg:/root/clearml.conf -v /tmp/clearml_agent.ssh.l8cguj81:/root/.ssh -v /home/smjahad/.clearml/apt-cache.1:/var/cache/apt/archives -v /home/smjahad/.clearml/pip-cache:/root/.cache/pip -v /home/smjah...

2 years ago
0 Is It Possible To Give The Agent Access To Install Private Pip Packages (Needs To Be Installed From The Repo)?

If you were to add this, where would you put it? I can use a modified version of clearml-agent

2 years ago
Show more results compactanswers