Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
SmugTurtle78
Moderator
7 Questions, 31 Answers
  Active since 10 January 2023
  Last activity one year ago

Reputation

0

Badges 1

30 × Eureka!
0 Votes
12 Answers
546 Views
0 Votes 12 Answers 546 Views
Hi
Hi 🙂 I use Clearml agents to execute tasks, I would like to remove irrelevant info logs (logs of the agent setup - such as: "Summary - installed python pack...
one year ago
0 Votes
5 Answers
605 Views
0 Votes 5 Answers 605 Views
Hi, I am using spot instances (launched by auto-scaler PRO service), but I see that sometimes the instance is suddenly terminated and the task status is stil...
one year ago
0 Votes
1 Answers
225 Views
0 Votes 1 Answers 225 Views
3 months ago
0 Votes
21 Answers
536 Views
0 Votes 21 Answers 536 Views
Hi, I am trying to use the ClearML AWS Autoscaler Service (in the PRO version) and getting this error: raceback (most recent call last): File "/root/.clearml...
one year ago
0 Votes
4 Answers
521 Views
0 Votes 4 Answers 521 Views
one year ago
0 Votes
12 Answers
673 Views
0 Votes 12 Answers 673 Views
Hi, I am getting this error when using the aws auto_scaler service (with the PRO version): Traceback (most recent call last): File "/root/.clearml/venvs-buil...
aws
one year ago
0 Votes
4 Answers
622 Views
0 Votes 4 Answers 622 Views
Hi, Is there any manifest for the relevant polices needed for the AWS account (if we are using autoscaling)? Also, Is there a way to use Github deploy key in...
one year ago
0 Hi, I Am Trying To Use The Clearml Aws Autoscaler Service (In The Pro Version) And Getting This Error:

About the CPU mode, used t3.medium...
About the specific configuration, of course- was trying this policy for example ( when I remove the ec2-vpc condition it works)
` {
"Sid": "GeneralEC2",
"Effect": "Allow",
"Action": [
"ec2:AttachClassicLinkVpc",
"ec2:CancelSpotInstanceRequests",
"ec2:CreateFleet",
"ec2:Describe*",
"ec2:GetConsoleOutput",
"ec2:DetachClassicL...

one year ago
0 Hi, I Am Trying To Use The Clearml Aws Autoscaler Service (In The Pro Version) And Getting This Error:

It is working with "Resource": "*" , I will try to use it and maybe use deny for specific configuration, thanks :)

one year ago
0 Hi, I Am Getting This Error When Using The Aws Auto_Scaler Service (With The Pro Version):

Hi TimelyPenguin76 , What is your estimation to the next release ? We are really waiting for this 🙂

one year ago
0 Hi, I Am Using Spot Instances (Launched By Auto-Scaler Pro Service), But I See That Sometimes The Instance Is Suddenly Terminated And The Task Status Is Still 'Running' ( And Not 'Failed' Or Something Else

CostlyOstrich36 actually, as I see it from logs, it spun a new instance but not retried the task, maybe because shown 'Found 0 tasks in queue' (after a mission is running it is removed automatically from queue). I cant see something new in the task logs also (still stuck), so it seems that the problem still exist .

one year ago
0 Hi, I Am Trying To Use The Clearml Aws Autoscaler Service (In The Pro Version) And Getting This Error:

CostlyOstrich36 AnxiousSeal95
So ,when I was added specific configuration it failed.
Is there a way to lower the needed credentials for specific actions such as: run, stop, start instances etc...? for example: fixing it to work only with conditions of specific subnet, security group and instance types? ( I was trying doing it but as I said it failed with this message:
` An error occurred (UnauthorizedOperation) when calling the RunInstances operation: You are not authorized to perform th...

one year ago
0 Hi, I Am Trying To Use The Clearml Aws Autoscaler Service (In The Pro Version) And Getting This Error:

I tried again and now it is working ,The version is: v1.4.0.
about the options of subnet & security group, I saw it already, but I use it but still I want to give the app lower policy that enable it to run only this network and this security group. CostlyOstrich36

one year ago
0 Hi

@<1523701205467926528:profile|AgitatedDove14> I am not sure if it would help but lets try 🙂

one year ago
0 Hi

@<1523701205467926528:profile|AgitatedDove14> Actually what my service do is to collect stdout/stderr from the Docker socket. I meant to the stdout/stderr .

one year ago
0 Hi

Maybe if there would be a way to change their format, it could also help filtering them from my side.

one year ago
0 Hi

@<1523701205467926528:profile|AgitatedDove14> Even if there is a way to set the format of those logs, that will be fine for now

one year ago
0 Hi, I Am Getting This Error When Using The Aws Auto_Scaler Service (With The Pro Version):

Hi TimelyPenguin76 , Is there any news about the release? 🙂

one year ago
0 Hi, I Am Getting This Error When Using The Aws Auto_Scaler Service (With The Pro Version):

[{"resource_name": "clearml_agent_gpu", "instance_type": "g4dn.xlarge", "cpu_only": false, "is_spot": false, "availability_zone": "eu-west-1a", "ami_id": "ami-00511f188b842c5cc", "num_instances": 1, "queue_name": "default", "tags": "*", "ebs_device_name": "/dev/sda1", "ebs_volume_size": 500, "ebs_volume_type": "gp3", "key_name": "***", "security_group_ids": "", "subnet_id": "**"}]

one year ago
0 Hi, Is There Any Manifest For The Relevant Polices Needed For The Aws Account (If We Are Using Autoscaling)? Also, Is There A Way To Use Github Deploy Key Instead Of Personal Token? Thanks !

Thanks for the answers, about the git credentials I would like to set limited access (read only) to only one specific repository , the personal token is not allows it ... Is ssh key is possible to use ? ( the autoscaling UI request personal token only)

one year ago
0 Hi

Hi CostlyOstrich36 ,Thanks for your answer, I would like it to be configurable , just like I set logging level for my logs.

one year ago
0 Hi, I Am Trying To Use The Clearml Aws Autoscaler Service (In The Pro Version) And Getting This Error:

CostlyOstrich36 I would like to add more conditions such as security groups and instance types- this is only an example :)

one year ago
0 Hi, I Am Getting This Error When Using The Aws Auto_Scaler Service (With The Pro Version):

We are working vpc, actually I didn't try on of the params cause we need them both...
Do you mean to the resources configuration or the general?

one year ago
0 Hi

Hi @<1523701205467926528:profile|AgitatedDove14> , I send the agent's logs to log management and monitoring service, and we get big amount of info logs (especially if we use schedulers and launch agents again and again as part of the production pipeline). I think that it is important to set level also for other levels then debugging, WDYT?

one year ago
0 Hi

@Is there a way to choose other logs format ? to get a json or something like that?
or setting logging level?

one year ago
0 Given I Want To Run A Task In A Pipeline Using A Base Task Id. One Of My Steps Just Finds The Latest Results To Use. I Want The Task To Output The Id Of The Results And The Next Step To Use It. How Would I Go About Doing This? Is There A Way To Pass Just

Dont sure if this a good solution for me since I wanted to add it as a paramater....
For example:
In dataset_creation utility I do this upload:
task.upload_artifact('id_of_running_creation', artifact_object=id_of_running)In Inference utility I do this upload:
task.upload_artifact('id_of_running_inference', artifact_object=id_of_running)and I would like to use them as a parameters to the next step of the pipeline run:
like this:
` pipe.add_step(
name='post_processing',....,
pa...

one year ago
0 Hi, I Am Getting This Error When Using The Aws Auto_Scaler Service (With The Pro Version):

Hi TimelyPenguin76 , how are you? have you found something?

one year ago
one year ago
0 Hi, I Am Trying To Use The Clearml Aws Autoscaler Service (In The Pro Version) And Getting This Error:

No, I want to use AWS user with much lower credentials ( Only to relevant for the autoscaler missions)- for example Describe/ RequestSpotInstance/ StopInstances permissions only for the relevant subnet, security group and instance types..

one year ago
0 Hi, I Am Trying To Use The Clearml Aws Autoscaler Service (In The Pro Version) And Getting This Error:

CornyDeer86 you are the best! AnxiousSeal95 thanks for your help also, we have been trying to solve this problem for a long time, and now it works like a magic.
conclusions:
minimal policy needed for the auto-scaling service if we want to specify security group and subnet for RunInstances action permissions and also to use spot instances (as far as we found until now):
still one problem is existing - AWS doesn't support specifications of resources for DescribeInstances/RequestSpotInstances...

one year ago
Show more results compactanswers