Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
BattyCrocodile47
Moderator
35 Questions, 147 Answers
  Active since 02 March 2023
  Last activity 2 months ago

Reputation

0

Badges 1

129 × Eureka!
0 Votes
2 Answers
1K Views
0 Votes 2 Answers 1K Views
Does clearML have a good story for offline/batch inference in production? I worked in the Airflow world for 2 years and these are the general features we use...
2 years ago
0 Votes
13 Answers
1K Views
0 Votes 13 Answers 1K Views
2 years ago
0 Votes
5 Answers
1K Views
0 Votes 5 Answers 1K Views
Whelp. Here's our hackathon demo submission for a ClearML VS Code extension @<1523701205467926528:profile|AgitatedDove14> and @<1523701087100473344:profile|S...
one year ago
0 Votes
2 Answers
1K Views
0 Votes 2 Answers 1K Views
AWS autoscale question: can the autoscaler use the IAM role of the EC2 instance it’s running on rather than needing to be provided AWS keys?
one year ago
0 Votes
10 Answers
1K Views
0 Votes 10 Answers 1K Views
I’m working on an automated deployment of ClearML with IaC. I’ve got a script to start an EC2 instance that runs the docker compose file. Separately, I’ve go...
one year ago
0 Votes
5 Answers
2K Views
0 Votes 5 Answers 2K Views
I'm getting some weird ClearML behavior. I've deployed it to an EC2 instance. When I access :8080 , I see the full ClaerML app as expected (first screenshot)...
2 years ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
2 years ago
0 Votes
2 Answers
1K Views
0 Votes 2 Answers 1K Views
2 years ago
0 Votes
0 Answers
286 Views
0 Votes 0 Answers 286 Views
Is anyone from ClearML going to be in Austin for GenAI / MLOps world?? https://www.linkedin.com/posts/eric-riddoch_5th-ann-mlops-world-and-generative-ai-wor[...
5 months ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
Hi,
Hi, @<1565509803839590400:profile|MoodyBear54> and I are trying to deploy the ClearML autoscaler to deploy the EC2 instances into a pre-existing VPC/subnet. ...
one year ago
0 Votes
9 Answers
1K Views
0 Votes 9 Answers 1K Views
Security question: in my journey of running ClearML the "hard way" (self-hosted), one problem I haven't solved is security. Some discussion here...
one year ago
0 Votes
4 Answers
961 Views
0 Votes 4 Answers 961 Views
Hey
Hey @<1523701205467926528:profile|AgitatedDove14> ! Don't know if you're up but we're working on the VS Code extension at the hackathon rn!
one year ago
0 Votes
19 Answers
1K Views
0 Votes 19 Answers 1K Views
Hey
Hey @<1523701205467926528:profile|AgitatedDove14> , I saw this SO answer you gave about ClearML's docker-compose.yaml . You described getting a secret key pa...
one year ago
0 Votes
7 Answers
1K Views
0 Votes 7 Answers 1K Views
Hi friends, we got on a sales call with ClearML yesterday and a discussion about webhooks came up. ClearML seems to not natively implement webhooks It seems ...
one year ago
0 Votes
5 Answers
1K Views
0 Votes 5 Answers 1K Views
ClearML tracks the executed .py file, so you can re-run the experiment. But... - With Metaflow DAGs, you pass a run argument to your training script, e.g. py...
one year ago
0 Votes
6 Answers
1K Views
0 Votes 6 Answers 1K Views
Another AWS autoscaler question. The docker-compose.yml automatically adds a ClearML agent to the services queue. When I run python aws_autoscaler.py --remot...
one year ago
0 Votes
0 Answers
1K Views
0 Votes 0 Answers 1K Views
I gave a demo of ClearML to our data engineering team (is also the ML infra team) and it went over really well! πŸŽ‰ We have two data science teams that we are...
2 years ago
0 Votes
7 Answers
2K Views
0 Votes 7 Answers 2K Views
Can you help me make the case for ClearML pipelines/tasks vs Metaflow? Context within...
one year ago
0 Votes
0 Answers
1K Views
0 Votes 0 Answers 1K Views
If anyone wants to join remotely, there’s a remote-first AI/ML hackathon happening tomorrow. Some of the details are out of date right now—I’ll have this pag...
one year ago
0 Votes
5 Answers
223 Views
0 Votes 5 Answers 223 Views
2 months ago
0 Votes
1 Answers
1K Views
0 Votes 1 Answers 1K Views
Is there a command line interface that lets you query and download models from the ClearML model registry the way you can with MLFlow? Example: # search for ...
one year ago
0 Votes
3 Answers
2K Views
0 Votes 3 Answers 2K Views
If I want to run tensorflow (version 2.10.0 with Python 3.8) with the AWS autoscaler, which AMI and Docker base image should I choose?
one year ago
0 Votes
6 Answers
1K Views
0 Votes 6 Answers 1K Views
Sorry for always posting such cryptic problems. I managed to create a docker-compose file that runs ClearML and it sets up 2 agents, one on the services queu...
one year ago
0 Votes
20 Answers
1K Views
0 Votes 20 Answers 1K Views
How would ya'll approach backing up the elastic-search/redis/etc. data in self-hosted ClearML? Any drawbacks/risks of doing a simple process that periodicall...
one year ago
0 Votes
18 Answers
1K Views
0 Votes 18 Answers 1K Views
Can anyone recommend a good workflow for clearml-session ? I like to code in the desktop app of VS Code. Right now, I - run clearml-session ... to start a se...
one year ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
2 years ago
0 Votes
9 Answers
404 Views
0 Votes 9 Answers 404 Views
5 months ago
0 Votes
1 Answers
1K Views
0 Votes 1 Answers 1K Views
You guys, thank you so much. I have super positive things to say about ClearML and I'm very excited to try it out at work (still selling it) https://www.link...
one year ago
0 Votes
7 Answers
954 Views
0 Votes 7 Answers 954 Views
Working on the VS Code extension. Pretty stumped on this one...
one year ago
0 Votes
7 Answers
2K Views
0 Votes 7 Answers 2K Views
Hey friends, how do you configure ClearML to use an S3 bucket? Specifically: does every data scientist have to have hard-coded AWS credentials with read/writ...
2 years ago
Show more results questions
0 More Of Pushing Clearml To It'S Data Engineering Limits

possibly cheaper on the cloud (Lambda vs EC2 instance)

Whoa, are you saying there's an autoscaler that doesn't use EC2 instances? I may be misunderstanding, but that would be very cool.

Maybe I should have said: my plan is to use AWS StepFunctions where a single task in the DAG is an entire ClearML pipeline . The non-ClearML steps would orchestrate putting messages into a queue, doing retry logic, and triggering said pipeline.

I think at some point, there has to be some amount of...

2 years ago
0 Hi Community! I'M Facing An Issue With A Self-Hosted Clearml Server. I Modified The Docker-Compose File So To Have All The Volumes Mounted In A Specific Location (

Here's a docker-compose I've been playing with. It doesn't have the same restart problem you're describing, but I did change the volume mounts: None

one year ago
0 More Of Pushing Clearml To It'S Data Engineering Limits

If this works, we might be able to fully replace Metaflow with ClearML!

(Refering to the feature where Metaflow creates Step Functions state machines for you, and then you can use those to trigger event-driven batch jobs in the same way described here)

2 years ago
0 My Team Uses Metaflow By Outerbounds. Great Dag Tool. Super Robust. We Run Our Production Workloads On It And Use It For Experimentation, Too. I'M Considering Adding Clearml To Our Stack As An Exp Tracker / Model Registry Rather Than Going With The More

you mean as experiment management / model registry / data? I think this is the bread&butter of clearml

πŸ’― . I was wondering if anyone had had experience using ClearML together with one of these others.

I think most of them are alternatives to metaflow

Totally.

Like, if you google "dagster and clearml" or "prefect and clearml" or "airflow and clearml" -- I don't find any blogs written by people talking about how they use both of them together.

That's strange to me, becau...

2 months ago
0 Working On The Vs Code Extension. Pretty Stumped On This One...

While I'm wishing for things: it'd be awesome if it had a queue already set up. But if there's not a way to do that in the docker compose file, I could potentially write a script that uses the creds to create one using API calls

one year ago
0 Whelp. Here'S Our Hackathon Demo Submission For A Clearml Vs Code Extension

Thank you! For now, it's kind of nice that it just picks up your credentials from your conf file. No extra setup required beyond the onboarding ClearML has you do πŸ˜„

And look! It's working, assuming you start the clearml session up yourself:

one year ago
0 Hey

Is there some way we could programmatically list all current ClearML sessions?

We need a way to do that, maybe with the clearml-session CLI in order to populate the VS Code extension menu.

one year ago
0 More Of Pushing Clearml To It'S Data Engineering Limits

To do this, I think I need to know:

  • Can you trigger a pre-existing Pipeline via the ClearML REST API? I'd want to have a Lambda function trigger the Pipeline for a batch without needing to have all the Pipeline code in the lambda function. Something like curl -u '<clearml credetials>' None ,...
  • [probably a big ask] If the pipeline succeeds/fails, can ClearML emit an event that I can react to? Like mayb...
2 years ago
0 Security Question: In My Journey Of Running Clearml The "Hard Way" (Self-Hosted), One Problem I Haven'T Solved Is Security. Some Discussion Here...

OOooh, excellent. So the file server isn't necessary at all if you're using some other object storage? That's slick!

Is there a way I could move the JWT authentication (not authorization) logic into an API Gateway or Load Balancer? For example, if ClearML is following OAuth 2.0, then the load balancer or API Gateway could reach out to it's "issuer URL" (probably available on the EC2 instance where ClearML is running) like this example here.
![image](https://clearml-web-assets.s3.amazonaws.c...

one year ago
0 My Autoscaled Instance Fails When Running "Git Clone" On A Private Repo. I

I'm not seeing a extra_docker_shell_script in my clearml.conf generated by clearml-agent init like in this guide

one year ago
0 Security Question: In My Journey Of Running Clearml The "Hard Way" (Self-Hosted), One Problem I Haven'T Solved Is Security. Some Discussion Here...

I'm imagining:

  • The EC2 instance would be in a private subnet, accessible only on the VPN (read: VPC)
  • The API Gateway and Load Balancer would also be on the VPC and therefore have access to the private subnet BUT the API Gateway or Load Balancer themselves would be exposed to the public internet.
    That way, to do the JWT authentication, the load balancer or API Gateway could reach out to the EC2 instance on the private network to authenticate any incoming ClearML SDK requests.
one year ago
0 Is There Any Documentation From Clearml On Best Practices For Mounting/Using External Ebs Volumes For The Clearml Server? We Would Like To Mount An External Ebs Volume To The

I symlinked

/opt/clearml

to

/mnt/xvda/clearml

Genius! I don't think I accounted for making sure the volumes ended up in the EBS volume mount in this CDK example ^^^. And I modified the docker-compose.yml file to point at a different location. Sym-linking is totally the route I should take if I get time to come back and clean up this repo.

one year ago
0 Crazy Idea:

Duh! I bet VS Code's Python extensions like the VS Code Black Extension would be a really good starting place. They are small and are wrappers around a Python CLI tool. I bet there's a lot we could adapt for the ClearML CLI

one year ago
0 Hey Friends, How Do You Configure Clearml To Use An S3 Bucket? Specifically: Does

Thanks Vasil! Can you elaborate on what you mean by using boto3? Do you mean writing a script using boto that pulls the credentials down and writes to the user's clearml.conf

Also, I've been seeing references to "credentials vault" in the docs. I can see this is the problem that it solves.

one year ago
0 Hello, Is There Any Hope To Use Clearml-Serving Without The Clearml Server? The Tutorial And Docs Make It Seem Like It'S Required But I Wanted To Check To Be Sure. I Really Like All The Features That Clearml Provides But It Seems Like Everything Is Deep

I’d really prefer it was modular enough to use serving with any model registry

Oh that's interesting. To serve a model from MLflow, would you have to copy it over to ClearML first?

one year ago
0 Working On The Vs Code Extension. Pretty Stumped On This One...

Interesting . It’s actually just running locally on my laptop. It seemed only to be an issue when pointing the ClearML session CLI at my local version of ClearML. Still thinking about this one.

one year ago
0 Sorry For Always Posting Such Cryptic Problems. I Managed To Create A Docker-Compose File That Runs Clearml

And for the session

clearml-session --queue sessions --docker python:3.9
one year ago
0 Crazy Idea:

Playing around this weekend to learn the ins and outs of extensions
image

one year ago
0 Hey

Aren't they two different auth systems? One for humans and one for machines?

one year ago
0 Hey

But I actually wish the interface were more like the apiserver.conf file--specifically, that you can define hard-coded credentials in this file in advance. Except, I wish that you could define API keys this way (or some other way)

auth {
    # Fixed users login credentials
    # No other user will be able to login
    fixed_users {
        enabled: true
        pass_hashed: false
        users: [
            {
                username: "test"
                password: "test"
      ...
one year ago
0 Whelp. Here'S Our Hackathon Demo Submission For A Clearml Vs Code Extension

How it works / what we finished:

  • We used the SaaS ClearML, started an EC2 instance, and manually installed and ran the clearml-agent daemon on it
  • We ran clearml-init on our laptops to generate the clearml.conf file.
  • The extension is in TypeScript, so...
  • We started trying to write code with the Python SDK to list sessions, but realized calling that from the extension would be hard, so we opted to have the TypeScript code make calls to the ClearML API server directly, e.g. ...
one year ago
0 After Presenting Clearml To My Team, I Got The Question "We'Re Already On Aws, Why Not Use Sagemaker?" Tbh, I'Ve Never Gone Through The Ml Workflow With Sagemaker. The Only Advantage I Could Think Of Is That We Can Use Our On-Prem Machines For Training,

@<1523701205467926528:profile|AgitatedDove14> you beautiful person, this is terrific! I do believe SageMaker has some nice monitoring/data drift capabilities that seem interesting, but these points you have here will be a fantastic starting point for my team's analysis of the products. I think this will help balance some of the over-enthusiasm towards using the native AWS solution.

2 years ago
0 How Would Ya'Ll Approach Backing Up The Elastic-Search/Redis/Etc. Data In Self-Hosted Clearml? Any Drawbacks/Risks Of Doing A Simple Process That Periodically Zips Up The

Oh, that is cool. I captured all this. Maybe I'll make a user-data.sh script and docker-compose.yml file that brings all these things together. Probably won't have time for a few weeks.

one year ago
0 I’M

I SOLVED IT, NO NEED TO READ FURTHER πŸ˜„

I'm a chump and didn't read the docs: None


Oh, I think I got overexcited and didn't look at this closely. So this ACCESS/SECRET key pair is on the agent-services container.

I can see that agent-services is simply a container running `clearml-agent daemon --queue ser...

one year ago
one year ago
0 Hey! Starting An Mlops Director Position In 2 Weeks. I'M Thinking About Architecture. Has Anyone Ever Tried To Use Clearml As An Experiment Tracker, But Used A Different Orchestrator Like Metaflow, Airflow, Prefect, Etc.? I'M Struggling To Find Guides Or

Hey @<1523701482157772800:profile|AnxiousSeal95> ! I think ClearML's orchestrator is a great fit for ad-hoc experimentation, but not for (event-triggered) batch inference jobs that need to be relied on in production.

I'd only feel comfortable supporting pipelines that serve end users on a tool that is known for that, e.g. Metaflow, Dagster, or Airflow--mainly because those tools emphasize good monitoring and integration with the wider data ecosystem.

5 months ago
0 On A Related Line But More Complicated: How Can We Ask The Autoscaler To Queue, Say, N Jobs On An N-Gpu Machine, Please? For Example, On Aws, Nvidia A100 Gpus Are Only Available On Instances With 8X A100, Which Is Overkill For A Single-Gpu Job, So Might A

My understanding may be bad. Say I have a single EC2 instance. Is that instance only able to handle one task at a time?

Or can I start multiple instances of the clearml-agent process on it and then have one task per agent?

And if that's the case, can we have multiple agents on the EC2 instance listening to the same queue, e.g. default . Or would this only work if they were listening to different queues?

one year ago
0 Hey Guys, Is There A Way To Dynamically Know The Path Of A Cloned Github Project (And Task) Inside A Docker Mode Worker? I Want To Set The Pythonpath Inside My Docker Worker, So I Can Access Local Modules, And My Only Problem Is That The Path Depends On T

I don't know about this, but could you turn your whole project into a pip-installable package using a setup.py and/or pyproject.toml ?

I've never tried this, but maybe then you could do pip install -e . locally before executing the task. Then execute. And then maybe the pip freeze that ClearML does would contain the symlink to your directory.

(so that from my_package import ... statements would work)

2 years ago
Show more results compactanswers