Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
DefiantHippopotamus88
Moderator
2 Questions, 55 Answers
  Active since 10 January 2023
  Last activity one year ago

Reputation

0

Badges 1

51 × Eureka!
0 Votes
18 Answers
2K Views
0 Votes 18 Answers 2K Views
Is it possible to create a serving endpoint with Pytorch JIT file in web interface only?
3 years ago
0 Votes
60 Answers
112K Views
0 Votes 60 Answers 112K Views
Hi, I try to run locally clearml-server and clearml-serving to create inference endpoint that utilize Triton server. So far I had port issues so I changed cl...
3 years ago
0 Hi, I Try To Run Locally

would IP help instead?

3 years ago
0 Hi, I Try To Run Locally
curl 

{"meta":{"id":"59bbb55b6ddc456092658ae588c9a436","trx":"59bbb55b6ddc456092658ae588c9a436","endpoint":{"name":"auth.login","requested_version":"2.18","actual_version":"1.0"},"result_code":401,"result_subcode":20,"result_msg":"Unauthorized (missing credentials)","error_stack":null,"error_data":{}},"data":{}}
3 years ago
0 Hi, I Try To Run Locally

that's strange, maybe you should upgrade it

3 years ago
0 Hi, I Try To Run Locally

yeah, ok
but it didn't

3 years ago
0 Hey,

hi WickedElephant66
I have the same issue, but port is not the only problem
https://clearml.slack.com/archives/CTK20V944/p1656446563854059

3 years ago
0 Hi, I Try To Run Locally

my example.env

CLEARML_WEB_HOST="
"
CLEARML_API_HOST="
"
CLEARML_FILES_HOST="
"
CLEARML_API_ACCESS_KEY="91SFEX4BYUQ9YCZ9V6WP"
CLEARML_API_SECRET_KEY="4WTXT7tAW3R6tnSi8hzSKNjgkmgUoyv22lYT2FIzIfLoeGERRO"
CLEARML_SERVING_TASK_ID="450231049bba42f69c6507cb774f7dc6 
3 years ago
0 Hi, I Try To Run Locally

I haven't followed it so closely, but let me check

3 years ago
0 Hi, I Try To Run Locally

I tried that, it didn't work. I was confused by the separate port parameter:

CLEARML_SERVING_PORT: ${CLEARML_SERVING_PORT:-8080}

which is only one port related in docker-compose-triton.yml
Can I test /auth.login somehow independently? Using curl or any other way. Which address does it suppose to have and which creds should I use?

3 years ago
0 Hi, I Try To Run Locally

my clearml.conf

api { 
    web_server: 

    api_server: 

    files_server: 

    # test 3
    credentials {
        "access_key" = "91SFEX4BYUQ9YCZ9V6WP"
        "secret_key" = "4WTXT7tAW3R6tnSi8hzSKNjgkmgUoyv22lYT2FIzIfLoeGERRO"
    }
}
3 years ago
0 Hey,

Let's maybe join our effort to get local deployment?

3 years ago
0 Is It Possible To Create A Serving Endpoint With Pytorch Jit File In Web Interface Only?

In my understanding requests still go through clearml-server which configuration I left intact. Maybe due to the port change in clearml-serving I need to adjust smth.

3 years ago
0 Is It Possible To Create A Serving Endpoint With Pytorch Jit File In Web Interface Only?

I tried, step by step from here
https://github.com/allegroai/clearml-serving/tree/main/examples/pytorch
and result is the same.
Then I tried to remove my old serving examples to start checking from scratch by the immediately restart after stopping

3 years ago
0 Is It Possible To Create A Serving Endpoint With Pytorch Jit File In Web Interface Only?

I made it working with full port reassignment to 9090 in clearml-serving-inference
which still send me an error that the format of my request is somehow wrong
but then I started from scratch by creating completely new project and new endpoint

3 years ago
0 Is It Possible To Create A Serving Endpoint With Pytorch Jit File In Web Interface Only?

I tried to switch off auto-refresh, but it doesn't help

3 years ago
0 Is It Possible To Create A Serving Endpoint With Pytorch Jit File In Web Interface Only?

curl -X POST " " -H "accept: application/json" -H "Content-Type: application/json" -d '{"url": " "}' curl: (56) Recv failure: Connection reset by peer

3 years ago
0 Hi, I Try To Run Locally

will continue tomorrow

3 years ago
0 Is It Possible To Create A Serving Endpoint With Pytorch Jit File In Web Interface Only?

clearml-serving-inference | 2022-07-03 22:06:26,893 - clearml.storage - ERROR - Could not download , err: HTTPConnectionPool(host='localhost', port=8081): Max retries exceeded with url: /DevOps/serving%20example%2010.0a76d264e30940c2b600375fa839f1a2/artifacts/py_code_test_model_pytorch2/preprocess.py (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fc3f41b1790>: Failed to establish a new connection: [Errno 111] Connection refused'))

3 years ago
0 Is It Possible To Create A Serving Endpoint With Pytorch Jit File In Web Interface Only?

the url above i accessible from the container:
$ docker-compose exec clearml-serving-inference bash root@a041497a554d:~/clearml# curl `

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2 Final//EN">

<title>405 Method Not Allowed</title> <h1>Method Not Allowed</h1> <p>The method is not allowed for the requested URL.</p> root@a041497a554d:~/clearml# `

3 years ago
0 Is It Possible To Create A Serving Endpoint With Pytorch Jit File In Web Interface Only?

basicaly I don't want to train a new model and I try to create an endpoint following the example but I finally get
$ curl -X POST " " -H "accept: application/json" -H "Content-Type: application/json" -d '{"url": " ` "}'

<html> <head><title>405 Not Allowed</title></head> <body> <center><h1>405 Not Allowed</h1></center> <hr><center>nginx/1.20.1</center> </body> </html> `

3 years ago
0 Is It Possible To Create A Serving Endpoint With Pytorch Jit File In Web Interface Only?

curl -X POST " " -H "accept: application/json" -H "Content-Type: application/json" -d '{"url": " "}' {"detail":"Error processing request: Error: Failed loading preprocess code for 'py_code_test_model_pytorch2': 'NoneType' object has no attribute 'loader'"}

3 years ago
0 Hey,

at least no more auth errors

3 years ago
0 Hey,

it worked for me with one docker-compose for all

3 years ago
0 Is It Possible To Create A Serving Endpoint With Pytorch Jit File In Web Interface Only?

How can I clean database or whatever to get to the beginning?

3 years ago
Show more results compactanswers