so notebook path is empty

yep

which I looked at previously to see if I could import sagemaker.kg or kernelgateway or something, but no luck

nope, that's wrong

curious whether it impacts anything besides sagemaker. I'm thinking it's generically a kernel gateway issue, but I'm not sure if other platforms are using that yet

I could just loop through and create separate pipelines with different parameters, but seems sort of inefficient. the hyperparameter optimization might actually work in this case utilizing grid search, but seems like kind of a hack

local Jupyter Lab:

but the only exception handler is for requests.exceptions.SSLError

if I instead change the request url to f"http://{server_info['hostname']}:{server_info['port']}/api/sessions" then it gets a 200 response... however , the response is an empty list

nice! Just tested it on my end as well, looks like it works!

done: None

the problem is here: None

and cat /var/log/studio/kernel_gateway.log | grep ipynb comes up empty

it does return kernels, just not sessions

here's my script:

#!/bin/bash
echo "******************** Starting Agent ********************"
echo "******************** Getting ENV Variables ********************"
source /etc/profile.d/env-vars.sh

# test that we can access the API
echo "******************** Waiting for ${CLEARML_API_HOST} connectivity ********************"
curl --retry 10 --retry-delay 10 --retry-connrefused ${CLEARML_API_HOST}/debug.ping

# start the agent
for i in $(seq 1 ${NUM_WORKERS})
do 
    export CLEARML_WORK...

I'm doing that and it's working well

if I add the base_url it's not found

one possibility for getting the notebook filepath is finding and parsing /home/sagemaker-user/.jupyter/lab/workspaces/default-37a8.jupyterlab-workspace I think, but I don't know if I can tie that to a specific session

I've poked around both the internal URL that Jupyter kernel is running on and some of the files in /sagemaker/.jupyter but no luck so far - I can find plenty of kernel info, but not session

I can get it to run up to here: None

yeah, even then it'll run but return 0 notebooks

and that requests.get() throws an exception:

ConnectionError: HTTPConnectionPool(host='default', port=8888): Max retries exceeded with url: /jupyter/default/api/sessions (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f7ba9cadc30>: Failed to establish a new connection: [Errno -2] Name or service not known'))

seems like it's using None and that doesn't provide the normal api/sessions endpoint - or, it does, but returns an empty list

I will once I figure out the fix!

I additionally tried using a Sagemaker Notebook instance, to see if it was the kernel dockerization that Studio uses that was messing things up. But it seems to actually log less information from a Notebook instance vs Studio .


![image](https://clearml-web-assets.s3.amazonaws.com/scoold/im...

SageMaker Studio:

Just ran the same notebook in a local Jupyter Lab session and it worked as I expected it might, saving a copy to Artifacts

As in, which tab when I'm viewing the Experiment should I see it on? Should it be code, an artifact, or something else?