Hi LittleReindeer37
Yes you are correct it should capture the entire jupyter notebook in sagemaker studio.
Just verifying this is the use case, correct ?

so my reading of the jupyter-kernel-gateway docs is that each session is containerized, so each notebook "session" is totally isolated

sounds good, thanks!

if there are any tests/debugging you'd like me to try, just let me know

As in, which tab when I'm viewing the Experiment should I see it on? Should it be code, an artifact, or something else?

I additionally tried using a Sagemaker Notebook instance, to see if it was the kernel dockerization that Studio uses that was messing things up. But it seems to actually log less information from a Notebook instance vs Studio .

yep

I think it just ends up in /home/sagemaker-user/{notebook}.ipynb every time

so notebooks ends up empty

one possibility for getting the notebook filepath is finding and parsing /home/sagemaker-user/.jupyter/lab/workspaces/default-37a8.jupyterlab-workspace I think, but I don't know if I can tie that to a specific session

if I change it to 0.0.0.0 it works

We will add this to the SDK soon

but even then the sessions endpoint is still empty

I will once I figure out the fix!

api/kernels does report back the active kernel, but doesn't give notebook paths or anything

but r.json() is an empty list

At the top there should be the URL of the notebook (I think)

sounds good!

Just ran the same notebook in a local Jupyter Lab session and it worked as I expected it might, saving a copy to Artifacts

Try to add here:
None

server_info['url'] = f"http://{server_info['hostname']}:{server_info['port']}/"

What happens when you call:

from clearml.backend_interface.task.repo import ScriptInfo

print(ScriptInfo._ScriptInfo__legacy_jupyter_notebook_server_json_parsing(None))

looks like the same as in server_info

as best I can tell it'll only have one .ipynb in $HOME with this setup, which may work...

but the only exception handler is for requests.exceptions.SSLError

What do you have in "server_info['url']" ?

that fails

poking around a little bit, and clearml.backend_interface.task.repo.scriptinfo.ScriptInfo._get_jupyter_notebook_filename() returns None

weird that it won't return that single session

right now I can't figure out how to get the session in order to get the notebook path

so notebook path is empty