Hi @<1628202899001577472:profile|SkinnyKitten28> ! What code do you see that is being captured?
Hello!
Copyright 2023 Google Inc.
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at
None
Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
"""Custom kernel launcher app to customize socket options."""
from ipykernel import kernelapp
import zmq
We want to set the high water mark on all sockets to 0, as we don't want
the backend dropping any messages. We want to set this before any calls to
bind or connect.
In principle we should override init_sockets
, but it's hard to set options
on the zmq.Context
there without rewriting the entire method. Instead we
settle for only setting this on iopub
, as that's the most important for our
use case.
class ColabKernelApp(kernelapp.IPKernelApp):
def init_iopub(self, context):
context.setsockopt(zmq.RCVHWM, 0)
context.setsockopt(zmq.SNDHWM, 0)
return super().init_iopub(context)
if name == 'main':
ColabKernelApp.launch_instance()
I found a solution, you can create your training script in the space of colab, and then execute it from colab with
!python training.py
and training.py has all that needs from clearML, and it works perfectly!