Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
I Keep Running Into This Issue:

I keep running into this issue:
error: Could not fetch origin
when the docker worker fetches the repository with submodules.
It has credentials via ssh-auth-sock and multiple submodules appear to work, but it doesn't work for each one.

How can I get more information from the pipeline, since the behaviour is weird?
Here's a full output:

Using cached repository in "/root/.clearml/vcs-cache/lvgl-ui-detector.git.7c8ae2688810ceed26c1ebcc1e911cf2/lvgl-ui-detector.git"
2024-04-25 00:25:01
Fetching submodule lvgl_ui_generator
Fetching submodule lvgl_ui_generator/lv_drivers
Fetching submodule lvgl_ui_generator/lvgl
Fetching submodule lvgl_ui_generator_v2
2024-04-25 00:25:07
Fetching submodule lvgl_ui_generator_v2/lv_micropython
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/asf4
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/axtls
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/berkeley-db-1.xx
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/btstack
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/cyw43-driver
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/fsp
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/libffi
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/libhydrogen
2024-04-25 00:25:12
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/lv_bindings
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/lv_bindings/lvgl
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/lv_bindings/pycparser
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/lwip
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/mbedtls
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/micropython-lib
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/mynewt-nimble
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/nrfx
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/nxp_driver
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/pico-sdk
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/pico-sdk/lib/btstack
2024-04-25 00:25:18
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/pico-sdk/lib/cyw43-driver
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/pico-sdk/lib/lwip
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/pico-sdk/lib/mbedtls
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/pico-sdk/lib/tinyusb
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/pico-sdk/lib/tinyusb/hw/mcu/allwinner
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/pico-sdk/lib/tinyusb/hw/mcu/bridgetek/ft9xx/ft90x-sdk
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/pico-sdk/lib/tinyusb/hw/mcu/broadcom
Could not access submodule 'hw/mcu/gd/nuclei-sdk'
Errors during submodule fetch:
	tinyusb
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/stm32lib
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/tinyusb
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/wiznet5k
Errors during submodule fetch:
	lvgl_ui_generator_v2
error: Could not fetch origin
Repository cloning failed: Command '['git', 'fetch', '--all', '--recurse-submodules']' returned non-zero exit status 1.
2024-04-25 00:25:25
User aborted: stopping task (3)
2024-04-25 00:25:26
clearml_agent: ERROR: Failed cloning repository. 
1) Make sure you pushed the requested commit:
(repository='git@github.com:HackXIt/lvgl-ui-detector.git', branch='main', commit_id='d23a755575fbfe481e42a44b4f62a4bbc67e044a', tag='', docker_cmd='nvidia/cuda:12.3.2-cudnn9-runtime-ubuntu22.04', entry_point='src/generate.py', working_dir='.')
2) Check if remote-worker has valid credentials [see worker configuration file]

It would be great to turn off the functionality of submodules, since I don't even want them to be cloned in the task as it is not necessary.

  
  
Posted 25 days ago
Votes Newest

Answers 6


I cleared the vcs cache manually already, it results in the same behaviour illustrated above
(allthough the logs show that it used the cache, I had another run without cache - but don't have the logs from that)

  
  
Posted 22 days ago

Hi @<1523701087100473344:profile|SuccessfulKoala55>

I am using 1.8.0 for the clearml-agent.

Attached is the logfile.

  
  
Posted 22 days ago

Hi @<1694157594333024256:profile|DisturbedParrot38> , which agent version are you using?
Also, can you make sure the vcs cache is cleared and share the complete task log?

  
  
Posted 24 days ago

If it were possible to override the checkout behaviour I would ignore all submodules anyways, but in the documentation of clearml.conf as well as the pipeline decorator I couldn't find anything that would allow me doing that.

  
  
Posted 25 days ago

On another attempt with a cleaned repository (no dirty commits) I get the same result, even though it states that it got a new commit id, so I'm at a loss at what is actually going wrong here:

`Using cached repository in "/root/.clearml/vcs-cache/lvgl-ui-detector.git.7c8ae2688810ceed26c1ebcc1e911cf2/lvgl-ui-detector.git"
remote: Enumerating objects: 11, done.
remote: Counting objects: 100% (11/11), done.
remote: Compressing objects: 100% (5/5), done.
remote: Total 8 (delta 4), reused 7 (delta 3), pack-reused 0
Unpacking objects: 100% (8/8), 1.13 KiB | 144.00 KiB/s, done.
From github.com:HackXIt/lvgl-ui-detector
   d23a755..2d74fb1  main       -> origin/main
Fetching submodule lvgl_ui_generator
Fetching submodule lvgl_ui_generator/lv_drivers
Fetching submodule lvgl_ui_generator/lvgl
Fetching submodule lvgl_ui_generator_v2
From github.com:HackXIt/lvgl_ui_generator_v2
   3f4d5fc..582a838  main       -> origin/main
Fetching submodule lvgl_ui_generator_v2/lv_micropython
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/asf4
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/axtls
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/berkeley-db-1.xx
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/btstack
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/cyw43-driver
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/fsp
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/libffi
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/libhydrogen
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/lv_bindings
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/lv_bindings/lvgl
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/lv_bindings/pycparser
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/lwip
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/mbedtls
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/micropython-lib
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/mynewt-nimble
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/nrfx
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/nxp_driver
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/pico-sdk
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/pico-sdk/lib/btstack
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/pico-sdk/lib/cyw43-driver
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/pico-sdk/lib/lwip
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/pico-sdk/lib/mbedtls
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/pico-sdk/lib/tinyusb
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/pico-sdk/lib/tinyusb/hw/mcu/allwinner
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/pico-sdk/lib/tinyusb/hw/mcu/bridgetek/ft9xx/ft90x-sdk
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/pico-sdk/lib/tinyusb/hw/mcu/broadcom
Could not access submodule 'hw/mcu/gd/nuclei-sdk'
Errors during submodule fetch:
        tinyusb
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/stm32lib
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/tinyusb
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/wiznet5k
Errors during submodule fetch:
        lib/pico-sdk
Errors during submodule fetch:
        lv_micropython
Fetching submodule paper
From github.com:HackXIt/ui-detector-paper
   e635ad0..425e18a  main       -> origin/main
Fetching submodule ui_randomizer
From github.com:HackXIt/ui_randomizer
 * [new branch]      develop    -> origin/develop
Fetching submodule yolov3_baseline_project
Errors during submodule fetch:
        lvgl_ui_generator_v2
error: Could not fetch origin
Repository cloning failed: Command '['git', 'fetch', '--all', '--recurse-submodules']' returned non-zero exit status 1.
User aborted: stopping task (3)

Leaving process id 18888

clearml_agent: ERROR: Failed cloning repository. 
1) Make sure you pushed the requested commit:
(repository='git@github.com:HackXIt/lvgl-ui-detector.git', branch='main', commit_id='2d74fb108f1270e0e95479104d4bc9ae2bde7f75', tag='', docker_cmd='nvidia/cuda:12.3.2-cudnn9-runtime-ubuntu22.04', entry_point='src/generate.py', working_dir='.')
2) Check if remote-worker has valid credentials [see worker configuration file]


Leaving process id 18888
DONE: Running task 'd333d294bfac479a84b954f962df6b93' (user aborted)
  
  
Posted 25 days ago

Any help would be greatly appreciated

  
  
Posted 25 days ago