Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
I Keep Running Into This Issue:

I keep running into this issue:
error: Could not fetch origin
when the docker worker fetches the repository with submodules.
It has credentials via ssh-auth-sock and multiple submodules appear to work, but it doesn't work for each one.

How can I get more information from the pipeline, since the behaviour is weird?
Here's a full output:

Using cached repository in "/root/.clearml/vcs-cache/lvgl-ui-detector.git.7c8ae2688810ceed26c1ebcc1e911cf2/lvgl-ui-detector.git"
2024-04-25 00:25:01
Fetching submodule lvgl_ui_generator
Fetching submodule lvgl_ui_generator/lv_drivers
Fetching submodule lvgl_ui_generator/lvgl
Fetching submodule lvgl_ui_generator_v2
2024-04-25 00:25:07
Fetching submodule lvgl_ui_generator_v2/lv_micropython
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/asf4
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/axtls
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/berkeley-db-1.xx
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/btstack
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/cyw43-driver
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/fsp
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/libffi
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/libhydrogen
2024-04-25 00:25:12
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/lv_bindings
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/lv_bindings/lvgl
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/lv_bindings/pycparser
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/lwip
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/mbedtls
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/micropython-lib
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/mynewt-nimble
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/nrfx
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/nxp_driver
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/pico-sdk
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/pico-sdk/lib/btstack
2024-04-25 00:25:18
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/pico-sdk/lib/cyw43-driver
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/pico-sdk/lib/lwip
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/pico-sdk/lib/mbedtls
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/pico-sdk/lib/tinyusb
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/pico-sdk/lib/tinyusb/hw/mcu/allwinner
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/pico-sdk/lib/tinyusb/hw/mcu/bridgetek/ft9xx/ft90x-sdk
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/pico-sdk/lib/tinyusb/hw/mcu/broadcom
Could not access submodule 'hw/mcu/gd/nuclei-sdk'
Errors during submodule fetch:
	tinyusb
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/stm32lib
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/tinyusb
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/wiznet5k
Errors during submodule fetch:
	lvgl_ui_generator_v2
error: Could not fetch origin
Repository cloning failed: Command '['git', 'fetch', '--all', '--recurse-submodules']' returned non-zero exit status 1.
2024-04-25 00:25:25
User aborted: stopping task (3)
2024-04-25 00:25:26
clearml_agent: ERROR: Failed cloning repository. 
1) Make sure you pushed the requested commit:
(repository='git@github.com:HackXIt/lvgl-ui-detector.git', branch='main', commit_id='d23a755575fbfe481e42a44b4f62a4bbc67e044a', tag='', docker_cmd='nvidia/cuda:12.3.2-cudnn9-runtime-ubuntu22.04', entry_point='src/generate.py', working_dir='.')
2) Check if remote-worker has valid credentials [see worker configuration file]

It would be great to turn off the functionality of submodules, since I don't even want them to be cloned in the task as it is not necessary.

  
  
Posted 7 months ago
Votes Newest

Answers 7


And using the latest agent version v1.8.1?

  
  
Posted 7 months ago

I cleared the vcs cache manually already, it results in the same behaviour illustrated above
(allthough the logs show that it used the cache, I had another run without cache - but don't have the logs from that)

  
  
Posted 7 months ago

Hi @<1523701087100473344:profile|SuccessfulKoala55>

I am using 1.8.0 for the clearml-agent.

Attached is the logfile.

  
  
Posted 7 months ago

Hi @<1694157594333024256:profile|DisturbedParrot38> , which agent version are you using?
Also, can you make sure the vcs cache is cleared and share the complete task log?

  
  
Posted 7 months ago

If it were possible to override the checkout behaviour I would ignore all submodules anyways, but in the documentation of clearml.conf as well as the pipeline decorator I couldn't find anything that would allow me doing that.

  
  
Posted 7 months ago

On another attempt with a cleaned repository (no dirty commits) I get the same result, even though it states that it got a new commit id, so I'm at a loss at what is actually going wrong here:

`Using cached repository in "/root/.clearml/vcs-cache/lvgl-ui-detector.git.7c8ae2688810ceed26c1ebcc1e911cf2/lvgl-ui-detector.git"
remote: Enumerating objects: 11, done.
remote: Counting objects: 100% (11/11), done.
remote: Compressing objects: 100% (5/5), done.
remote: Total 8 (delta 4), reused 7 (delta 3), pack-reused 0
Unpacking objects: 100% (8/8), 1.13 KiB | 144.00 KiB/s, done.
From github.com:HackXIt/lvgl-ui-detector
   d23a755..2d74fb1  main       -> origin/main
Fetching submodule lvgl_ui_generator
Fetching submodule lvgl_ui_generator/lv_drivers
Fetching submodule lvgl_ui_generator/lvgl
Fetching submodule lvgl_ui_generator_v2
From github.com:HackXIt/lvgl_ui_generator_v2
   3f4d5fc..582a838  main       -> origin/main
Fetching submodule lvgl_ui_generator_v2/lv_micropython
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/asf4
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/axtls
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/berkeley-db-1.xx
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/btstack
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/cyw43-driver
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/fsp
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/libffi
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/libhydrogen
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/lv_bindings
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/lv_bindings/lvgl
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/lv_bindings/pycparser
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/lwip
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/mbedtls
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/micropython-lib
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/mynewt-nimble
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/nrfx
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/nxp_driver
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/pico-sdk
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/pico-sdk/lib/btstack
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/pico-sdk/lib/cyw43-driver
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/pico-sdk/lib/lwip
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/pico-sdk/lib/mbedtls
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/pico-sdk/lib/tinyusb
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/pico-sdk/lib/tinyusb/hw/mcu/allwinner
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/pico-sdk/lib/tinyusb/hw/mcu/bridgetek/ft9xx/ft90x-sdk
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/pico-sdk/lib/tinyusb/hw/mcu/broadcom
Could not access submodule 'hw/mcu/gd/nuclei-sdk'
Errors during submodule fetch:
        tinyusb
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/stm32lib
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/tinyusb
Fetching submodule lvgl_ui_generator_v2/lv_micropython/lib/wiznet5k
Errors during submodule fetch:
        lib/pico-sdk
Errors during submodule fetch:
        lv_micropython
Fetching submodule paper
From github.com:HackXIt/ui-detector-paper
   e635ad0..425e18a  main       -> origin/main
Fetching submodule ui_randomizer
From github.com:HackXIt/ui_randomizer
 * [new branch]      develop    -> origin/develop
Fetching submodule yolov3_baseline_project
Errors during submodule fetch:
        lvgl_ui_generator_v2
error: Could not fetch origin
Repository cloning failed: Command '['git', 'fetch', '--all', '--recurse-submodules']' returned non-zero exit status 1.
User aborted: stopping task (3)

Leaving process id 18888

clearml_agent: ERROR: Failed cloning repository. 
1) Make sure you pushed the requested commit:
(repository='git@github.com:HackXIt/lvgl-ui-detector.git', branch='main', commit_id='2d74fb108f1270e0e95479104d4bc9ae2bde7f75', tag='', docker_cmd='nvidia/cuda:12.3.2-cudnn9-runtime-ubuntu22.04', entry_point='src/generate.py', working_dir='.')
2) Check if remote-worker has valid credentials [see worker configuration file]


Leaving process id 18888
DONE: Running task 'd333d294bfac479a84b954f962df6b93' (user aborted)
  
  
Posted 7 months ago

Any help would be greatly appreciated

  
  
Posted 7 months ago