Reputation
Badges 1
13 × Eureka!hey @<1523701070390366208:profile|CostlyOstrich36> , I run this example ( None ) with changed num_workers to >1 and pin_memory=True in dataloader and again I got this brokenpipe issue :<
@<1523701070390366208:profile|CostlyOstrich36> Do you have any thoughts on this?
- it all worked perfectly fine before applying clearml
@<1523701070390366208:profile|CostlyOstrich36> I don't have anything specific on my mind. I am just wondering how you guys separate dev from prod on your daily work and generally what are good practices in this area :)
I've upgraded version from 1.7.2 to 1.10.2 and the problem has occured with the latest version. I have a feeling that it is related to major changes in Lightning with their 2+ version but its only my intuition. It would be nice if you could check it with your simple example code. Looking forward to the updates, thanks.
Thank you, it works perfectly now 🙂
Hey, just for your information:
I replicated pytorch_lightning_example.py and it works fine (model/artifact saving) with old lightning interface (I mean "import pytorch_lightning as pl" as it is right now in the example) but the issue occurs when I try to use new lightning interface ("import lightning.pytorch as pl"). Hope it helps somehow and still looking forward to fix 🙂
@<1523701435869433856:profile|SmugDolphin23> I'm having trouble understanding your words. I don't use the agent here.
@<1523701435869433856:profile|SmugDolphin23> @<1523701070390366208:profile|CostlyOstrich36> Maybe you could look at my code ( None ) to get a better view of the case. (I really doubt that the look at the code will help to solve it since it is related to presence of git). Theres no clearml agent or any complex se...
@<1523701070390366208:profile|CostlyOstrich36> 1) I attached logs in text file. 2) I want to develop my code in docker container and theres no place for git (as far as I understand the purpose of using docker at all) - regardless of my use case, this type of simple pipeline should work with no git dependency, right? 3) I don't use the agent in this case
- Attached verbose logs.
- There's no point to run script with pipeline without clearml since the script is based on clearml feature (pipeline itself). All other scripts that can be run without clearml works fine.
Hydra config file can't be read while running preprocess.py via pipeline, but it works good running it directly. (no git case)