Sorry I disappeared (went on a well deserved vacation). The problem is happening because of the ordering of the install. If I install using pip install -r ./requirements.txt
then pip installs the packages in the order of the requirements file. However, during the installation process from ClearML, it installs the packages in order UNLESS there's a custom path provided, then it's saved for last. The reason this breaks my code is I have later packages that depend on the custom packages, as such, they attempt to install the dependences from pypi. The entire reason why I have the custom versions of the packages is I had to manually resolve a conflict between the darts package and hydra/omegaconf (hydra is working on an official solution but progress is slow).
For now I can just exclude the hydra colorlog package but how would you suggest going about resolving this issue in a less hacky way? I guess I could build a container.