i think for now it should do the trick... was just thinking about the roadmap part
not so sure.. ideally i was looking for some function calls which enables me to create a sort of DAG which get scheduled at given interval and DAG has status checks on up streams task ... so if upstream task fails.. downstream tasks are not run
you replied it already.. it was execute_remotely
called with exit_true
argument
looking at the above link, it seems i might be able to create it with some boilerplate as it has concept of parent and child... but not sure how status checks and dependency get sorted out
this looks good... also do you have any info/eta on next controller/service release you mentioning
couldn't find the licensing price for enterprise version
i ran it this week
i guess i was not so clear may be.. say e.g. you running lightgbm model training, by default it will take all the cpus available on the box and will run that many threads, now another task got scheduled on the same box now you have 2x threads with same amount of CPU to schedule on. So yes the jobs will progress but the progression will not be the same due to context switches which will happen way more than say if we have allowed on 1/2x threads for each job
AgitatedDove14 no it doesn't work
so as you say.. i don't think the issue i am seeing is due to this error
this is when executed from directly with task.init()
any logs i can check or debug my side
thanks for letting me know.. but it turns out after i have recreated my whole system environment from scratch, trains agent is working as expected..
thanks for the update... it seems currently i can not pass the http/s proxy parameters as when agent creates a new env and try to download some package its being blocked by our corp firewall... all outgoing connection needs to pass through a proxy.. so is it possible to specify that or environment variables to agent
an example achieving what i propose would be greatly helpful
it still tries to create a new env
or is there any plan to fix it in upcoming release
TimelyPenguin76 yeah when i run matplotlib with show
plots does land under Plot
section... so its mainly then the imshow
part.. i am wondering why the distinction and what is the usual way to emit plots to debug samples
thanks Martin.. at least something to go with.. as if i have any issue then i know which component logs to look for
thanks... i was just wondering if i overlooked any config option for that... as cpu_set
might be possibility to for cpu
i don't need this right away.. i just wanted to know the possibility fo dividing the current machine into multiple workers... i guess if its not readily available then may be you guys can discuss to see if it makes sense to have it on roadmap..