We have around 18k jobs in the repository, and it seems that submitting jobs is really starting to take a while… Not sure if its due to having that many subfolders in one location, but it might be… i know windows doesnt like that.
If thats the reason, could maybe the jobs folders be organized into subfolders by submission date?
Hmm, back when we were running tests with 50K jobs in the repository, we didn’t notice a slowdown in submission time. I’m assuming your scene files are being submitted with the job? Could these scene files be larger than they were previously? Is there currently more network traffic than before?
Regardless, storing the job folders in subfolders is probably a good idea. We could do it by submission time, or perhaps we should do it the same way we do it for job report files (which uses the last few characters of the job ID for good distribution).