-
Notifications
You must be signed in to change notification settings - Fork 6
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Use dusql to create a table of file info #9
Comments
Can it handle independent changes made to the directory well? I mean would |
Those are good questions and I don't know all the answers myself. At the very least |
We could add a minimum age to The scan takes however long it takes to |
See coecms/dusql#29 |
When
nccompress
times out and is re-run on the same directory it ends up trying to open every file to check if it is netCDF. This is slow and inefficient if it has already done that before.Could use
dusql
to create a file info database, and create a table that stores the format information, and if it has already been compressed, so the work is not duplicated when it it is run again.The text was updated successfully, but these errors were encountered: