I did a few project that related to working with large files constantly and had a few problems with cache’s lifetime, for example:
- Working with a large file constantly make the cache grows bigger and bigger when it read random, the usual chunk data is still there but few times chunk data (chunk data that only get accessed a few times) is still there too, that makes unnecessary chunk data remains as long as the file keep get accessed and the result is bigger cache.
- For video, its the same, watch a video file that has 2 hours and cache for that file keep growing until = total size of file after finish watch that video, its really take too many spaces on the drives with multiple parallel read threads.
Hope you can implement cache’s lifetime to file’s chunk data as well because it’s really important to me. I would even pay more to get this done as soon as possible since i know this is really complex if implement lifetime’s cache to chunk data.