Fufu Fang
825bd4d3fb
added the command line switch to control the download segment size
2019-04-25 21:34:07 +01:00
Fufu Fang
b6b101bc63
removed unnecessary goto statements
2019-04-25 13:14:54 +01:00
Fufu Fang
df025b1caf
improved the correctness of Cache_bgdl()
2019-04-25 08:50:04 +01:00
Fufu Fang
f5acebafe2
Merge branch 'master' of github.com:fangfufu/httpdirfs
2019-04-25 01:17:18 +01:00
Fufu Fang
a13dd2d91d
Update README.md
2019-04-25 01:12:48 +01:00
Fufu Fang
f628939713
Now dynamically allocate the receive buffers on the heap.
2019-04-25 00:58:29 +01:00
Fufu Fang
86999915e8
Merge pull request #29 from Lewiscowles1986/patch-1
...
Make larger block size
2019-04-24 23:59:02 +01:00
Fufu Fang
e442871899
added Cache_background_download() to enable the download of the next block
2019-04-24 23:58:26 +01:00
Lewis Cowles
6d02b0554b
Make larger block size
...
The queue is inherently serial, not a queue data structure, and the code has no concurrency / parallelization added, but making the block-size larger should increase supported file-size & use disk cache more efficiently.
2019-04-24 06:22:43 +01:00
Fufu Fang
12c19e3421
improved Cache_read()
2019-04-24 04:28:54 +01:00
Fufu Fang
97ea20ef89
updated comment
2019-04-24 04:28:54 +01:00
Fufu Fang
ccac51a94f
Update README.md
2019-04-24 04:28:54 +01:00
Fufu Fang
cc1697894b
Resolved race condition - this code is now considered as stable.
...
Reference:
https://wiki.sei.cmu.edu/confluence/display/c/FIO24-C.+Do+not+open+a+file+that+is+already+open
2019-04-24 04:28:54 +01:00
Fufu Fang
bd2b43a58b
improved Doxyfile
2019-04-24 04:28:54 +01:00
Fufu Fang
2ebf37fb65
fixed doxygen warnings
2019-04-24 04:28:54 +01:00
Fufu Fang
797501514d
changed the log output
2019-04-24 04:28:54 +01:00
Fufu Fang
60b2e6c0c8
minor cosmetic changes
2019-04-24 04:28:54 +01:00
Fufu Fang
cb39b91693
Update README.md
2019-04-24 04:28:54 +01:00
Fufu Fang
0892cd0a8a
changed header inclusion order
2019-04-24 04:28:54 +01:00
Fufu Fang
3a0c431bba
Stability improvement
...
Metadata corruption still occasionally happens when it gets read in.
I suspect it is due to some sort of race condition.
2019-04-24 04:28:54 +01:00
Fufu Fang
fb8a132c14
added a mutex lock for closing cache dataset
2019-04-24 04:28:54 +01:00
Fufu Fang
cba66c58fd
more stability and error handling improvements
2019-04-24 04:28:54 +01:00
Fufu Fang
fe079f6266
improved stability / error handling
2019-04-24 04:28:54 +01:00
Fufu Fang
1ad2238aff
Update README.md
2019-04-24 04:28:46 +01:00
Fufu Fang
36ddbe9ec5
fixed bug in fs_open(), now handles cache dataset creation properly
2019-04-24 04:28:46 +01:00
Fufu Fang
6536163f98
improve cached dataset creation process, better error handling
2019-04-24 04:28:46 +01:00
Fufu Fang
ac61ddd1c0
stability improvement, hopefully got rid off SIGFPE
2019-04-24 04:28:46 +01:00
Fufu Fang
774269b529
Update README.md
2019-04-24 04:28:46 +01:00
Fufu Fang
a1abd8fab3
Update Makefile
2019-04-24 04:28:46 +01:00
Fufu Fang
f122cf000d
updated BUG section of README.md
2019-04-24 04:28:46 +01:00
Fufu Fang
e166098162
updated README, also moved some status message around
2019-04-24 04:28:46 +01:00
Fufu Fang
96a1e4fd55
used a more stupid version of the bitmap, because it works reliably
2019-04-24 04:28:35 +01:00
Fufu Fang
0d8d5ef329
documented the new feature, and the bug
2019-04-24 04:28:35 +01:00
Fufu Fang
e2d2b0dd28
Cache system has been succesfully implemented
2019-04-24 04:28:27 +01:00
Fufu Fang
692ad3f00c
Cache dataset creation is working, time write the function to fill in the cache
2019-04-24 04:27:40 +01:00
Fufu Fang
a7bbfcbe7d
Update Makefile
2019-04-24 04:27:40 +01:00
Fufu Fang
b6bdf15ad1
removed a bunch of function prototypes
2019-04-24 04:27:38 +01:00
Fufu Fang
e515a2a197
fixed documentation format
2019-04-24 04:26:33 +01:00
Fufu Fang
77bb715590
fixed memory leak in link table creation
2019-04-24 04:21:38 +01:00
Fufu Fang
5af3def3f8
Linked in CacheSystem_init, Cache_open, Cache_close
2019-04-24 04:21:38 +01:00
Fufu Fang
a02072f548
replaced fseek with fseeko, this should enable large file support
2019-04-24 04:21:38 +01:00
Fufu Fang
07b8382022
modified cache_create
2019-04-24 04:21:38 +01:00
Fufu Fang
212e319f20
unified struct member name between link.h and cache.h
2019-04-24 04:21:38 +01:00
Fufu Fang
c6717e0450
changed a bunch of function to static function
2019-04-24 04:21:38 +01:00
Fufu Fang
86644c0518
added more documentation
2019-04-24 04:21:38 +01:00
Fufu Fang
e9e41165ae
added CacheDir_create() and fs_release()
2019-04-24 04:21:38 +01:00
Fufu Fang
0c55dc5a0c
wrote Seg_exist, Seg_set, refined CacheSystem_init
2019-04-24 04:21:38 +01:00
Fufu Fang
b1971a7c3f
modified strndupcat, added more comments
2019-04-24 04:21:38 +01:00
Fufu Fang
e5c77f3680
Changed the way segments work, added more functions
...
Now segments are fixed size block of 128KiB
2019-04-24 04:21:38 +01:00
Fufu Fang
3d0269e90f
added Cache_create
2019-04-24 04:21:38 +01:00