040092b8bb
improved error message during sleeping
2019-04-26 20:39:29 +01:00
7c1c1d2195
added retry-wait command line option
2019-04-26 20:37:49 +01:00
2d91734ade
Update Makefile
2019-04-26 20:09:52 +01:00
6cef84874c
fixed LinkTable_print()
2019-04-26 19:49:20 +01:00
17587852ff
fixed LinkTable_gap_fill
2019-04-26 19:47:03 +01:00
1dc54afdeb
Improved LinkTable_fill() and LinkTable_gapfill()
2019-04-26 19:30:39 +01:00
245d4a3ff4
removed the restriction for Link_get_stat()
2019-04-26 18:53:26 +01:00
9fe02d8304
reverted LINK_INVALID to '\0'
2019-04-26 18:50:41 +01:00
99761b249a
restored LinkTable_print()
2019-04-26 18:45:38 +01:00
8110438cd1
reduce the amount of debug output
2019-04-26 18:30:35 +01:00
e2c47260a0
now calculate the number of invalid links in the linktable
2019-04-26 18:25:40 +01:00
579454be3d
Merge branch 'master' of github.com:fangfufu/httpdirfs
2019-04-26 18:09:58 +01:00
3f41aba125
remove unnecessary lock
2019-04-26 18:09:39 +01:00
8da41bbe04
Update README.md
2019-04-26 16:44:18 +01:00
84f2ebc970
improved error messages
2019-04-26 16:24:55 +01:00
39820e3814
improved performance when encountering HTTP 429
2019-04-26 16:20:01 +01:00
9717d016ed
added LinkTable_gap_fill() to fill in the gaps in the link table when it is loaded from the disk
2019-04-26 15:35:48 +01:00
15cbe8a693
removed some locks
2019-04-26 14:36:54 +01:00
7d81d742d3
more error messages in curl_process_msgs() for handling HTTP 429
2019-04-26 14:25:52 +01:00
04c0499fae
added HTTP 429 handling for file stat query
2019-04-26 14:14:42 +01:00
93f9701aa8
minor error message formatting
2019-04-26 13:32:59 +01:00
774f14c8e7
if we get HTTP 429, wait for 5 secs
2019-04-26 13:20:55 +01:00
9065dcffb5
minor bug fix
2019-04-26 11:43:35 +01:00
edc3df733c
minor bug fix
2019-04-26 11:42:11 +01:00
85d66adf6c
added command line switch to configure user agent and the maximum number of network connections allowed
2019-04-26 11:39:03 +01:00
f4fd419528
added command line option to change the number of the maximum number of network connection allowed
2019-04-26 11:27:39 +01:00
33ace8e120
bumped version number
2019-04-26 11:13:08 +01:00
80a98a79f9
improved thread synchronisation, to stop Cache_read() from downloading the segment that is being downloaded in the background by Cache_bgdl()
2019-04-26 10:57:07 +01:00
f479482d7b
stop Cache_bgdl() from downloading past the last segment, remove excess debug message
2019-04-26 10:36:25 +01:00
5f6fc3f761
Now caches the directory structures by dumping LinkTables to the disk.
2019-04-26 08:26:47 +01:00
9a5f37d91f
replaced strndupcat with path_append, added LinkTable_disk_*() functions
2019-04-26 07:39:45 +01:00
825bd4d3fb
added the command line switch to control the download segment size
2019-04-25 21:34:07 +01:00
b6b101bc63
removed unnecessary goto statements
2019-04-25 13:14:54 +01:00
df025b1caf
improved the correctness of Cache_bgdl()
2019-04-25 08:50:04 +01:00
f5acebafe2
Merge branch 'master' of github.com:fangfufu/httpdirfs
2019-04-25 01:17:18 +01:00
a13dd2d91d
Update README.md
2019-04-25 01:12:48 +01:00
f628939713
Now dynamically allocate the receive buffers on the heap.
2019-04-25 00:58:29 +01:00
86999915e8
Merge pull request #29 from Lewiscowles1986/patch-1
...
Make larger block size
2019-04-24 23:59:02 +01:00
e442871899
added Cache_background_download() to enable the download of the next block
2019-04-24 23:58:26 +01:00
6d02b0554b
Make larger block size
...
The queue is inherently serial, not a queue data structure, and the code has no concurrency / parallelization added, but making the block-size larger should increase supported file-size & use disk cache more efficiently.
2019-04-24 06:22:43 +01:00
12c19e3421
improved Cache_read()
2019-04-24 04:28:54 +01:00
97ea20ef89
updated comment
2019-04-24 04:28:54 +01:00
ccac51a94f
Update README.md
2019-04-24 04:28:54 +01:00
cc1697894b
Resolved race condition - this code is now considered as stable.
...
Reference:
https://wiki.sei.cmu.edu/confluence/display/c/FIO24-C.+Do+not+open+a+file+that+is+already+open
2019-04-24 04:28:54 +01:00
bd2b43a58b
improved Doxyfile
2019-04-24 04:28:54 +01:00
2ebf37fb65
fixed doxygen warnings
2019-04-24 04:28:54 +01:00
797501514d
changed the log output
2019-04-24 04:28:54 +01:00
60b2e6c0c8
minor cosmetic changes
2019-04-24 04:28:54 +01:00
cb39b91693
Update README.md
2019-04-24 04:28:54 +01:00
0892cd0a8a
changed header inclusion order
2019-04-24 04:28:54 +01:00
Fufu Fang
Lewis Cowles