Commit Graph

132 Commits

Author SHA1 Message Date
Fufu Fang ee397d1513
Data_read() no longer gives warning messages when reaching the end of the cache file. 2019-09-02 16:51:42 +01:00
Fufu Fang 4c0b7da34b
stop the background download thread from pre-fetching beyond EOF 2019-09-02 16:05:55 +01:00
Fufu Fang eb463478a8
The background download thread is being spawned again. 2019-09-02 15:47:10 +01:00
Fufu Fang 6c8a15d8cc
Fixed buffer over-read at the boundary.
- Say we are using a lock size of 1024k, we send a request for 128k at 1008k. It won't trigger the download, because we already download 1024k at 0. So it would read off from the empty disk space!
- This problem only occurs during the first time you download a file. During subsequent accesses, when you are only reading from the cache, this problem does not occur.
2019-09-02 15:19:41 +01:00
Fufu Fang 9e3e4747ae
fixed Cache_bgdl()
- Cache_bgdl() used to corrupt the cache file
2019-09-02 09:04:20 +01:00
Fufu Fang e06ea6dc06
Wrapped mutex lock / unlock functions into function rather than macro 2019-09-01 21:36:58 +01:00
Fufu Fang ed5457c76f
Bugfix: partially fixed the cache lock
- now when the same file is opened twice, the fread() output is consistent.
2019-09-01 11:39:47 +01:00
Fufu Fang 20f30a0e38
Tidied up some of the comments and formatting 2019-09-01 08:52:18 +01:00
Fufu Fang 1a44a4d960
Wrapped mutex locking and unlocking functions in error checking macro 2019-09-01 01:21:40 +01:00
Fufu Fang 92a9658c66
Cache system bug fix
- Now keep track of the number of times a file has been opened. The on-disk
cache file no longer gets opened multiple times, if a file is opened multiple
times.
2019-09-01 00:43:50 +01:00
Fufu Fang afb2a8fe6c
Directory listing performance improvement while file transfers are going on
- Added a LinkTable generation priority lock
- This allows LinkTable generation to be run exclusively. This
effectively gives LinkTable generation priority over file transfer.
2019-08-31 21:21:28 +01:00
Fufu Fang d6fbcb4113 fixed issue #40
curl handles should NOT be added when there are transfers going on!!!
2019-08-31 08:10:36 +01:00
Fufu Fang 600f3c3fe5 added more documentation 2019-08-27 10:52:46 +01:00
Fufu Fang 20577e516c updated README.me, suppress "-Wunused-function" in crypto lock function in network.c 2019-08-24 18:13:47 +01:00
Fufu Fang e409e816eb Merge branch 'master' of github.com:fangfufu/httpdirfs 2019-08-23 23:21:26 +01:00
Fufu Fang 23611b8b1c Version 1.1.7
- Now mutex associated debugging outputs are not compiled by default.
- Tagging version 1.1.7
2019-08-23 23:15:01 +01:00
Jerome Charaoui 6ba5ccda0e tweak usage texts 2019-08-23 12:44:06 -04:00
Jerome Charaoui 145f70aa33 refer to usage info on argument parsing error 2019-08-23 12:43:23 -04:00
Jerome Charaoui e71576ded6 print limited FUSE options 2019-08-23 12:42:39 -04:00
Jerome Charaoui 290ad9482e rename long help function 2019-08-23 12:40:19 -04:00
Fufu Fang 45cee81e15 reverting segment size back to 8MB 2019-07-28 09:38:54 +01:00
Fufu Fang 71da71148f removed excess fflush 2019-07-28 09:31:49 +01:00
Fufu Fang ab15800b3a improved error message 2019-07-28 08:20:17 +01:00
Fufu Fang c72b0d4a7f added pthread_detach() for cleanup 2019-07-27 02:49:38 +01:00
Fufu Fang 91af975ff8 changed default segment size, moved the locking sequence of bgt_lock and rw_lock 2019-07-26 00:06:36 +01:00
Fufu Fang 64cd6ca2c6 added more debug messages 2019-07-24 17:55:32 +01:00
Fufu Fang c660159a18 added mutex locking / unlocking messages 2019-07-22 09:25:30 +01:00
Fufu Fang ee2d3edcbf Fixed issue #37
If a cache file already exists, the download segment size is set
to the size set by the metadata. The user specified download
segment size is ignored for existing cache files.
2019-07-21 17:53:35 +01:00
Fufu Fang 6aa180db5e updated some error message 2019-07-21 17:08:25 +01:00
Fufu Fang ed37aa5ca0 removed CURL_LOCK_DATA_CONNECT to solve #36 without disabling HTTP2 2019-07-21 08:41:02 +01:00
Fufu Fang 4491377f64 forces HTTP1.1 to fix issue #36 2019-07-20 19:25:25 +01:00
Fufu Fang 78d816716c Fixed issue #34 - file / directory detection 2019-07-20 17:19:40 +01:00
Fufu Fang a4fd2e17dc changed variable size to fix Wstringop-truncation warnings 2019-07-20 15:33:08 +01:00
Fufu Fang 22b672d4e2 updated help message and readme 2019-04-30 08:24:56 +01:00
Fufu Fang 283520136c Closing issue #33, now set a default cache directory 2019-04-30 08:06:09 +01:00
Fufu Fang 99b530ee15 changed the way the full path for the config file is calculated. 2019-04-29 23:40:48 +01:00
Fufu Fang 88efbdf87c path_append now check both path and filename for '/' 2019-04-29 23:40:21 +01:00
Fufu Fang f1c7e6e97e setting CURLMOPT_MAX_HOST_CONNECTIONS just in case 2019-04-28 01:24:35 +01:00
Fufu Fang 74878cfcfe rearranged the orders of the help text 2019-04-27 04:59:46 +01:00
Fufu Fang 4acf91a2b8 added --max-seg-count command line option 2019-04-27 04:52:39 +01:00
Fufu Fang 2a93e95aea improved debug message formatting 2019-04-27 03:28:28 +01:00
Fufu Fang ba8c7232e2 HTTP 429, LinkTable_print(), variable shadowing
changed the way HTTP 429 gets handled while querying for file stats
fixed LinkTable_print(), added variable shawdowing warning in Makefile
2019-04-27 02:42:29 +01:00
Fufu Fang 2a2ac2dce2 rewrote curl_multi_perform_once() 2019-04-27 01:53:09 +01:00
Fufu Fang 2cee4b33a7 cosmetic changes 2019-04-26 23:29:16 +01:00
Fufu Fang 3c0a5fdf65 removed excess #include directive 2019-04-26 23:10:09 +01:00
Fufu Fang 040092b8bb improved error message during sleeping 2019-04-26 20:39:29 +01:00
Fufu Fang 7c1c1d2195 added retry-wait command line option 2019-04-26 20:37:49 +01:00
Fufu Fang 6cef84874c fixed LinkTable_print() 2019-04-26 19:49:20 +01:00
Fufu Fang 17587852ff fixed LinkTable_gap_fill 2019-04-26 19:47:03 +01:00
Fufu Fang 1dc54afdeb Improved LinkTable_fill() and LinkTable_gapfill() 2019-04-26 19:30:39 +01:00