Jonathan Kamens
e94b5441f3
Add a few more debug messages to help trace program execution
2023-09-29 12:47:55 +01:00
Jonathan Kamens
4d323b846f
Do the right thing with sites that use absolute links
...
On some sites, the link to each subfolder is an absolute link rather
than a relative one. To accommodate this, convert the links from
absolute to relative before storing them in the link table.
2023-09-29 12:47:55 +01:00
Jonathan Kamens
41cb4b80bc
Do the right thing with sites that require the final slash
...
Some web sites will return 404 if you fetch a directory without the
final slash. For example, https://archive.mozilla.org/pub/ works,
https://archive.mozilla.org/pub does not. We need to do two things to
accommodate this:
* When processing the root URL of the filesystem, instead of stripping
off the final slash, just set the offset to ignore it.
* In the link structure, store the actual URL tail of the link
separately from its name, final slash and all if there is one, and
append that instead of the name when constructing the URL for curl.
2023-09-29 12:47:55 +01:00
Fufu Fang
1e80844831
ran the code through formatter
2023-07-26 07:48:33 +08:00
Fufu Fang
6d8db94458
minor formatting changes for PR #114
2023-07-26 07:48:22 +08:00
Fufu Fang
282605b0ac
fix: changed deprecated libcurl call
2023-07-25 14:57:08 +08:00
Mike Morrison
a309994b9e
Add setting to refresh directory contents ( #114 )
...
Refresh a directory's contents when fs_readdir is called
if it has been more than the number of seconds specified by
--refresh_timeout since the directory was last indexed.
2023-03-31 13:26:15 +01:00
Nathaniel Wesley Filardo
12abb7d8ad
Add --cacert and --proxy-cacert
...
Fixes https://github.com/fangfufu/httpdirfs/issues/108
2022-11-01 02:13:27 +00:00
Nathaniel Wesley Filardo
ff5f566dd9
Link_download_full: don't FREE(NULL)
...
It's entirely possible that `ts.data` is `NULL` on an error path, so
handing it to `FREE()`, which bails on a `NULL` argument, is not ideal.
Just pass it to `free()` instead, which is required to no-op if given
`NULL`.
2022-11-01 01:59:03 +00:00
Fufu Fang
67edcc906f
Clean up for the master branch
2021-09-04 12:41:33 +01:00
Fufu Fang
ebcfb0a79e
periodic backup
2021-09-04 03:00:25 +01:00
Fufu Fang
5d539c30b1
started writing the ramcache
2021-09-04 01:28:01 +01:00
Fufu Fang
939e287c87
adjusted includes
2021-09-03 21:39:31 +01:00
Fufu Fang
6819ad09e4
removed unnecessary includes
2021-09-03 21:23:52 +01:00
Fufu Fang
7c6433f0cd
more refactoring
2021-09-03 17:00:32 +01:00
Fufu Fang
1efe5932cf
more refactoring
2021-09-03 16:58:08 +01:00
Fufu Fang
dd8d887f94
more refactoring
2021-09-03 16:29:00 +01:00
Fufu Fang
d403fa339b
minor refactoring
2021-09-03 15:41:22 +01:00
Fufu Fang
cd6bb5bee8
more refactoring
2021-09-03 14:56:11 +01:00
Fufu Fang
bc88a681e3
check return for curl_easy_setopt, also new libcurl debug level
2021-09-03 12:57:52 +01:00
Fufu Fang
08eb04fb0e
refactoring - now check return code from curl_easy_getinfo
2021-09-03 12:47:48 +01:00
Fufu Fang
c64a139b46
refactoring transfer_blocking
2021-09-03 12:40:35 +01:00
Fufu Fang
177b738522
removed ts_ptr from Link
2021-09-02 16:52:39 +01:00
Fufu Fang
2d42313e8f
compiles, but not running properly
2021-09-02 15:36:53 +01:00
Fufu Fang
31f8509f42
moved the *sonic related fields into a separate struct
2021-09-01 21:29:13 +01:00
Fufu Fang
464c8e4863
Merged transfer status struct and transfer data struct
2021-09-01 11:56:18 +01:00
Fufu Fang
a76366c481
improved error handling in path_download
2021-09-01 11:03:27 +01:00
Fufu Fang
95b86825ed
Added minimum transfer size in TransferDataStruct
2021-09-01 03:53:19 +01:00
Fufu Fang
08c1eeba49
added initial debug statements
2021-08-31 21:30:24 +01:00
Fufu Fang
3c7e79089b
changed error handling for empty file
2021-08-31 18:54:58 +01:00
Fufu Fang
5e87ac92b0
Change error handling in cache.c, Updated Changelog.md
2021-08-31 18:49:49 +01:00
Fufu Fang
f42264d3c3
Added single file mode
...
Implemented feature request
https://github.com/fangfufu/httpdirfs/issues/86
2021-08-31 13:52:25 +01:00
Fufu Fang
af45bcfa19
replaced strlen with strnlen
2021-08-31 12:31:02 +01:00
Fufu Fang
6713362a5f
improved error handling
2021-08-31 11:59:28 +01:00
Fufu Fang
e02042cade
improved logging
2021-08-31 11:50:59 +01:00
Fufu Fang
45d8cb8136
changed indentation style
2021-08-31 11:18:39 +01:00
Fufu Fang
f791ceb308
shortened error log format, changed indentation style
2021-08-31 11:15:00 +01:00
Fufu Fang
b03954482e
changed linktable offset
2021-08-31 10:37:56 +01:00
Fufu Fang
7b6277cb3d
now check for the invalid CONFIG.mode
2021-08-31 00:23:50 +01:00
Fufu Fang
0f3cc61875
relabelled all log outputs
2021-08-30 11:24:32 +01:00
Fufu Fang
0219d7460a
only network.c needs to be cleaned up
2021-08-30 05:17:15 +01:00
Fufu Fang
2a4c61477a
clean up lprintf statements - we have link.c and network.c left.
2021-08-30 03:43:45 +01:00
Fufu Fang
7813487c50
improved error message, removed unnecessary locks
2021-08-30 02:50:03 +01:00
Fufu Fang
14c4b3b486
updated logging facility
2021-08-29 22:46:24 +01:00
Fufu Fang
f37cdefa47
Various changes
...
- Rather than using a flag to indicate operating mode, now we use
a variable.
- Change log printing level names
- Change the return for Cache_exist
2021-08-29 14:07:22 +01:00
Fufu Fang
05ebf76094
fixed LinkTable_uninitialised_fill() status output
2021-08-29 10:58:11 +01:00
Fufu Fang
6d5267089f
improved debug messages
2021-08-22 02:26:09 +01:00
MecryWork
33bbd21e9f
Fix memory overflow
...
Co-authored-by: MecryWork
2021-08-12 13:28:37 +01:00
Fufu Fang
e76b079fe6
Fix issue #59
...
Stop duplicated link from showing for Apache server configured
with IconsAreLinks option.
2021-08-08 14:25:28 +01:00
Fufu Fang
861481e6e1
Fixed issue #71
...
Now allows link which start with percentage encoding
2021-08-05 00:34:07 +01:00