Commit Graph

48 Commits

Author SHA1 Message Date
Alexander Neumann 58cded6b75 Refactor progress reporting 2015-02-21 14:25:06 +01:00
Alexander Neumann 97b963ef1d Report files and dirs 2015-02-21 14:05:02 +01:00
Alexander Neumann a0fea201d9 Reenable Preloading 2015-02-18 23:10:59 +01:00
Alexander Neumann f8e47181b0 Add more debug for preloading 2015-02-17 23:38:40 +01:00
Alexander Neumann 677a5038c5 Increase concurrency for loading blobs 2015-02-17 23:15:08 +01:00
Alexander Neumann 4bb7f2f2ed Add Preloader for blobs 2015-02-17 22:39:44 +01:00
Alexander Neumann 4fd8222da6 Remove unneeded buffers from Archiver.SaveFile() 2015-02-16 23:47:32 +01:00
Alexander Neumann 06ed5c12b8 Remove Compress() and Uncompress() from backend 2015-02-16 00:30:51 +01:00
Alexander Neumann f8f8107d55 wip 2015-02-15 15:17:24 +01:00
Alexander Neumann bbb3145f11 Add chunker pool 2015-02-09 23:38:50 +01:00
Alexander Neumann bda33e612c Implement streaming chunker using io.Reader 2015-02-09 00:28:54 +01:00
Alexander Neumann 25a214809b Refactor debug into debug module 2015-01-17 16:32:13 +01:00
Alexander Neumann af43fb3dda Fix handling vanished files 2015-01-14 17:48:23 +01:00
Alexander Neumann 4e54c6af2c Fix calls to debug() 2015-01-14 17:48:10 +01:00
Alexander Neumann 48751e1935 Introduce debug tags and debug breaks
The environment variable DEBUG_TAGS can be used to control what is
printed on stderr. Example:

    DEBUG_TAGS="+all,-Archiver.*" ./restic backup foo

The variable DEBUG_BREAK can be used to set a breakpoint (implemented
using SIGSTOP):

    DEBUG_BREAK=Archiver.Snapshot ./restic backup foo
2015-01-14 16:34:30 +01:00
Alexander Neumann 203a911de9 Refactor repository structure
Merge Map data type into Tree.
2015-01-14 16:34:30 +01:00
Alexander Neumann cdf3336e7a Improve error message for newer files 2015-01-08 20:49:32 +01:00
Alexander Neumann 33bcf31bae Fix incremental backup
Copying blobs (for unchanged files and subtrees) from old BlobList to
new BlobList was missing
2015-01-05 21:40:43 +01:00
Alexander Neumann 6eb969a492 Update modified files, store error message 2015-01-04 23:25:13 +01:00
Alexander Neumann e543f5926c Refactor Archiver and backup command
Improve incremental backup by first scanning the tree, loading the old
tree and afterwards comparing both trees in memory.
2015-01-04 22:39:30 +01:00
Alexander Neumann fe231af7fc Remove error from return value of NewContentHandler 2015-01-04 20:07:30 +01:00
Alexander Neumann 4b70bba588 Split Scanner from Archiver, refactor Progress 2015-01-04 18:23:00 +01:00
Alexander Neumann a93bc3c991 Rename functions, remove code for compare
* Archiver: Rename loadTree -> scan and LoadTree -> Scan
 * Archiver: Remove code to compare against an old snapshot/tree,
   the current implementation was really slow
2015-01-04 16:13:50 +01:00
Alexander Neumann ef41a77aff Remove explicit key handling 2014-12-21 18:10:19 +01:00
Alexander Neumann cc147c002e Introduce type Server 2014-12-21 17:37:29 +01:00
Alexander Neumann 5eaa427e80 Save UID and GID as integer in Snapshot 2014-12-21 17:20:49 +01:00
Alexander Neumann 202984a93f Rename snapshot.Content -> snapshot.Tree 2014-12-07 14:14:50 +01:00
Alexander Neumann 3336f2b8e7 Check number of bytes saved for each file 2014-12-07 13:34:56 +01:00
Alexander Neumann e2fea0d088 Rename khepri -> restic 2014-12-05 21:45:49 +01:00
Alexander Neumann 13fc9fe604 Add additional check 2014-12-01 00:06:29 +01:00
Alexander Neumann caf00f6087 Save blobs from parent snapshot to new snapshot 2014-11-30 23:12:47 +01:00
Alexander Neumann f5e76a0044 Add safety check: count chunks and compare to blobs 2014-11-30 22:49:14 +01:00
Alexander Neumann 3325fa07ea Check timestamps for files 2014-11-30 22:34:21 +01:00
Alexander Neumann 4246e7602f Store empty list of blobs for empty files 2014-11-30 22:16:34 +01:00
Alexander Neumann c0b3021494 Correctly deal with empty files 2014-11-30 16:24:27 +01:00
Alexander Neumann bbaba349b2 Panic on error saving blobs 2014-11-29 10:52:06 +01:00
Alexander Neumann 33ce4e33aa Store maps in new subdir "maps" 2014-11-23 22:26:01 +01:00
Alexander Neumann b1923063fe Ignore ErrUnexpectedEOF for io.ReadFull 2014-11-23 21:49:57 +01:00
Alexander Neumann f95788ed90 Limit memory usage, add several sync.Pool 2014-11-23 21:26:20 +01:00
Alexander Neumann 21df0e50e5 Refactor stats
* channel instead of callback func
 * cumulate Stats for slow receivers
2014-11-23 13:51:02 +01:00
Alexander Neumann 7d1ba8ab65 Ignore permission errors for backup 2014-11-23 12:15:19 +01:00
Alexander Neumann d11688f242 Save multiple data blobs in parallel 2014-11-22 22:05:39 +01:00
Alexander Neumann d1e4431514 Refactor StorageMap to BlobList 2014-11-22 21:05:18 +01:00
Alexander Neumann 551c7525fe Rename chunker so package chunker does not overlap 2014-11-18 21:46:49 +01:00
Alexander Neumann fe92062735 Move SaveFile to Archiver, add blobs status 2014-11-18 21:46:49 +01:00
Alexander Neumann 94d1482888 Save multiple files in parallel 2014-11-18 21:46:44 +01:00
Alexander Neumann 4a3a6861e2 Scan directory first, then backup. Add stats. 2014-11-17 23:52:31 +01:00
Alexander Neumann 30ab03b7b7 Add decrypt, refactor 2014-10-03 21:44:55 +02:00