hjp
/
simba
1
0
Fork 0
Code Issues 2 Pull Requests Releases Wiki Activity

Commit Graph

  • 1ae975f33f Install umount-all-backups master Peter J. Holzer 2023-12-03 00:25:58 +0100
  • 3d78d4dd82 Add umount-all-backups Peter J. Holzer 2023-12-03 00:23:10 +0100
  • 45095845fd Limit instances to deduplicate by id Peter J. Holzer 2023-11-29 06:04:02 +0100
  • 118bb0a2e7 Fix pruning Peter J. Holzer 2023-11-29 06:03:36 +0100
  • 92125c7c4e Uncompress gzipped files Peter J. Holzer 2022-03-26 10:04:07 +0100
  • e8c34ce1b5 Fix typo Peter J. Holzer 2022-03-13 23:22:24 +0100
  • 7180c24cc3 Add (hardcoded) timeout to reserve_fileset Peter J. Holzer 2021-07-25 12:22:54 +0200
  • 88f226757d Add sortorder to filesets Peter J. Holzer 2021-07-25 12:22:27 +0200
  • 24932a63ac Log selected previous backup Peter J. Holzer 2021-07-25 12:21:10 +0200
  • 289670b313 Treat zero length files specially for better performance Peter J. Holzer 2021-07-25 12:19:18 +0200
  • 19b0faad02 Add linkdup_db to statistics Peter J. Holzer 2021-07-25 12:18:09 +0200
  • 270c64e758 Log statistics in backup2disk Peter J. Holzer 2021-01-31 13:47:59 +0100
  • 0cbf922eda Log progress by time instead of count Peter J. Holzer 2021-01-31 13:39:59 +0100
  • 164e6ab553 Log file version id Peter J. Holzer 2021-01-31 13:38:50 +0100
  • 23998cefbd Clamp mtime to +/- 2**31. Peter J. Holzer 2021-01-31 13:36:33 +0100
  • 615742845e Add scripts graph_free and graph_used Peter J. Holzer 2021-01-31 13:33:33 +0100
  • 34ce8eb0bc Implement timeout hjp 2021-01-21 15:34:30 +0000
  • d79a7d083c Fix sessions_on_same_device cache hjp 2020-07-18 08:52:00 +0000
  • 25fec312b0 Improve logging and documentation of backup device selection hjp 2020-07-18 08:49:56 +0000
  • f26d6b6640 Run backups for different filesets in parallel hjp 2019-11-09 10:22:34 +0000
  • 0d7a8e667b Report free space on all found backup volumes and the total hjp 2019-09-28 09:17:55 +0000
  • 8aa0c9ca5e Fix typo hjp 2019-09-28 09:15:21 +0000
  • f01efab3a6 Add documentation hjp 2019-09-08 09:06:01 +0000
  • a6b9dff48e Don't record fs_id:inode_number and time of backup for each instance by default hjp 2019-09-08 09:05:40 +0000
  • 7f0c656caf Add schema visualization hjp 2019-01-18 21:11:05 +0000
  • 90cdc088ed Add script to mount all backups hjp 2018-10-13 08:01:58 +0000
  • 86f05574e5 Use LUKS encryption if available hjp 2018-10-01 20:48:07 +0000
  • 18c9936606 Use O_NOATIME hjp 2018-03-05 19:33:19 +0000
  • 33d8e11a3e Create log dir if necessary hjp 2018-03-05 19:32:59 +0000
  • a83aa49a89 Export to local disk instead of backup medium. hjp 2017-01-28 14:06:34 +0000
  • 838af50376 Install remove_session hjp 2016-11-20 20:25:41 +0000
  • f8ef39ae0f Add column active to mark filesets which should be backed up. hjp 2016-06-08 19:48:33 +0000
  • 6514b6cdb6 Create export dir and commit after session. hjp 2016-05-08 19:53:26 +0000
  • d7446596d9 umount all unused backup dirs, cd into the used backup dir hjp 2015-09-05 23:38:54 +0000
  • 99f174bd0d rebuild empty partitions. hjp 2014-12-14 10:07:25 +0000
  • cd48a38516 Added option --age to expire all instances beyond a certain age. hjp 2014-12-14 09:34:47 +0000
  • 810552e10f hardcoded path to gzip. hjp 2014-01-12 11:00:57 +0000
  • 6392f06826 At the end of a run, export all sessions which haven't been exported yet to the current basedir. hjp 2014-01-11 18:50:14 +0000
  • 5ae126f797 typo hjp 2014-01-11 18:44:43 +0000
  • 48ae9b2939 remove_session hjp 2014-01-11 18:44:23 +0000
  • 404d448634 Removed the customization from the build system. I don't remember what it was for (installing into a custom directory?). hjp 2014-01-11 18:44:02 +0000
  • b58ef04af7 Added missing parameter to $versions->first(). How could this have worked before? hjp 2013-12-01 18:49:32 +0000
  • 4a046ecf3d reactivated remove_orphaned_files. hjp 2013-12-01 12:17:15 +0000
  • 6982561a6d reimplemented the outer join in perl with two separate queries and a judy bitmap. This is about 20 times faster (1 hour instead of 20 for 1.3E9 instances and 125E6 versions). hjp 2013-12-01 12:10:35 +0000
  • 71e2f16454 moved removal of orphaned records into their own functions and after the loop. hjp 2013-12-01 09:08:38 +0000
  • dbd472cac6 Commit. Flush stdout. hjp 2013-12-01 09:01:58 +0000
  • 055cc98b3a fixed trivial errors hjp 2013-11-26 21:51:49 +0000
  • b2eb491d08 script to remove session(s) from database. hjp 2013-11-26 21:50:50 +0000
  • d5e1e04495 Check for gzipped files, too. hjp 2013-11-26 21:50:11 +0000
  • 2bc5967e10 Automatically create a new partition if the current one doesn't have enough free space. hjp 2013-11-26 21:33:11 +0000
  • d360ae4722 Avoid trying to use an undefined value as an array reference. hjp 2013-11-13 22:09:29 +0000
  • accc96a1e4 Added dependency on Digest::SHA. hjp 2013-11-13 00:26:12 +0000
  • 317671456d Added Simba/CA/DBI.pm and convert_mysql_to_pgsql to repository. hjp 2013-11-13 00:24:35 +0000
  • 756d9ce01a Added metadata. hjp 2013-11-13 00:21:09 +0000
  • 6a1be23732 Added dist_abstract and removed dependency on SHA1. Added script simba_export. hjp 2013-11-13 00:20:00 +0000
  • ff9f0d48f1 Need to commit periodically. flush_insert_instances is the most logical place although that may be a bit too often. hjp 2012-10-09 06:57:27 +0000
  • cc770cdf9e Read all checksums from the last session and store them in a hash. This should speed up retrieving checksums considerably. hjp 2012-09-29 10:44:10 +0000
  • 069d20a488 replaced Digest::SHA1 with Digest::SHA. hjp 2012-09-20 10:47:19 +0000
  • 440f4f67db avoid warning hjp 2011-03-25 12:15:34 +0000
  • 3f08edbd25 this script checks for all instances with a given prefix whether they actually exist and removes them from the database if they don't. hjp 2010-11-15 10:26:14 +0000
  • 4f7aa4cc04 it's not (generally) "my" pid hjp 2010-09-11 09:59:24 +0000
  • 2596541fd0 rlease lock at the end, don't try to reserve it again. hjp 2010-09-11 07:26:27 +0000
  • ea76362546 lock fileset by storing the pid in the table. Somewhat ugly but should work. hjp 2010-09-02 12:05:59 +0000
  • 3a2570be8e fixed some typos hjp 2010-09-02 11:41:21 +0000
  • 9c0af9a71e Find files with checksum is null hjp 2010-09-02 11:40:57 +0000
  • 4f4e5540ff lock fileset during backup to avoid concurrent backups of the same dataset. Only search the last few (well, currently 30) sessions with a backup on the same device for matching files in linkdup. Started to work on support for tokyocabinet hjp 2010-09-02 08:24:07 +0000
  • 944d7f3be9 added bug: dup detection hjp 2010-09-01 11:00:13 +0000
  • 5953f4048a Note about MySQL rebuilding a damaged index. hjp 2010-06-16 08:28:44 +0000
  • 259d97bc99 avoid temporary filenames with more than 255 characters. hjp 2010-05-26 20:09:05 +0000
  • fe23839aaf log mounts hjp 2010-05-20 09:25:20 +0000
  • 58b8ab7403 finer grained profiling of versions2 handling hjp 2010-05-20 09:24:54 +0000
  • 1452afe110 added comment about ENOENT hjp 2010-05-18 08:03:45 +0000
  • 3a8c8e86a8 estimate free space by inodes, too. hjp 2010-04-24 20:23:58 +0000
  • 28745ebffa documented log levels hjp 2010-04-24 20:23:21 +0000
  • 4aa78b8530 write to random backup device, not the least full hjp 2010-04-13 21:54:39 +0000
  • f8856de2c9 (late commit) Improved search for last session (now only finds sessions which were completed successfully). Some speed optimizations (not very successfull, iirc). hjp 2010-04-09 20:28:20 +0000
  • 1f6f4c2949 Added (experimental) schema for PostgreSQL. hjp 2009-11-24 16:16:47 +0000
  • 2bc2878dd3 more timing info hjp 2009-09-25 19:58:20 +0000
  • 582cf47a11 Moved backup to scripts directory and added to script_files. hjp 2009-09-24 08:12:13 +0000
  • ff0848e57f private key creation hjp 2009-09-22 09:05:19 +0000
  • c0254d8f53 Try to find all devices suitable for backup and mount them. hjp 2009-09-22 09:04:53 +0000
  • 74da594a66 Only try to hardlink to old versions on the same device. This should significantly speed up the first backup to a new device. Added some timing info to the log. hjp 2009-09-10 16:14:21 +0000
  • 8334de1d7b versions split into versions2 and instances. hjp 2009-08-19 11:33:12 +0000
  • 8a85412ec7 simba_* users need to be privileged. hjp 2009-08-19 11:24:58 +0000
  • b8210f431e Fixed equality checking for setuid files. Setuid files are now stored as setuid which means that the backup volume should be mounted nosuid or even noexec unless you trust all your clients. hjp 2009-06-28 20:24:18 +0000
  • b699d9b65f fixed detection of best backup dir. hjp 2009-06-28 20:21:14 +0000
  • 0b5aa8283b noted that dieing is suboptimal. hjp 2008-07-15 21:18:16 +0000
  • 54c4472a16 deal with several backup dirs. hjp 2008-07-15 21:17:14 +0000
  • a06a715c5d restrict logging by default. hjp 2008-07-13 20:01:25 +0000
  • 2edaa67ccc mkdir_p problem hjp 2008-06-20 06:19:18 +0000
  • 30512f5471 fixed some db queries. Identified (but haven't yet fixed) lack of error handling when reading from CA. hjp 2008-05-04 13:42:31 +0000
  • 6ce3a6b0c5 somewhat naive conversion to new db layout hjp 2008-04-17 21:34:39 +0000
  • 22bc19fd19 mysql doesn't support nested commands, so we need to read a chunk of data from versions, insert it into versions2 and instances, then read the next chunk ... hjp 2008-04-17 21:34:08 +0000
  • d0911e115e script to split versions table. hjp 2008-04-13 10:37:20 +0000
  • 066869e9c2 Try to be more intelligent in linking to old instances of the same file. Especially recover from various errors (e.g. link count exvceeded) by creating a new file. hjp 2008-04-13 10:36:46 +0000
  • 87ab219c31 fixed count of skipped tests. hjp 2008-04-05 11:21:51 +0000
  • c42aeb5aee Refactoring: Moved code to store a regular file in a sub of its own, but don't change the logic yet. Put info about file related subprocesses into $self so that this can be cleaned up after the session ends. Added a few log messages. hjp 2008-04-05 11:21:28 +0000
  • 446c3a6fdc fixed name of DA config file. hjp 2008-03-23 16:30:48 +0000
  • b110319851 First draft of installation instructions. hjp 2008-03-23 16:27:01 +0000
  • 26afacf9d0 really fix permissions of da hjp 2008-03-21 21:39:32 +0000