Commit Graph

141 Commits

Author SHA1 Message Date
hjp 34ce8eb0bc Implement timeout 2021-01-21 15:34:30 +00:00
hjp d79a7d083c Fix sessions_on_same_device cache
This hasn't been working for at least 10 years. We treated the contents
of the cache as a list of ids, but it was really a list of records. Now
we just store the ids, since we don't need the rest of the info.
2020-07-18 08:52:00 +00:00
hjp 25fec312b0 Improve logging and documentation of backup device selection 2020-07-18 08:49:56 +00:00
hjp f26d6b6640 Run backups for different filesets in parallel 2019-11-09 10:22:34 +00:00
hjp 0d7a8e667b Report free space on all found backup volumes and the total 2019-09-28 09:17:55 +00:00
hjp 8aa0c9ca5e Fix typo 2019-09-28 09:15:21 +00:00
hjp f01efab3a6 Add documentation 2019-09-08 09:06:01 +00:00
hjp a6b9dff48e Don't record fs_id:inode_number and time of backup for each instance by default
We don't actually use that information.
2019-09-08 09:05:40 +00:00
hjp 7f0c656caf Add schema visualization 2019-01-18 21:11:05 +00:00
hjp 90cdc088ed Add script to mount all backups
I had a simple zsh script before, but with LUKS support that would have
become more complex, so I just copied the relevant code from the backup
script.
2018-10-13 08:01:58 +00:00
hjp 86f05574e5 Use LUKS encryption if available 2018-10-01 20:48:07 +00:00
hjp 18c9936606 Use O_NOATIME 2018-03-05 19:33:19 +00:00
hjp 33d8e11a3e Create log dir if necessary 2018-03-05 19:32:59 +00:00
hjp a83aa49a89 Export to local disk instead of backup medium.
The export directory will then be backed up normally, which is a simple
copy operation, while exporting all sessions is expensive and should not
be repeated for every new backup medium.
2017-01-28 14:06:34 +00:00
hjp 838af50376 Install remove_session 2016-11-20 20:25:41 +00:00
hjp f8ef39ae0f Add column active to mark filesets which should be backed up.
This can still be overridden with the filesets option.
2016-06-08 19:48:33 +00:00
hjp 6514b6cdb6 Create export dir and commit after session. 2016-05-08 19:53:26 +00:00
hjp d7446596d9 umount all unused backup dirs, cd into the used backup dir 2015-09-05 23:38:54 +00:00
hjp 99f174bd0d rebuild empty partitions. 2014-12-14 10:07:25 +00:00
hjp cd48a38516 Added option --age to expire all instances beyond a certain age. 2014-12-14 09:34:47 +00:00
hjp 810552e10f hardcoded path to gzip. 2014-01-12 11:00:57 +00:00
hjp 6392f06826 At the end of a run, export all sessions which haven't been exported yet
to the current basedir.
2014-01-11 18:50:14 +00:00
hjp 5ae126f797 typo 2014-01-11 18:44:43 +00:00
hjp 48ae9b2939 remove_session 2014-01-11 18:44:23 +00:00
hjp 404d448634 Removed the customization from the build system.
I don't remember what it was for (installing into a custom directory?).
2014-01-11 18:44:02 +00:00
hjp b58ef04af7 Added missing parameter to $versions->first(). How could this have
worked before?
2013-12-01 18:49:32 +00:00
hjp 4a046ecf3d reactivated remove_orphaned_files. 2013-12-01 12:17:15 +00:00
hjp 6982561a6d reimplemented the outer join in perl with two separate queries and a
judy bitmap. This is about 20 times faster (1 hour instead of 20 for
1.3E9 instances and 125E6 versions).
2013-12-01 12:10:35 +00:00
hjp 71e2f16454 moved removal of orphaned records into their own functions and after the
loop.
2013-12-01 09:08:38 +00:00
hjp dbd472cac6 Commit.
Flush stdout.
2013-12-01 09:01:58 +00:00
hjp 055cc98b3a fixed trivial errors 2013-11-26 21:51:49 +00:00
hjp b2eb491d08 script to remove session(s) from database. 2013-11-26 21:50:50 +00:00
hjp d5e1e04495 Check for gzipped files, too. 2013-11-26 21:50:11 +00:00
hjp 2bc5967e10 Automatically create a new partition if the current one doesn't have
enough free space.
2013-11-26 21:33:11 +00:00
hjp d360ae4722 Avoid trying to use an undefined value as an array reference. 2013-11-13 22:09:29 +00:00
hjp accc96a1e4 Added dependency on Digest::SHA. 2013-11-13 00:26:12 +00:00
hjp 317671456d Added Simba/CA/DBI.pm and convert_mysql_to_pgsql to repository. 2013-11-13 00:24:35 +00:00
hjp 756d9ce01a Added metadata. 2013-11-13 00:21:09 +00:00
hjp 6a1be23732 Added dist_abstract and removed dependency on SHA1.
Added script simba_export.
2013-11-13 00:20:00 +00:00
hjp ff9f0d48f1 Need to commit periodically. flush_insert_instances is the most logical
place although that may be a bit too often.
2012-10-09 06:57:27 +00:00
hjp cc770cdf9e Read all checksums from the last session and store them in a hash.
This should speed up retrieving checksums considerably.
2012-09-29 10:44:10 +00:00
hjp 069d20a488 replaced Digest::SHA1 with Digest::SHA. 2012-09-20 10:47:19 +00:00
hjp 440f4f67db avoid warning 2011-03-25 12:15:34 +00:00
hjp 3f08edbd25 this script checks for all instances with a given prefix whether they
actually exist and removes them from the database if they don't.

this is mostly useful after part of a backup has been (intentionally
or accidentally) deleted.
2010-11-15 10:26:14 +00:00
hjp 4f7aa4cc04 it's not (generally) "my" pid 2010-09-11 09:59:24 +00:00
hjp 2596541fd0 rlease lock at the end, don't try to reserve it again. 2010-09-11 07:26:27 +00:00
hjp ea76362546 lock fileset by storing the pid in the table. Somewhat ugly but should
work.
2010-09-02 12:05:59 +00:00
hjp 3a2570be8e fixed some typos 2010-09-02 11:41:21 +00:00
hjp 9c0af9a71e Find files with checksum is null 2010-09-02 11:40:57 +00:00
hjp 4f4e5540ff lock fileset during backup to avoid concurrent backups of the same
dataset.
Only search the last few (well, currently 30) sessions with a backup on
the same device for matching files in linkdup.
Started to work on support for tokyocabinet
2010-09-02 08:24:07 +00:00