hjp
/
simba
1
0
Fork 0
Code Issues 2 Pull Requests Releases Wiki Activity
147 Commits 1 Branch 0 Tags 344 KiB
Commit Graph

147 Commits

Author SHA1 Message Date
Peter J. Holzer 19b0faad02 Add linkdup_db to statistics 2021-07-25 12:18:09 +02:00
Peter J. Holzer 270c64e758 Log statistics in backup2disk 
Backups are running in child processes so the CA object in the parent is
never updated. And per-fileset statistics are more interesting than the
total anyway.
 2021-01-31 13:47:59 +01:00
Peter J. Holzer 0cbf922eda Log progress by time instead of count 
Instead of logging the current file name every 1000 files we now log it
every 10 seconds. This makes it easier to see where backup is slow.
 2021-01-31 13:39:59 +01:00
Peter J. Holzer 164e6ab553 Log file version id 2021-01-31 13:38:50 +01:00
Peter J. Holzer 23998cefbd Clamp mtime to +/- 2**31. 2021-01-31 13:36:33 +01:00
Peter J. Holzer 615742845e Add scripts graph_free and graph_used 2021-01-31 13:33:33 +01:00
hjp 34ce8eb0bc Implement timeout 2021-01-21 15:34:30 +00:00
hjp d79a7d083c Fix sessions_on_same_device cache 
This hasn't been working for at least 10 years. We treated the contents
of the cache as a list of ids, but it was really a list of records. Now
we just store the ids, since we don't need the rest of the info.
 2020-07-18 08:52:00 +00:00
hjp 25fec312b0 Improve logging and documentation of backup device selection 2020-07-18 08:49:56 +00:00
hjp f26d6b6640 Run backups for different filesets in parallel 2019-11-09 10:22:34 +00:00
hjp 0d7a8e667b Report free space on all found backup volumes and the total 2019-09-28 09:17:55 +00:00
hjp 8aa0c9ca5e Fix typo 2019-09-28 09:15:21 +00:00
hjp f01efab3a6 Add documentation 2019-09-08 09:06:01 +00:00
hjp a6b9dff48e Don't record fs_id:inode_number and time of backup for each instance by default 
We don't actually use that information.
 2019-09-08 09:05:40 +00:00
hjp 7f0c656caf Add schema visualization 2019-01-18 21:11:05 +00:00
hjp 90cdc088ed Add script to mount all backups 
I had a simple zsh script before, but with LUKS support that would have
become more complex, so I just copied the relevant code from the backup
script.
 2018-10-13 08:01:58 +00:00
hjp 86f05574e5 Use LUKS encryption if available 2018-10-01 20:48:07 +00:00
hjp 18c9936606 Use O_NOATIME 2018-03-05 19:33:19 +00:00
hjp 33d8e11a3e Create log dir if necessary 2018-03-05 19:32:59 +00:00
hjp a83aa49a89 Export to local disk instead of backup medium. 
The export directory will then be backed up normally, which is a simple
copy operation, while exporting all sessions is expensive and should not
be repeated for every new backup medium.
 2017-01-28 14:06:34 +00:00
hjp 838af50376 Install remove_session 2016-11-20 20:25:41 +00:00
hjp f8ef39ae0f Add column active to mark filesets which should be backed up. 
This can still be overridden with the filesets option.
 2016-06-08 19:48:33 +00:00
hjp 6514b6cdb6 Create export dir and commit after session. 2016-05-08 19:53:26 +00:00
hjp d7446596d9 umount all unused backup dirs, cd into the used backup dir 2015-09-05 23:38:54 +00:00
hjp 99f174bd0d rebuild empty partitions. 2014-12-14 10:07:25 +00:00
hjp cd48a38516 Added option --age to expire all instances beyond a certain age. 2014-12-14 09:34:47 +00:00
hjp 810552e10f hardcoded path to gzip. 2014-01-12 11:00:57 +00:00
hjp 6392f06826 At the end of a run, export all sessions which haven't been exported yet 
to the current basedir.
 2014-01-11 18:50:14 +00:00
hjp 5ae126f797 typo 2014-01-11 18:44:43 +00:00
hjp 48ae9b2939 remove_session 2014-01-11 18:44:23 +00:00
hjp 404d448634 Removed the customization from the build system. 
I don't remember what it was for (installing into a custom directory?).
 2014-01-11 18:44:02 +00:00
hjp b58ef04af7 Added missing parameter to $versions->first(). How could this have 
worked before?
 2013-12-01 18:49:32 +00:00
hjp 4a046ecf3d reactivated remove_orphaned_files. 2013-12-01 12:17:15 +00:00
hjp 6982561a6d reimplemented the outer join in perl with two separate queries and a 
judy bitmap. This is about 20 times faster (1 hour instead of 20 for
1.3E9 instances and 125E6 versions).
 2013-12-01 12:10:35 +00:00
hjp 71e2f16454 moved removal of orphaned records into their own functions and after the 
loop.
 2013-12-01 09:08:38 +00:00
hjp dbd472cac6 Commit. 
Flush stdout.
 2013-12-01 09:01:58 +00:00
hjp 055cc98b3a fixed trivial errors 2013-11-26 21:51:49 +00:00
hjp b2eb491d08 script to remove session(s) from database. 2013-11-26 21:50:50 +00:00
hjp d5e1e04495 Check for gzipped files, too. 2013-11-26 21:50:11 +00:00
hjp 2bc5967e10 Automatically create a new partition if the current one doesn't have 
enough free space.
 2013-11-26 21:33:11 +00:00
hjp d360ae4722 Avoid trying to use an undefined value as an array reference. 2013-11-13 22:09:29 +00:00
hjp accc96a1e4 Added dependency on Digest::SHA. 2013-11-13 00:26:12 +00:00
hjp 317671456d Added Simba/CA/DBI.pm and convert_mysql_to_pgsql to repository. 2013-11-13 00:24:35 +00:00
hjp 756d9ce01a Added metadata. 2013-11-13 00:21:09 +00:00
hjp 6a1be23732 Added dist_abstract and removed dependency on SHA1. 
Added script simba_export.
 2013-11-13 00:20:00 +00:00
hjp ff9f0d48f1 Need to commit periodically. flush_insert_instances is the most logical 
place although that may be a bit too often.
 2012-10-09 06:57:27 +00:00
hjp cc770cdf9e Read all checksums from the last session and store them in a hash. 
This should speed up retrieving checksums considerably.
 2012-09-29 10:44:10 +00:00
hjp 069d20a488 replaced Digest::SHA1 with Digest::SHA. 2012-09-20 10:47:19 +00:00
hjp 440f4f67db avoid warning 2011-03-25 12:15:34 +00:00
hjp 3f08edbd25 this script checks for all instances with a given prefix whether they 
actually exist and removes them from the database if they don't.

this is mostly useful after part of a backup has been (intentionally
or accidentally) deleted.
 2010-11-15 10:26:14 +00:00