Commit Graph

125 Commits

Author SHA1 Message Date
hjp 6514b6cdb6 Create export dir and commit after session. 2016-05-08 19:53:26 +00:00
hjp d7446596d9 umount all unused backup dirs, cd into the used backup dir 2015-09-05 23:38:54 +00:00
hjp 99f174bd0d rebuild empty partitions. 2014-12-14 10:07:25 +00:00
hjp cd48a38516 Added option --age to expire all instances beyond a certain age. 2014-12-14 09:34:47 +00:00
hjp 810552e10f hardcoded path to gzip. 2014-01-12 11:00:57 +00:00
hjp 6392f06826 At the end of a run, export all sessions which haven't been exported yet
to the current basedir.
2014-01-11 18:50:14 +00:00
hjp 5ae126f797 typo 2014-01-11 18:44:43 +00:00
hjp 48ae9b2939 remove_session 2014-01-11 18:44:23 +00:00
hjp 404d448634 Removed the customization from the build system.
I don't remember what it was for (installing into a custom directory?).
2014-01-11 18:44:02 +00:00
hjp b58ef04af7 Added missing parameter to $versions->first(). How could this have
worked before?
2013-12-01 18:49:32 +00:00
hjp 4a046ecf3d reactivated remove_orphaned_files. 2013-12-01 12:17:15 +00:00
hjp 6982561a6d reimplemented the outer join in perl with two separate queries and a
judy bitmap. This is about 20 times faster (1 hour instead of 20 for
1.3E9 instances and 125E6 versions).
2013-12-01 12:10:35 +00:00
hjp 71e2f16454 moved removal of orphaned records into their own functions and after the
loop.
2013-12-01 09:08:38 +00:00
hjp dbd472cac6 Commit.
Flush stdout.
2013-12-01 09:01:58 +00:00
hjp 055cc98b3a fixed trivial errors 2013-11-26 21:51:49 +00:00
hjp b2eb491d08 script to remove session(s) from database. 2013-11-26 21:50:50 +00:00
hjp d5e1e04495 Check for gzipped files, too. 2013-11-26 21:50:11 +00:00
hjp 2bc5967e10 Automatically create a new partition if the current one doesn't have
enough free space.
2013-11-26 21:33:11 +00:00
hjp d360ae4722 Avoid trying to use an undefined value as an array reference. 2013-11-13 22:09:29 +00:00
hjp accc96a1e4 Added dependency on Digest::SHA. 2013-11-13 00:26:12 +00:00
hjp 317671456d Added Simba/CA/DBI.pm and convert_mysql_to_pgsql to repository. 2013-11-13 00:24:35 +00:00
hjp 756d9ce01a Added metadata. 2013-11-13 00:21:09 +00:00
hjp 6a1be23732 Added dist_abstract and removed dependency on SHA1.
Added script simba_export.
2013-11-13 00:20:00 +00:00
hjp ff9f0d48f1 Need to commit periodically. flush_insert_instances is the most logical
place although that may be a bit too often.
2012-10-09 06:57:27 +00:00
hjp cc770cdf9e Read all checksums from the last session and store them in a hash.
This should speed up retrieving checksums considerably.
2012-09-29 10:44:10 +00:00
hjp 069d20a488 replaced Digest::SHA1 with Digest::SHA. 2012-09-20 10:47:19 +00:00
hjp 440f4f67db avoid warning 2011-03-25 12:15:34 +00:00
hjp 3f08edbd25 this script checks for all instances with a given prefix whether they
actually exist and removes them from the database if they don't.

this is mostly useful after part of a backup has been (intentionally
or accidentally) deleted.
2010-11-15 10:26:14 +00:00
hjp 4f7aa4cc04 it's not (generally) "my" pid 2010-09-11 09:59:24 +00:00
hjp 2596541fd0 rlease lock at the end, don't try to reserve it again. 2010-09-11 07:26:27 +00:00
hjp ea76362546 lock fileset by storing the pid in the table. Somewhat ugly but should
work.
2010-09-02 12:05:59 +00:00
hjp 3a2570be8e fixed some typos 2010-09-02 11:41:21 +00:00
hjp 9c0af9a71e Find files with checksum is null 2010-09-02 11:40:57 +00:00
hjp 4f4e5540ff lock fileset during backup to avoid concurrent backups of the same
dataset.
Only search the last few (well, currently 30) sessions with a backup on
the same device for matching files in linkdup.
Started to work on support for tokyocabinet
2010-09-02 08:24:07 +00:00
hjp 944d7f3be9 added bug: dup detection 2010-09-01 11:00:13 +00:00
hjp 5953f4048a Note about MySQL rebuilding a damaged index. 2010-06-16 08:28:44 +00:00
hjp 259d97bc99 avoid temporary filenames with more than 255 characters. 2010-05-26 20:09:05 +00:00
hjp fe23839aaf log mounts 2010-05-20 09:25:20 +00:00
hjp 58b8ab7403 finer grained profiling of versions2 handling 2010-05-20 09:24:54 +00:00
hjp 1452afe110 added comment about ENOENT 2010-05-18 08:03:45 +00:00
hjp 3a8c8e86a8 estimate free space by inodes, too. 2010-04-24 20:23:58 +00:00
hjp 28745ebffa documented log levels 2010-04-24 20:23:21 +00:00
hjp 4aa78b8530 write to random backup device, not the least full 2010-04-13 21:54:39 +00:00
hjp f8856de2c9 (late commit)
Improved search for last session (now only finds sessions which were
completed successfully).
Some speed optimizations (not very successfull, iirc).
2010-04-09 20:28:20 +00:00
hjp 1f6f4c2949 Added (experimental) schema for PostgreSQL. 2009-11-24 16:16:47 +00:00
hjp 2bc2878dd3 more timing info 2009-09-25 19:58:20 +00:00
hjp 582cf47a11 Moved backup to scripts directory and added to script_files. 2009-09-24 08:12:13 +00:00
hjp ff0848e57f private key creation 2009-09-22 09:05:19 +00:00
hjp c0254d8f53 Try to find all devices suitable for backup and mount them. 2009-09-22 09:04:53 +00:00
hjp 74da594a66 Only try to hardlink to old versions on the same device.
This should significantly speed up the first backup to a new device.
Added some timing info to the log.
2009-09-10 16:14:21 +00:00