Commit Graph

105 Commits

Author SHA1 Message Date
hjp 317671456d Added Simba/CA/DBI.pm and convert_mysql_to_pgsql to repository. 2013-11-13 00:24:35 +00:00
hjp 756d9ce01a Added metadata. 2013-11-13 00:21:09 +00:00
hjp 6a1be23732 Added dist_abstract and removed dependency on SHA1.
Added script simba_export.
2013-11-13 00:20:00 +00:00
hjp ff9f0d48f1 Need to commit periodically. flush_insert_instances is the most logical
place although that may be a bit too often.
2012-10-09 06:57:27 +00:00
hjp cc770cdf9e Read all checksums from the last session and store them in a hash.
This should speed up retrieving checksums considerably.
2012-09-29 10:44:10 +00:00
hjp 069d20a488 replaced Digest::SHA1 with Digest::SHA. 2012-09-20 10:47:19 +00:00
hjp 440f4f67db avoid warning 2011-03-25 12:15:34 +00:00
hjp 3f08edbd25 this script checks for all instances with a given prefix whether they
actually exist and removes them from the database if they don't.

this is mostly useful after part of a backup has been (intentionally
or accidentally) deleted.
2010-11-15 10:26:14 +00:00
hjp 4f7aa4cc04 it's not (generally) "my" pid 2010-09-11 09:59:24 +00:00
hjp 2596541fd0 rlease lock at the end, don't try to reserve it again. 2010-09-11 07:26:27 +00:00
hjp ea76362546 lock fileset by storing the pid in the table. Somewhat ugly but should
work.
2010-09-02 12:05:59 +00:00
hjp 3a2570be8e fixed some typos 2010-09-02 11:41:21 +00:00
hjp 9c0af9a71e Find files with checksum is null 2010-09-02 11:40:57 +00:00
hjp 4f4e5540ff lock fileset during backup to avoid concurrent backups of the same
dataset.
Only search the last few (well, currently 30) sessions with a backup on
the same device for matching files in linkdup.
Started to work on support for tokyocabinet
2010-09-02 08:24:07 +00:00
hjp 944d7f3be9 added bug: dup detection 2010-09-01 11:00:13 +00:00
hjp 5953f4048a Note about MySQL rebuilding a damaged index. 2010-06-16 08:28:44 +00:00
hjp 259d97bc99 avoid temporary filenames with more than 255 characters. 2010-05-26 20:09:05 +00:00
hjp fe23839aaf log mounts 2010-05-20 09:25:20 +00:00
hjp 58b8ab7403 finer grained profiling of versions2 handling 2010-05-20 09:24:54 +00:00
hjp 1452afe110 added comment about ENOENT 2010-05-18 08:03:45 +00:00
hjp 3a8c8e86a8 estimate free space by inodes, too. 2010-04-24 20:23:58 +00:00
hjp 28745ebffa documented log levels 2010-04-24 20:23:21 +00:00
hjp 4aa78b8530 write to random backup device, not the least full 2010-04-13 21:54:39 +00:00
hjp f8856de2c9 (late commit)
Improved search for last session (now only finds sessions which were
completed successfully).
Some speed optimizations (not very successfull, iirc).
2010-04-09 20:28:20 +00:00
hjp 1f6f4c2949 Added (experimental) schema for PostgreSQL. 2009-11-24 16:16:47 +00:00
hjp 2bc2878dd3 more timing info 2009-09-25 19:58:20 +00:00
hjp 582cf47a11 Moved backup to scripts directory and added to script_files. 2009-09-24 08:12:13 +00:00
hjp ff0848e57f private key creation 2009-09-22 09:05:19 +00:00
hjp c0254d8f53 Try to find all devices suitable for backup and mount them. 2009-09-22 09:04:53 +00:00
hjp 74da594a66 Only try to hardlink to old versions on the same device.
This should significantly speed up the first backup to a new device.
Added some timing info to the log.
2009-09-10 16:14:21 +00:00
hjp 8334de1d7b versions split into versions2 and instances. 2009-08-19 11:33:12 +00:00
hjp 8a85412ec7 simba_* users need to be privileged. 2009-08-19 11:24:58 +00:00
hjp b8210f431e Fixed equality checking for setuid files.
Setuid files are now stored as setuid which means that the backup volume
should be mounted nosuid or even noexec unless you trust all your
clients.
2009-06-28 20:24:18 +00:00
hjp b699d9b65f fixed detection of best backup dir. 2009-06-28 20:21:14 +00:00
hjp 0b5aa8283b noted that dieing is suboptimal. 2008-07-15 21:18:16 +00:00
hjp 54c4472a16 deal with several backup dirs. 2008-07-15 21:17:14 +00:00
hjp a06a715c5d restrict logging by default. 2008-07-13 20:01:25 +00:00
hjp 2edaa67ccc mkdir_p problem 2008-06-20 06:19:18 +00:00
hjp 30512f5471 fixed some db queries.
Identified (but haven't yet fixed) lack of error handling when reading
from CA.
2008-05-04 13:42:31 +00:00
hjp 6ce3a6b0c5 somewhat naive conversion to new db layout 2008-04-17 21:34:39 +00:00
hjp 22bc19fd19 mysql doesn't support nested commands,
so we need to read a chunk of data from versions,
insert it into versions2 and instances,
then read the next chunk ...
2008-04-17 21:34:08 +00:00
hjp d0911e115e script to split versions table. 2008-04-13 10:37:20 +00:00
hjp 066869e9c2 Try to be more intelligent in linking to old instances of the same file.
Especially recover from various errors (e.g. link count exvceeded) by
creating a new file.

Note: This code is extremely slow and should not be used. A
reorganisation of the database layout is in progress.
2008-04-13 10:36:46 +00:00
hjp 87ab219c31 fixed count of skipped tests. 2008-04-05 11:21:51 +00:00
hjp c42aeb5aee Refactoring: Moved code to store a regular file in a sub of its own,
but don't change the logic yet. Put info about file related subprocesses 
into $self so that this can be cleaned up after the session ends.
Added a few log messages.
2008-04-05 11:21:28 +00:00
hjp 446c3a6fdc fixed name of DA config file. 2008-03-23 16:30:48 +00:00
hjp b110319851 First draft of installation instructions. 2008-03-23 16:27:01 +00:00
hjp 26afacf9d0 really fix permissions of da 2008-03-21 21:39:32 +00:00
hjp 3fa026c805 Added option filesets to backup only some filesets (instead of all of
them).
2008-03-21 11:12:42 +00:00
hjp b32e22fd99 fix permissions of da. 2008-03-20 21:13:04 +00:00