Skip to content

Next #8

Draft
wants to merge 24 commits into
base: master
Choose a base branch
from
Draft

Next #8

wants to merge 24 commits into from

Commits on Apr 7, 2025

  1. pbackup: Cosmetics

    donald committed Apr 7, 2025
    Configuration menu
    Copy the full SHA
    b3c3cfd View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    a20ffd9 View commit details
    Browse the repository at this point in the history
  3. pbackup: Cosmetics

    donald committed Apr 7, 2025
    Configuration menu
    Copy the full SHA
    dd21d61 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    42943cd View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    b535e84 View commit details
    Browse the repository at this point in the history
  6. Add tmp do_jobs % command

    donald committed Apr 7, 2025
    Configuration menu
    Copy the full SHA
    14676d3 View commit details
    Browse the repository at this point in the history
  7. Align "status" output

    donald committed Apr 7, 2025
    Configuration menu
    Copy the full SHA
    a1cfc94 View commit details
    Browse the repository at this point in the history
  8. quickcheck: Change time limits

    We now have seperate FULL and INCREMENTAL backup jobs. Also we have the
    new REFRESH ('%') backup job. The 4/5 hours time limit was to low
    anyway, so implement new time limits:
    
    INCREMENTAL : 10 hours
    EXPIRE job  : 10 hours
    FULL        : 3 days
    BALANCE     : 3 days
    REFRESH     : 3 days
    donald committed Apr 7, 2025
    Configuration menu
    Copy the full SHA
    ee3657f View commit details
    Browse the repository at this point in the history
  9. quickcheck: Cosmetics

    donald committed Apr 7, 2025
    Configuration menu
    Copy the full SHA
    d354ca5 View commit details
    Browse the repository at this point in the history
  10. pbackup: Only dedup with jobs with same id

    Only dedup with jobid with same id, not with jobs with different jobid
    but same name or same distmaster family.
    
    While there is a win in used space for the extra deduplications, there
    is also a reason to keep the additional redundancy, because data can be
    corrupted when a project is moved or during dist.
    
    Additionally, the multiple database queries significantly slow down the
    "search for the next job to do" loop. This is more relevant for the
    search for FULL backups, becase ypically there are no FULL backups to be
    done during normal operation and the process has to walk over all jobs.
    donald committed Apr 7, 2025
    Configuration menu
    Copy the full SHA
    1abae36 View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    49e0e7a View commit details
    Browse the repository at this point in the history
  12. Configuration menu
    Copy the full SHA
    7f3be53 View commit details
    Browse the repository at this point in the history
  13. Configuration menu
    Copy the full SHA
    67d2f8b View commit details
    Browse the repository at this point in the history
  14. pbackup: Support PBACKUP_DB for development

    Add code to override the sqlite database name via environment variable.
    This can help in development, so that code can be tested against a copy
    of a real database as an unpriviledged user while avoiding the risk to
    block the running server or corrupte the backup data.
    donald committed Apr 7, 2025
    Configuration menu
    Copy the full SHA
    c227747 View commit details
    Browse the repository at this point in the history
  15. pbackup: Use SQL to find jobs for FULL

    FULL backups want only jobs without existing stat records. Usually,
    there will be none. Select jobs without stat records by `LEFT JOIN
    stat ON stat_job_id = job_id WHERE stat_job_id IS NULL`.
    
    This reduced the time for test runs to discover that there are no FULL
    jobs to do in an actual database from 2.02 seconds to 0.06 seconds.
    donald committed Apr 7, 2025
    Configuration menu
    Copy the full SHA
    8a1674f View commit details
    Browse the repository at this point in the history
  16. Configuration menu
    Copy the full SHA
    9c5491c View commit details
    Browse the repository at this point in the history
  17. pbackup: Cosmetics

    Space after comma, spaces around other operators, remove some comments
    donald committed Apr 7, 2025
    Configuration menu
    Copy the full SHA
    b187678 View commit details
    Browse the repository at this point in the history
  18. Configuration menu
    Copy the full SHA
    33720b8 View commit details
    Browse the repository at this point in the history
  19. pbackup: Remove dead code

    donald committed Apr 7, 2025
    Configuration menu
    Copy the full SHA
    f044e04 View commit details
    Browse the repository at this point in the history
  20. Configuration menu
    Copy the full SHA
    bc8d7cd View commit details
    Browse the repository at this point in the history
  21. Configuration menu
    Copy the full SHA
    d429bd2 View commit details
    Browse the repository at this point in the history
  22. pbackup: Maintain stat_generation on move

    When we move a run from one volume to another and dedup on the target
    volume, use the smaller (older) generation number of the two source runs
    which are joined, because both can contribute data.
    
    Remove "review" fuse for cmd_move.
    donald committed Apr 7, 2025
    Configuration menu
    Copy the full SHA
    36c398b View commit details
    Browse the repository at this point in the history
  23. Configuration menu
    Copy the full SHA
    e399cb2 View commit details
    Browse the repository at this point in the history

Commits on Apr 18, 2025

  1. Configuration menu
    Copy the full SHA
    415ee8e View commit details
    Browse the repository at this point in the history