Welcome! » Log In » Create A New Profile

Enhancement request: other compression methods

Posted by Yves Bellefeuille 
Yves Bellefeuille
Enhancement request: other compression methods
August 26, 2017 12:59PM
I'm not sure how useful it would be to suggest enhancements, but here's
mine.

rdiff-backup uses gzip for compression. With modern multi-core
processors, that's not efficient. I'd like to suggest an option to use
other compression programs, for example bzip2 or xz, or even multi-
threaded compressions programs, such as pbzip2 or pxz.

As I understand it, pigz ( https://zlib.net/pigz/ ) is fully backward-
compatible with gzip, so perhaps that would be the easiest solution.

--
Yves Bellefeuille <yan@storm.ca>
GPG key 837A6134 at http://members.storm.ca/~yan/pgp.asc

_______________________________________________
rdiff-backup-users mailing list at rdiff-backup-users@nongnu.org
https://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki
This message was imported via the External PhorumMail Module
Mr. Clif
Re: Enhancement request: other compression methods
February 05, 2018 10:59AM
+1 here,

by the way, it's highly desirable if your compression algorithm keeps
changes localized so rsync can efficiently just transfer the
differences. Right now gzip, and it's multi-threaded version pigz are
the only compression utilities that provides this "--rsyncable" option.
The others tend to change every block coming after the first difference.

    Clif

On 08/26/2017 12:23 PM, Yves Bellefeuille wrote:
> I'm not sure how useful it would be to suggest enhancements, but here's
> mine.
>
> rdiff-backup uses gzip for compression. With modern multi-core
> processors, that's not efficient. I'd like to suggest an option to use
> other compression programs, for example bzip2 or xz, or even multi-
> threaded compressions programs, such as pbzip2 or pxz.
>
> As I understand it, pigz ( https://zlib.net/pigz/ ) is fully backward-
> compatible with gzip, so perhaps that would be the easiest solution.
>


_______________________________________________
rdiff-backup-users mailing list at rdiff-backup-users@nongnu.org
https://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki
This message was imported via the External PhorumMail Module
Sorry, only registered users may post in this forum.

Click here to login