SearchFAQMemberlist Log in
Reply to topic Page 1 of 1
Problem FileZIO.pm (Out of memory)
Author Message
Post Problem FileZIO.pm (Out of memory) 
Hi,

I'm making backups from some servers daily, but i have a problem with one server.
The client take up around 50G, but almost all in one directory(49G)

When i try make a backup, this give me an error when trying to copy the directory with 49G
"Out of memory during "large" request .... /usr/...backuppc/.../fileZIO.pm"

What happen?
Maybe could i split several parts? Bad configuration server? i put in loader.conf kern.maxdsiz="2048M" but not luck.

The backup's server is a FreeBSD with 2G RAM with perl version 5.8.9.

Thanks.

View user's profile Send private message
Post Problem FileZIO.pm (Out of memory) 
shalauras writes:

I'm making backups from some servers daily, but i have a problem with one server.
The client take up around 50G, but almost all in one directory(49G)

When i try make a backup, this give me an error when trying to copy the directory with 49G
"Out of memory during "large" request .... /usr/...backuppc/.../fileZIO.pm"

Can you include the full error? Also, what versions of zlib and
Compress::Zlib are you using?

How many files are in this directory?

BackupPC stores all the file attribute information for each directory
in a single file, and it needs to be able to decompress and fit that
information in memory. However, it should only be at most a few 100
bytes per file, so one directory would have to have a huge number of
files for this to be a problem.

Another possibility is that some compressed file is corrupted and
it is causing uncompress to break.

Craig

Post Re: Problem FileZIO.pm (Out of memory) 
shalauras writes:

I'm making backups from some servers daily, but i have a problem with one server.
The client take up around 50G, but almost all in one directory(49G)

When i try make a backup, this give me an error when trying to copy the directory with 49G
"Out of memory during "large" request .... /usr/...backuppc/.../fileZIO.pm"

Can you include the full error? Also, what versions of zlib and
Compress::Zlib are you using?

How many files are in this directory?

BackupPC stores all the file attribute information for each directory
in a single file, and it needs to be able to decompress and fit that
information in memory. However, it should only be at most a few 100
bytes per file, so one directory would have to have a huge number of
files for this to be a problem.

Another possibility is that some compressed file is corrupted and
it is causing uncompress to break.

Craig

Thanks for your answer.

My Compress::Zlib is 2.021.
I have 287 files in that directory, almost all hidden.
Maybe any file with a lot ofs characters???? i had some problems seems with largue names.

Thanks again.

View user's profile Send private message
Display posts from previous:
Reply to topic Page 1 of 1
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
  


Magic SEO URL for phpBB