Backup Central

I have several large file systems (>1TB) where I want to break them up to get smaller backup streams in parallel to increase the throughput to tape. My fileset directive is below. I want everything in /home, but divided by the regular expressions provided in the Options section. Will this do what I want or will I only get one backup stream?

FileSet {
Name = "homedirs2 Set"
Include {
Options {
signature = MD5
RegexDir = "^/home/[0-9]*"
RegexDir = "^/home/[a-e]*"
RegexDir = "^/home/[f-j]*"
RegexDir = "^/home/[k-o]*"
RegexDir = "^/home/[p-t]*"
RegexDir = "^/home/[u-z]*"
RegexDir = "^/home/[A-Z]*"
}
File = /home
}
#
Exclude {
File = /proc
File = /tmp
File = /.journal
File = /.fsck
File = lost+found
}
}


Patti Clark
Information International Associates, Inc.
Linux Administrator and subcontractor to:
Research and Development Systems Support Oak Ridge National Laboratory


------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Bacula-users mailing list
Bacula-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

On Tue, Jun 12, 2012 at 03:31:12PM -0400, Clark, Patricia A. wrote:
I have several large file systems (>1TB) where I want to break them up to get smaller backup streams in parallel to increase the throughput to tape. My fileset directive is below. I want everything in /home, but divided by the regular expressions provided in the Options section. Will this do what I want or will I only get one backup stream?

FileSet {
Name = "homedirs2 Set"
Include {
Options {
signature = MD5
RegexDir = "^/home/[0-9]*"
RegexDir = "^/home/[a-e]*"
RegexDir = "^/home/[f-j]*"
RegexDir = "^/home/[k-o]*"
RegexDir = "^/home/[p-t]*"
RegexDir = "^/home/[u-z]*"
RegexDir = "^/home/[A-Z]*"
}
File = /home
}
#
Exclude {
File = /proc
File = /tmp
File = /.journal
File = /.fsck
File = lost+found

Hello Patti,

my current understanding is that in order to get multiple streams from
a single client running in parallel, you'll need to split your fileset
into several "Job" type directives.

Also remember to include the maximum concurrent jobs parameter for the
client in question.

HTH,

Uwe

------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Bacula-users mailing list
Bacula-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

On Tue, Jun 12, 2012 at 3:31 PM, Clark, Patricia A. <clarkpa < at > ornl.gov> wrote:
I have several large file systems (>1TB) where I want to break them up to get smaller backup streams in parallel to increase the throughput to tape.  My fileset directive is below.  I want everything in /home, but divided by the regular expressions provided in the Options section.  Will this do what I want or will I only get one backup stream?

FileSet {
 Name = "homedirs2 Set"
 Include {
   Options {
     signature = MD5
     RegexDir = "^/home/[0-9]*"
     RegexDir = "^/home/[a-e]*"
     RegexDir = "^/home/[f-j]*"
     RegexDir = "^/home/[k-o]*"
     RegexDir = "^/home/[p-t]*"
     RegexDir = "^/home/[u-z]*"
     RegexDir = "^/home/[A-Z]*"
   }
   File = /home
 }
#
 Exclude {
   File = /proc
   File = /tmp
   File = /.journal
   File = /.fsck
   File = lost+found
 }
}


You want to run X jobs with X different filesets. The config above
will certainly not accomplish that. It will just be 1 job and 1
fileset. Also you will need to enable concurrency and have multiple
storage devices since a single storage device can load only 1 volume
at a time. Think of each disk storage devices as a single tape drive
with all the abilities and restrictions.

John

------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Bacula-users mailing list
Bacula-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Hi,

-----Ursprüngliche Nachricht-----
Von: Clark, Patricia A. [mailto:clarkpa < at > ornl.gov]
Gesendet: Dienstag, 12. Juni 2012 21:31
An: bacula-users < at > lists.sourceforge.net
Betreff: [Bacula-users] Getting multiple streams for a large file system

I have several large file systems (>1TB) where I want to break them up
to get smaller backup streams in parallel to increase the throughput to
tape. My fileset directive is below. I want everything in /home, but
divided by the regular expressions provided in the Options section.
Will this do what I want or will I only get one backup stream?

This will not do what you want. You need to specify separate filesets and jobs and specify a suitable maximum concurrent jobs on the daemons configs.


FileSet {
Name = "homedirs2 Set"
Include {
Options {
signature = MD5
RegexDir = "^/home/[0-9]*"
RegexDir = "^/home/[a-e]*"
RegexDir = "^/home/[f-j]*"
RegexDir = "^/home/[k-o]*"
RegexDir = "^/home/[p-t]*"
RegexDir = "^/home/[u-z]*"
RegexDir = "^/home/[A-Z]*"
}
File = /home
}
#
Exclude {
File = /proc
File = /tmp
File = /.journal
File = /.fsck
File = lost+found
}
}


Kind regards

Julian


Patti Clark
Information International Associates, Inc.
Linux Administrator and subcontractor to:
Research and Development Systems Support Oak Ridge National Laboratory


------------------------------------------------------------------------
------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond.
Discussions
will include endpoint security, mobile security and the latest in
malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Bacula-users mailing list
Bacula-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Bacula-users mailing list
Bacula-users < at > lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users