Welcome! » Log In » Create A New Profile

New back-up architecture

Posted by Hylian103 
New back-up architecture
February 22, 2010 09:12AM
Dear people

i'm currently working at a business where they use HP data protector.
i'm a student and needs to design a new back-up architecture.

At our headquarters we have hp dataprotector installed, 4 SAN devices, and a VLS hardware device of HP. HP dataproctector currently assembles the data and sends this to the VLS. the VLS will make a virtual packet and will store this on back-up tapes and on the SAN devices (Redundant).

on other locations accross europe,asia and the us. they have a server installed with ARC Serve with a local tape-unit. there is no IT employee working at these offices because the amount of employees is to few.

The whole idea is to get these back-ups centrilised at the headquarters. the company don't want to change from the software HP dataprotector.

Could anyone here give me some at advise. where to start? do i need to deduplicate data? and is that possible with HP Dataprotector 6.1? what is the best possible architecture for this company? and are there other techonologies that can provide the best solution?

All information is welcome. thanks
New back-up architecture
February 22, 2010 09:20AM
If the remote offices are available through network (I suppose they are), You can simply install HP DP Agents on remote office servers/desktops, and make backups using compression and encryption (in case of public network).

It all depends on how much data would You like to backup from remote locations, your network bandwidth and security. It is common to have VPN connections to remote offices, so You wouldn't have to additionally encrypt the data. Problem with VPNs is the maximum throughput, and QoS (if any) which could reduce backup speeds.

You could setup remote media servers with disk-only storage, and try asynchronic replication to HQ, but it's not exactly HP DP feature.
New back-up architecture
February 22, 2010 09:34AM
[quote]If the remote offices are available through network (I suppose they are), You can simply install HP DP Agents on remote office servers/desktops, and make backups using compression and encryption (in case of public network).

It all depends on how much data would You like to backup from remote locations, your network bandwidth and security. It is common to have VPN connections to remote offices, so You wouldn't have to additionally encrypt the data. Problem with VPNs is the maximum throughput, and QoS (if any) which could reduce backup speeds.

You could setup remote media servers with disk-only storage, and try asynchronic replication to HQ, but it's not exactly HP DP feature.[/quote]

Hey flexray thanks for the quick reply! I still need to research a few things. i'm sitting here for about 2 weeks now.
these are some nice solutions. but the compression your talking about is that the technique deduplication? and that works with the agent HP DP ?the data of the other offices contains user data, word, excel, PST files, you name it. i still need to research that.

unfortunatly they only want to use this HP data protector technology because they are familiar with it.
New back-up architecture
February 22, 2010 09:54AM
Compression isn't deduplication exactly. It reduces data size by means of compression algorithms, deduplication works by reducing number of exactly the same blocks of data.

As I know, compression is built in DP Agents, so is encryption. Didn't see any deduplication though.

Compresion is performed on backed-up server, so the size of data sent through network between remote location and HQ would be reduced, depending on type of data You are backing up.
New back-up architecture
February 22, 2010 10:26AM
[quote]Compression isn't deduplication exactly. It reduces data size by means of compression algorithms, deduplication works by reducing number of exactly the same blocks of data.

As I know, compression is built in DP Agents, so is encryption. Didn't see any deduplication though.

Compresion is performed on backed-up server, so the size of data sent through network between remote location and HQ would be reduced, depending on type of data You are backing up.[/quote]

all right now i get it. i read a blog on the HP site about deduplication. but it not certain if this is also includes the client.

http://www.communities.hp.com/online/blogs/information-faster/archive/2009/03/30/deduplication-options-in-hp-data-protector-6-1.aspx

The agent only compress the packet? but will sent all data accross the line "duplicated". What I need is a solution to deduplicate the data first before it will be sent to the HQ. is this also possible with HP dataprotector?

where have you found the information about these security and compressing clients?
New back-up architecture
February 22, 2010 10:39AM
About compression I suggest Installation Guide,

[quote]When software compression is used and hardware compression is
disabled, the data is compressed by the Disk Agent and sent compressed
to a Media Agent. The compression algorithm can take a substantial
amount of resources from the Disk Agent system if software compression
is used, but this reduces the network load.[/quote]

About deduplication, If you have read carefully, DP doesnt have deduplication exactly, it has Advanced to Disk backup, whichi is fine, and gives You Virtual Full backups based on incrementals. But thats all i know. No real deduplication without using external storage/communication devices supporting deduplication
New back-up architecture
February 22, 2010 11:56AM
[quote]About deduplication, If you have read carefully, DP doesnt have deduplication exactly, it has Advanced to Disk backup, whichi is fine, and gives You Virtual Full backups based on incrementals. But thats all i know. No real deduplication without using external storage/communication devices supporting deduplication[/quote]

Thanks for the imput, I just read another artikel about HP dataprotector in combination with VLS. VLS is capable to perform deduplication processes.

[quote]Key Message: Scalability, Consolidation and Data Centre resilience
In this scenario the volumes of data involved at the regional data centres are significantly high and
the need for scalability paramount. HP’s enterprise level Virtual Tape Libraries (VLS) are therefore
used because in terms of deduplication (the technology enabler for low bandwidth replication) the HP
VLS accelerated deduplication is able to scale much higher in terms of capacity and performance
than the HP Dynamic deduplication used on HP D2D systems.
The ROBO to regional centre solution is the same as in Scenario 2 but instead of local regional data
centre backups being done to D2D because the regional data centre volumes are > 30TB they are
now backed up to a local VLS9000 device. VLS systems also support Low Bandwidth replication and
currently support up to 4 to 1 fan-in, so we can consolidate replications from several regional data
centres in a single VLS9000 device at the main data centre. The VLS9000 uses a multi-node
architecture to ensure scalability in terms of backup performance, deduplication performance and
replication performance. Because of the higher volumes of replicated data involved however the low
bandwidth links for VLS are typically in the area of 100 Mbits/sec upwards. This solution with VLS
allows consolidation at the main data centre, the VLS9000 there is used both as a replication target
for the 4 regional data centres AND for main data centre backups as well, providing a very good
consolidated solution. Deduplication is a licensable feature on the VLS range , and low bandwidth
replication licencing is only required at the target site(one licence per node).
Replicated cartridges from the regional centre arriving at the VLS target in the main data centre send
an Email on an hourly basis to the Data Protector Cell manager at the main data centre. Data
Protector scripts then import these newly replicated tapes into the backup catalog at the main data
centre to allow easy access to replicated data in the event of disaster recovery being necessary for
the regional data centre.
Should it be required for compliance or archiving HP Data Protector Cell manager 1/Media Server at
the main data centre can easily copy any content from the VLS to Physical tape.
A further enhancement to this scenario would be to have Active <-> Active replication where the
main data centre backups to the VLS are also replicated back to the regional data center giving the
main data centre a very cost effective disaster recovery process using existing infrastructure.
Because of the different nature of D2D & VLS deduplication technologies it is not possible for D2D
units to replicate directly into a VLS unit.
The disaster recovery options for the regional data centre using VLS are identical to those used for
D2D namely:-
a) Re-building regional server and restoring data to it at the main data centre using the data
replicated to the main data centre VLS.
b) Rebuilding the server at the regional site and reverse replicating the critical data from the
VLS in the main data centre. Although this will be limited to several TB max, because of the
replication link being the bottleneck to high capacity restores – for reverse replication the
“entire” contents of a virtual tape are reverse replicated.
c) Offloading critical data to physical tape at the main data centre and transporting physical
tapes and associated hardware back to the regional data centre for import and recovery.
Again with the higher volumes of data involved between regional data centres and main data
centers HP expect the usage model for VLS to VLS replication to be predominantly
&#61623; A dedicated replication link – not shared with application traffic
&#61623; 24 Hour replication window available.
VLS replication sizing is also fully supported in the HP StorageWorks sizing Tool
http://www.hp.com/go/storageworks/sizer
The key benefits to the customer of this solution are:-
&#61623; Fast local recovery when needed at both ROBO, regional data centre and Main data centre.
&#61623; Option for ROBO data to be copied to VLS in regional data center for onward replication to
main data centre.
&#61623; Ability to store several months of backups locally at regional data centre and main data
centre using VLS accelerated deduplication - scalable to very high volumes.
&#61623; Cost effective consolidation in the main data centre, up to 4 regional VLS units (fan-in) AND
VLS at main data centre can be used for local main data centre backups as well.
&#61623; Very Flexible Disaster recovery options.
&#61623; Easy offload to tape with HP Data Protector Object copy.
&#61623; HP Data Protector manages the entire process from the main data centre.
&#61623; Main Data centre DR capability if active<->active replication is deployed in the future, using
existing infrastructure.
Summary
The three scenarios described above give an insight into the various ROBO & regional data centre DR
deployments possible using HP storage components:-
&#61623; HP Data Protector product features ( synthetic full backup, Object copy, automated tape
importing etc)
&#61623; HP D2D systems – with Dynamic deduplication as standard and products specifically
designed for the ROBO environment
&#61623; HP VLS systems with Accelerated deduplication specifically designed for the high
performance and high capacity requirements of the enterprise
&#61623; Low bandwidth replication support on D2D & VLS with large fan-in ratio support – changing
the dynamics and costs of “off-site” data protection
&#61623; HP Physical Tape Systems (MSL, EML, ESL) for the ultimate safe repository of data.
&#61623; Single point of control from the main data centre using HP data protector management and
scheduling tools.
Using the wide range of components above allows flexibility and scalability in the variety of ROBO
and data centre backup solutions that can be constructed. With innovative technologies such as
synthetic full functionality, deduplication and low bandwidth replication on VTL products HP is able to
deliver the optimum solution, with optimum performance at the best cost for each specific location,
whilst ensuring central management and control.[/quote]
New back-up architecture
February 22, 2010 01:49PM
[quote]About compression I suggest Installation Guide,

[quote]When software compression is used and hardware compression is
disabled, the data is compressed by the Disk Agent and sent compressed
to a Media Agent. The compression algorithm can take a substantial
amount of resources from the Disk Agent system if software compression
is used, but this reduces the network load.[/quote]

About deduplication, If you have read carefully, DP doesnt have deduplication exactly, it has Advanced to Disk backup, whichi is fine, and gives You Virtual Full backups based on incrementals. But thats all i know. No real deduplication without using external storage/communication devices supporting deduplication[/quote]

By the way! Hp dataprotector does support D2D deduplication functions. and VLS deduplication functions! inline and post-process deduplication.

It could be possible the client support these futures.
New back-up architecture
February 22, 2010 01:54PM
It's not exactly HP DP functionality, but the HP D2D hardware or HP VLS. Many software vendors support hardware deduplication and Virtual Tape Drives.

Yes HP DP Supports them too.
New back-up architecture
February 22, 2010 02:16PM
We have one VLS system in the HQ but not at the other customer centers.
is it possible for the agents to deduplicate te data before being sent? tot the VLS in the HQ
New back-up architecture
February 23, 2010 01:04AM
Hi,

I recommend two options:

include media agents for Dataprotector, in the locations where you don't have IT staff, replacing Arcserve, creating a centralized backup infrastructure
Or
Include a data protector cell manager at locations where you don't have IT staff, replacing Arcserve, the union of dataprotectors can be done by manager or managers (MoM) module. In my view, this is the best approach.

In the web site www.hp.com/go/dataprotector you can find a lot of information.

Regards

Edson

-----Original Message-----
From: data-protector-bounces < at > backupcentral.com [mailto] On Behalf Of Hylian103
Sent: segunda-feira, 22 de fevereiro de 2010 06:12
To: data-protector < at > backupcentral.com
Subject: [DP] New back-up architecture

Dear people

i'm currently working at a business where they use HP data protector.
i'm a student and needs to design a new back-up architecture.

At our headquarters we have hp dataprotector installed, 4 SAN devices, and a VLS hardware device of HP. HP dataproctector currently assembles the data and sends this to the VLS. the VLS will make a virtual packet and will store this on back-up tapes and on the SAN devices (Redundant).

on other locations accross europe,asia and the us. they have a server installed with ARC Serve with a local tape-unit. there is no IT employee working at these offices because the amount of employees is to few.

The whole idea is to get these back-ups centrilised at the headquarters. the company don't want to change from the software HP dataprotector.

Could anyone here give me some at advise. where to start? do i need to deduplicate data? and is that possible with HP Dataprotector 6.1? what is the best possible architecture for this company? and are there other techonologies that can provide the best solution?

All information is welcome. thanks

+----------------------------------------------------------------------
|This was sent by r.derksen < at > student.fontys.nl via Backup Central.
|Forward SPAM to abuse < at > backupcentral.com.
+----------------------------------------------------------------------

_______________________________________________
If you'd like to join the discussion, go to http://www.backupcentral.com and get
a user id. Then subscribe to one or more of our mailing lists or follow the
discussions in one of our forums (http://www.backupcentral.com/phpBB2).

_______________________________________________
If you'd like to join the discussion, go to http://www.backupcentral.com and get
a user id. Then subscribe to one or more of our mailing lists or follow the
discussions in one of our forums (http://www.backupcentral.com/phpBB2).
New back-up architecture
February 23, 2010 10:22AM
[quote]Hi,

I recommend two options:

include media agents for Dataprotector, in the locations where you don't have IT staff, replacing Arcserve, creating a centralized backup infrastructure
Or
Include a data protector cell manager at locations where you don't have IT staff, replacing Arcserve, the union of dataprotectors can be done by manager or managers (MoM) module. In my view, this is the best approach.[/quote]

is it possible to configure the media agents on the different settlements to deduplicate the files before sending it to the HQ's dataprotector?
New back-up architecture
February 23, 2010 10:28AM
To avoid traffic, the data should be storaged locally, using local devices.

But if you want, you can centralize the devices. But note, dedup can be done after or pos backup, in you choose after, the backup windows can be so big..

-----Original Message-----
From: data-protector-bounces < at > backupcentral.com [mailto] On Behalf Of Hylian103
Sent: terça-feira, 23 de fevereiro de 2010 07:23
To: data-protector < at > backupcentral.com
Subject: [DP] New back-up architecture

Edson Silva wrote:
[quote]Hi,

I recommend two options:

include media agents for Dataprotector, in the locations where you don't have IT staff, replacing Arcserve, creating a centralized backup infrastructure
Or
Include a data protector cell manager at locations where you don't have IT staff, replacing Arcserve, the union of dataprotectors can be done by manager or managers (MoM) module. In my view, this is the best approach.
[/quote]

is it possible to configure the media agents on the different settlements to deduplicate the files before sending it to the HQ's dataprotector?

+----------------------------------------------------------------------
|This was sent by r.derksen < at > student.fontys.nl via Backup Central.
|Forward SPAM to abuse < at > backupcentral.com.
+----------------------------------------------------------------------

_______________________________________________
If you'd like to join the discussion, go to http://www.backupcentral.com and get
a user id. Then subscribe to one or more of our mailing lists or follow the
discussions in one of our forums (http://www.backupcentral.com/phpBB2).

_______________________________________________
If you'd like to join the discussion, go to http://www.backupcentral.com and get
a user id. Then subscribe to one or more of our mailing lists or follow the
discussions in one of our forums (http://www.backupcentral.com/phpBB2).
New back-up architecture
February 23, 2010 12:31PM
[quote]To avoid traffic, the data should be storaged locally, using local devices.

But if you want, you can centralize the devices. But note, dedup can be done after or pos backup, in you choose after, the backup windows can be so big..[/quote]

Every settlement has its own file server with user data on it.

it's about the back-ups we need to centralize them. These other settlements are far away. the biggest distance is holland (HQ) tot the USA. we need to back-up these files on these file servers an deduplicate this data before it goes on his way to Holland.

my question. is the media client (HP DP) able to deduplicate these files before it goes throught the internet.? or do I need a VLS device?
New back-up architecture
February 23, 2010 04:37PM
is it possible to use the protocol NDMP? for the solution? encrypting an compressing files? or deduplication?
Sorry, you do not have permission to post/reply in this forum.