if you look at my zpool list above you can see my dedup at 19x and usage at 1.04 which effectively means Im getting 19TB in 1TB worth of space. my servers have relatively few files that change and the large files get appended to so I really only store the changes.
snapshots are almost instant and can be browsed at /storage/host1/.zfs/snapshot/ and are labeled by the @`date xxx` so i get folders for the dates. these are read only snapshots and can be shared via samba or nfs.
zfs list -t snapshot
opensolaris:/storage/host1/.zfs/snapshot# zfs list -t snapshot
NAME
rpool/ROOT/opensolaris@install 270M - 3.26G -
storage/
[email protected]
zfs set sharesmb=on storage/
[email protected]-or-
zfs set sharenfs=on storage/
[email protected]if you dont want to go pure opensolaris then look at nexenta. it is a functional opensolaris-debian/ubuntu hybrid with ZFS and it has dedup. it does not currently share via iscsi so keep that in mind. I believe it also uses a full samba package for samba shares while opensolaris can use the native CIFS server which is faster than samba.
opensolaris can also join Active Directory. You also need to extend your AD schema. If you do you can give a priviliged use UID and GUI mappings in AD and then you can access the windows1/C$ shares. I would create a backup user and add them to restricted groups in GP to be local administrators on the machines (but not domain admins). You would probably want to figure out how to do a VSS and rsync that over instead of the active filesystem because you will get tons of file locals if you dont.
good luck
On Fri, Feb 19, 2010 at 6:51 AM, Les Mikesell
<lesmikesell AT gmail DOT com> wrote:
Ralf Gross wrote:
>
> I think I've to look for a different solution, I just can't imagine a
> pool with > 10 TB.
Backuppc's usual scaling issues are with the number of files/links more than
total size, so the problems may be different when you work with huge files. I
thought someone had posted here about using nfs with a common archive and
several servers running the backups but I've forgotten the details about how he
avoided conflicts and managed it. Maybe this would be the place to look at
opensolaris with zfs's new block-level de-dup and a simpler rsync copy.