Teamwork server selective backup

[Anonymous]

Hello

Just configured our BIMserver to backup everything daily. Seems to work nicely.

I just wonder is there any way to backup just those projects/libraries that have changed since last backup? Now when full backups are made daily, Time Machine of course thinks that they are all new. But for example libraries doesn't really change. This makes alot of extra backup data, which won't be needed. So is there any way to exclude libraries or projects with no changes with ServerBackupTooll?

[Anonymous]

I do the backup during the day and take the disks home for that reason.

We briefly looked at Online storage, but due to the amount of data we create I didn't think it would be suitable. We do not have a leased broadband line and our upload speed is only 318kbps!

I guess you don't have any issues?

[Anonymous]

Our upload speed test is 5000kbs and downloads on the local speed test server are 75000kbs. Online Storage is about $1 per Gb per year these days. About the only good thing going for cloud atm. I've started archiving on line. I have a bunch of floppy disks, tapes, zip drives, etc that cannot be read. Lol, soon the same will go for cd and DVD.... blue ray will never really take off if online storage becomes accepted.

Gaz

[Anonymous]

Not sure if have got my calculations correct, but to back up the data the BimServerBackupTool creates to 'the cloud' (currently 27Gig) would take 23.5hours @ 318kbps!

[Anonymous]

OFF SITE BACKUP
Yeah. It's important to remember that your off site storage is basically to recover from a fire or theft. You'll have no office or office equipment.... so you'll not be up and running in an instant.

Your upload speeds are not so good. Can you have a look at that first? I once archived 80+Gb of old project records online on sugarsync which took over a day.. but that was because Sugarsync is not exactly fast and neither is the download speed from their server. Not that download speed would worry you so much as you'd be busy putting out the fire and finding alternative office accommodation.

Do you really have 27Gb in your BIMSERVERBACKUP target folder? You would need to archive all your completed projects so you aren't uploading those every night. On top of the the actual project files the BIM server backup folder only consumes 70KB. My backup folder contains 1Gb of data which, at your upload speed would take about an hour.

Alternatively, Sugarsync is a "smart update" process. Once synced for the first time, only files that change are uploaded.
Perhaps you could sync off site:
/BIM Server/TeamworkMessagingServer/conf
/BIM Server/TeamworkServer/Config
/Graphisoft/BIM Server/TeamworkServer/Attachments
/Graphisoft/BIM Server/TeamworkServer/Projects

These components require a cold backup to be effectively reintroduced, which sugarsync does not provide. At worst, you could readily salvage the last working project backup file.

CLONE YOUR BIM SERVER HARD DRIVE
If your hardware fails and needs to go into the shop for repairs, you can boot another machine from your clone (an external drive) and keep working. Basically zero downtime.

INCREMENTAL BACKUPS
The Bim server does incremental backups. This might be enough for you. If you need to go back a few weeks and return to an old idea you'll need to have an archive of it. You can do that by generating a pln file at the time you decide to change things, or you can use an automatic incremental backup. In a MAC, time machine generates these automatically. I can go back a month or more, choose the relevant BIM server generated project backup file and restore it. On a PC, you would need to set up a son, Father, grandfather style backup routine and run it automatically. those backups need only be stored on site on an external drive.

[Anonymous]

Oh... archiving old projects... archive them to the cloud for 10 years. They're safe there and you can even bill your client an archiving fee just like a lawyer does.
Gaz

[Anonymous]

26.8GB to be exact! 24GB approx in current projects, so archiving won't make that much difference.

If I understand you correctly, I'm not sure backing up new and used files using Sugarsync will help, the BimServerBackupTool is the only way to restore BimData (providing Graphisoft get their finger out and actually make it work!). What would be better is if the BSBUT backed up just new and changed files.

I'm reasonably IT literate but I'm not 100% sure I could stick a cloned HD into a fresh machine and it will work, maybe someone could advise.

With regard BimServer auto backups, we have never been able to restore these, maybe because of the size of the projects? So I will not be relying on these.

I think Graphisoft have some work to do on this MAJOR ISSUE, what also worries me (I don't know why it should) is that other users are plodding on backing up Bim data, not aware that it's useless and those who are using the BSBUT don't realise that it is not a reliable way to restore data.

[Anonymous]

csparchitects wrote:
If I understand you correctly, I'm not sure backing up new and used files using Sugarsync will help, the BimServerBackupTool is the only way to restore BimData (providing Graphisoft get their finger out and actually make it work!). What would be better is if the BSBUT backed up just new and changed files.

You seem to have a lot of projects on one BIM server. I would have split that up on a team basis if possible, if only so as to reduce the risk of the whole office going down because of one PC with a cracked motherboard.

From Sugarsync project file backup, I set up a new BIM server on a different Mac and successfully attempted and restored 4 projects using the "Restore Project Database on a different server" method described here:
http://www.archicadwiki.com/Teamwork/HowToRecoverLostProjects?highlight=%28Teamwork%2FTeamworkMultiB...
That process does not involve the BSBUT.

Those bim server automatic incremental backups also work for me and I don't know why they aren't working for you.

I agree there's improvements that have to be made. The trick is to get everything to backup simply and automatically to cover all your bases... The one reason I do not like the BSBUT is that I don't like scripting... But cloning the hard drive on which the server resides is simple and intuitive. You should give it a spin.... the software I mentioned for PC is free... and you can take the external drive home with you.... I assume you now have two of these and rotate them so that one is always off site? The external drives are simply plugged in.. you could use eSATA drives for instance.

[Anonymous]

I didn't know you could recover lost projects that way!! thanks Gaz, our support agent didn't tell me this! I'm going to try it later today.

If it works for me, this could solve lots of issues.

I am using SyncToy at the moment to back up our data, which seems to work nicely. I run the BSBUT on an evening, which is backed up the following day. I know we will lose a days worth of data in the event of a total loss, but I'd be happy enough at that.

All our backups are done late in the afternoon and I take the HD's home, our 'heafty' machine doesn't suffer performance issues when it's doing it. 24GB of RAM and a quad core helps with that!

[Anonymous]

Gaz, its works. You are a star, if you are in York sometime I'll buy you a pint.

[Anonymous]

Thanks. "I'll have half".... always wanted to say that

On the subject of selective backup, The BSBUT backs up your projects, users, roles, categories and BIM library.

If you dont use the tool, or a clone, you can reliably backup BIM server "users", "roles" and "categories" from within the BIM Server Manager... as frequently as you want to.

Ideally, the entire backup and recovery process should be encapsulated in the BIM Server Manager graphic interface.

Our BIM server works well enough across the internet, so the location of the BIM server could itself be located off site (in your home for example.. or a virtual server maintained by someone else) and for self assurance, you can mirror it locally... or vice versa. I think we're headed that way in the near future. It would be nice for Graphisoft to take the initiative.

Gaz