Downtime: Data corruption, Round 2

Announcements about major changes in Haven & Hearth.

Re: Downtime: Data corruption, Round 2

Postby abagraba » Mon May 10, 2010 10:45 pm

My entire village disappeared with all my LP invested in it...WTF!!!! Along with my 200 mile road... which is still on the minimap...
abagraba
 
Posts: 51
Joined: Sat Apr 24, 2010 3:44 am

Re: Downtime: Data corruption, Round 2

Postby sabinati » Mon May 10, 2010 11:07 pm

oh no, not the road! :cry:

edit: seriously you should have seen this guy's road
User avatar
sabinati
 
Posts: 15497
Joined: Mon Jul 13, 2009 4:25 am
Location: View active topics

Re: Downtime: Data corruption, Round 2

Postby Gringo » Tue May 11, 2010 2:29 am

loftar wrote:
Granger wrote:Then put some of the donations into a SSD as main disk (to get throughput and IOPS to keep game server served), use LVM snapshots (or ZFS clones or whatever) to freeze a filesystem copy and then rsync it to a normal RAIDed volume for backup (using hardlinks against an old backup will offer multiple generations cheaply).

Well, true enough, there are ways around it. I haven't exerted any efforted for it, however, since I've mainly just kept a backup around for the utmost disaster of a hard drive failure, though. I hadn't expected XFS to regularly corrupt data on power failures. Reasonably, I guess I should switch back to ext3 instead (I used XFS on the new hard drive mainly for its ability to be extended on-line, and because I find it performs rather well).

Unclean shutdown of a filesystem is never a good idea.
Maybe check the mount flags, might be that you disabled something by accident which leads to unrecoverable state when shit happens.

As far as i have seen ext3 with journal is most reliable in case unclean shutdown (UPS with OK battery pack will be send on its way tomorrow, UPS - the mail guys - website tells me it should arrive on friday). Putting a call to sync into cron also helps a bit (but avoiding unclean shutdown should have priority over any workarounds).

My suggestion still is to put some € into an SSD for game data (to get low latency) and cron a niced rsync (with --link-dest option against the last backup, just put something into the script which dumps oldest backup(s) in case space on backup drive starts to run low), maybe even from a temporary snapshot to avoid dupe bugs, to a time where server load is low.

In case you feel that server performance would still suffer from this then put a sign on the website saying every day at x:00 UTC background backup will run so performance will suck - but since you won't suddenly miss your village because of existing current backups (in case the server crashes hard for some reason) you will want to live with that without complaining.


EDIT: shit, wrong account. Greetings from Granger.
Gringo
 
Posts: 9
Joined: Tue Feb 23, 2010 2:14 pm

Re: Downtime: Data corruption, Round 2

Postby Valten21 » Tue May 11, 2010 5:37 am

At least I know where the 30k went, and what happened to the Village claim! Back to the grind? :(
You may have foiled the plans of BAD-EVIL this time, but there is no rest for the wicked.
User avatar
Valten21
 
Posts: 2052
Joined: Thu Feb 25, 2010 7:40 pm
Location: Vancouver, Canada

Re: Downtime: Data corruption, Round 2

Postby jaydee0004 » Tue May 11, 2010 9:42 am

There has something to be done to compensate the LP loss.
User avatar
jaydee0004
 
Posts: 17
Joined: Sun Mar 28, 2010 8:01 am

Re: Downtime: Data corruption, Round 2

Postby Potjeh » Tue May 11, 2010 10:11 am

There's no refunds in H&H, never been, never will be.
Image Bottleneck
User avatar
Potjeh
 
Posts: 11788
Joined: Fri May 29, 2009 4:03 pm

Re: Downtime: Data corruption, Round 2

Postby Haba » Tue May 11, 2010 10:17 am

Potjeh wrote:There's no refunds in H&H, never been, never will be.


You can always ask for a refund. Paying customers and all, right?
User avatar
Haba
 
Posts: 666
Joined: Sun Nov 01, 2009 9:36 pm

Re: Downtime: Data corruption, Round 2

Postby Granger » Tue May 11, 2010 11:03 am

Haba wrote:You can always ask for a refund.

Fixed that for you.
⁎ Mon Mar 22, 2010 ✝ Thu Jan 23, 2020
User avatar
Granger
 
Posts: 9263
Joined: Mon Mar 22, 2010 2:00 pm

Re: Downtime: Data corruption, Round 2

Postby Teme » Tue May 11, 2010 1:51 pm

Crashing returned with data corrup.? :/
Plaah ~Image
User avatar
Teme
 
Posts: 97
Joined: Mon Apr 19, 2010 5:21 pm

Re: Downtime: Data corruption, Round 2

Postby Potjeh » Tue May 11, 2010 3:00 pm

Emphasis on paying. Equi donati dentes non inspiciuntur.
Image Bottleneck
User avatar
Potjeh
 
Posts: 11788
Joined: Fri May 29, 2009 4:03 pm

PreviousNext

Return to Announcements

Who is online

Users browsing this forum: No registered users and 41 guests