Randomville

Randomville! => Main Street => Topic started by: rva on October 08, 2006, 01:18:54 AM

Title: Server issues
Post by: rva on October 08, 2006, 01:18:54 AM
umm.. yeah.  So our webhosts have yet to adequately explain what happened here.  

Supposedly a switch went down which prevented access to the site.  Which is all well and good, except it doesn't explain why we've apparently been reset to August.  There's a hard drive failure somewhere.  A hard drive failure that really should have nothing to do with the other technical problems.

I have a personal restore from I think a week and a half ago, but it's too big for me to upload.  I'm sure they'll be willing to accomodate us with a workaround, but that's still a lot of data lost.  Needless to say, I am royally pissed.
Title: Server issues
Post by: Bronzetree on October 08, 2006, 02:09:30 AM
Wow. Fuxx0red doesn't seem to cover this.

To say I freaked when I got home from work tonight and saw what had happened is an understatement...
Title: Re: Server issues
Post by: Rafe on October 08, 2006, 11:08:41 AM
Quote from: "rva"
Needless to say, I am royally pissed.

I don't blame you! It must be a right bugger after all the hard work you lot constantly put into both the site and the 'zine content. Good luck on getting things sorted out.
Title: Server issues
Post by: frizgolf on October 08, 2006, 11:37:53 AM
Serious WTFage...
Title: Server issues
Post by: rva on October 08, 2006, 12:15:21 PM
Yeah, and this is where I get into a pissing contest with the webhosts.

They will say it's my responsibility to backup the data and therefore any data lost is my fault.  I will point out that a hard drive failure is their responsibility, since I do kind of pay them to store my data.
Title: Server issues
Post by: Nate on October 08, 2006, 02:07:15 PM
El sucko, indeed.
Title: Server issues
Post by: cuddlyevil on October 08, 2006, 02:20:08 PM
I was wondering why I couldn't log on yesterday.
Title: Server issues
Post by: whigsgeek on October 08, 2006, 02:42:48 PM
Hang in there, rva. I can't help much with the actual technical work, but if you need a hand making calls to get the issue resolved, I'm happy to pitch in.
Title: Server issues
Post by: sg7 on October 08, 2006, 02:47:53 PM
that really sucks! i'm sorry you guys have to go through such annoyances to get things working again. and i'm sad that i'm back to being a tourist, but oh well.

is there any way to recover all that data or is it lost completely? more than anything, what a loss for the zine. :(
Title: Server issues
Post by: rva on October 08, 2006, 02:56:19 PM
Worst case scenario is we will get set back to September 21, which will come from my personal backups.  A bit hard to believe they haven't backed up their drives since August.

So the hit on the webzine shouldn't be *too* bad.  We're going to lose all the torturethon threads though, unless I can restore them from google's cache or something.
Title: Server issues
Post by: Bronzetree on October 08, 2006, 04:02:44 PM
Knowing that we lost some pretty awesome articles from the last two months, I would be glad to place a tersely worded phone call to the appropriate person. I hope like hell we can recover the MPMF stuff...
Title: Server issues
Post by: sg7 on October 08, 2006, 05:23:45 PM
Quote from: "rva"
Worst case scenario is we will get set back to September 21, which will come from my personal backups.  A bit hard to believe they haven't backed up their drives since August.

So the hit on the webzine shouldn't be *too* bad.  We're going to lose all the torturethon threads though, unless I can restore them from google's cache or something.


well, it's good to know there's at least something a bit more recent to be restored possibly.

that really sucks. i'm sorry, rva and wherle. :(
Title: Server issues
Post by: foolsgold on October 08, 2006, 07:09:51 PM
Quote from: "rva"
We're going to lose all the torturethon threads though,


Not a problem.  Just have Butter, CR, Ella, Trixi, KC and Dan (it seems like I am forgetting someone) just do their 8+ hours again.  If they were any kind of teamplayers, that shouldn't be a problem.  ;)

This does really suck.  I hope you guys can somehow recover the lost stuff.
Title: Server issues
Post by: c-lando on October 09, 2006, 09:33:09 AM
ACK!!!!!!

Thanks for the update. Sorry for the suckage.
Title: Server issues
Post by: rva on October 09, 2006, 09:54:17 AM
Don't post anything on the forum that you don't want to lose.  When hostbaby finally gets off their lazy ass, they're going to overwrite the DB with my backup so all this will be gone.  Or maybe they'll just sit around and continue to do jackshit.
Title: Server issues
Post by: Butter on October 09, 2006, 09:57:28 AM
I've always secretly hated you all.

..



Thank goodness they're going to overwrite all this very shortly.
Title: Server issues
Post by: Kwyjibo on October 09, 2006, 10:13:34 AM
I'm secretly in love with Buttman...

There... I said it.
Title: Server issues
Post by: Content Chick on October 09, 2006, 11:27:09 AM
Now I got that stupid Cher song "If I Could Turn Back Time" stuck in my head.
Title: Server issues
Post by: Atzend on October 09, 2006, 11:50:31 AM
Quote from: "Content Chick"
Now I got that stupid Cher song "If I Could Turn Back Time" stuck in my head.


If I ever decide to do the Torturethon that would be the song.
Title: Server issues
Post by: Juliana on October 09, 2006, 12:31:50 PM
Hmm.

We were out all weekend, so this is the first I've seen of anything.
Sorry this happened. If you need anybody roughed up RVA, let me know
Title: Server issues
Post by: Juliana on October 09, 2006, 01:29:12 PM
Did you try that one website that archives other sites?
I forget the name of it.  Kwyj, what's the name of it?

Maybe there will be something since this last backup?
Title: Server issues
Post by: Kwyjibo on October 09, 2006, 01:48:04 PM
Archive.org is what Juliana is talking about.  I doubt it would have all of the message boards stuff... much less in a usable format.

And it appears they haven't archived Randomville since February of '05.
Title: Server issues
Post by: berzerker on October 09, 2006, 02:13:23 PM
Fucky McFuckerson... well, at least I have copies of the articles I've sent to the 'zine... hopefully others do too. I don't think I submitted anyhting after the 21st of Sept, anyway.

Damn, yo. Tards.
Title: Server issues
Post by: Kwyjibo on October 09, 2006, 02:30:05 PM
God!  I hope we didn't lose the fictionarium piece.

Oh yeah, it never got posted.
Title: Server issues
Post by: Rafe on October 09, 2006, 02:56:03 PM
Quote from: "Kwyjibo"
God!  I hope we didn't lose the fictionarium piece.

Oh yeah, it never got posted.

There was one chapter left to write as I recall. Still, you can't really blame Lunarbee for that, eh? She's made a pretty big life change recently, hasn't she? I hope she's doing well up in Pennsylvania, or however you spell it.
Title: Server issues
Post by: Kwyjibo on October 09, 2006, 03:44:44 PM
I don't remember blaming anyone.
Title: Server issues
Post by: Rafe on October 09, 2006, 04:09:31 PM
I know. I read your post and thought that you were being a bit funny about the fictionarium thing not being posted.
Title: Server issues
Post by: Kwyjibo on October 09, 2006, 04:37:02 PM
It just kind of drives me crazy that it never got posted, but I wasn't pointing any fingers.  It's been a year at least by now, any number of things could have transpired to get it done, but nothing gets done with it and mostly when I bring it up I get ignored or somebody says they can write the last piece but it doesn't happen.  It's just frustrating so I vent once in a while.  It wouldn't have gotten as far as it did to begin with if I'd been running the thing, and I've never said any different.

Anyway, I was just kidding around, not trying to be a dick.
Title: Server issues
Post by: scurvygirl on October 09, 2006, 05:37:46 PM
The current status on the fictionarium is that my bf hasn't finished the last chapter because he's been slammed at work.  He told me he has the ending figured out, he just needs to find the time to write it.  I should probably work on distracting him less with certain stuff.
Title: Server issues
Post by: Ella Minnow Pea on October 09, 2006, 07:36:45 PM
So is this where we're thankful for the googlebots? Should we go out and capture any content we specifically want to save from the Google caches before it's deleted?
Title: Server issues
Post by: Bronzetree on October 09, 2006, 07:40:09 PM
Yes. I'm working on that myself with some articles, just in case.

I stopped saving new stories to my hard drive - including my own - because it was starting to take up a ton of room. From now on, I'll be saving everything and backing them up on discs monthly.
Title: Server issues
Post by: Cockney Rebel on October 09, 2006, 10:43:14 PM
I hope we get our shit back. I hate the fact that all the torturethon laughs may have disappeared into the ether somewhere. Trixi's was hysterical. I think it was the "clap clap, stomp, stomp, stomp" thing?

Plus, I will never remember what films I have seen or CDs I have bought without the full "50 for 2006" threads!

Good luck with the rebuild W
Title: Server issues
Post by: Ella Minnow Pea on October 09, 2006, 11:05:55 PM
I just grabbed the last pages of the 50 for 2006 (and 17) from my browser cache, in case we need them, too.
Title: Server issues
Post by: Nate on October 10, 2006, 12:03:11 AM
Score!  You guys rule.
Title: Server issues
Post by: Bronzetree on October 10, 2006, 10:02:12 AM
If you check the webzine, you'll see that we've been restored up through 10/4. Not sure how the hostbaby folks did it, as we only had a backup through 9/21, but they did it, which is what counts. I don't think they can do anything about the message boards, unfortunately. :(

We'll have to see if Ella's saves can be reposted somehow.
Title: Server issues
Post by: JohnnyRoyale on October 10, 2006, 10:19:29 AM
Phew!
Title: Server issues
Post by: rva on October 10, 2006, 10:29:48 AM
Okay, here's the status and where we go from here:

The Hostbaby folks were able to partially restore the messageboard database.  And by "partially" I mean we have maybe an extra 200 posts since August 19, including none of the torturethon stuff.  

They put that on a separate set of tables and separate working messageboard, which I don't think we'll use.  The backup couldn't be fully restored so while there is some extra content, some usernames and thread topics have been lost.  

What I'm going to do is comb through that other set of tables and try to merge the data into this one.  It's going to take me awhile to do this, and frankly I may just do it for a few threads because it's a lot of work.  If we'd had the torturethon stuff, it would have been different.  Anyway, those extra posts should be restored sometime in the next couple weeks just in time for them not to be relevant anymore.

So we're just going to go ahead and roll with what we have on the boards for now.  Everyone can go ahead and post as usual; we won't be overwriting anything.  I'll set up another torturethon folder.
Oh, and it looks like the Art forum and subforums were preserved so we'll have those up in the next day or so avec content.

There's really nothing anyone can do about this.  The data is just gone and Hostbaby can't get it back.  If we're lucky, they may at some point be able to restore their dead drive, or at least rescue the data off of it.  But at this point they're still in crisis managament and trying to get everyone restored.

Also, the user table was wiped out so anyone who registered after August 19 is going to have to re-register.
Title: Server issues
Post by: whigsgeek on October 10, 2006, 10:34:47 AM
Thanks for all of the time and work you've put into this, W.  =D>
Title: Server issues
Post by: Bronzetree on October 10, 2006, 10:37:29 AM
Yeah, W, thanks a ton, man. I don't know how to thank you enough.
Title: Server issues
Post by: rva on October 10, 2006, 10:40:11 AM
I forgot.  Yeah, everyone check your personal caches (or google cache if you know how) and send me what you have from the torturethon.  wpai-at-randomville.com
Title: Server issues
Post by: Kwyjibo on October 10, 2006, 10:55:13 AM
I have no idea how to go about that, but if you tell me I'll gladly do it.
Title: Server issues
Post by: Ella Minnow Pea on October 10, 2006, 11:04:37 AM
What I did was switch to "Work Offline". I then opened up the history window and clicked on each of the randomville pages until I found one that was still in the cache - and therefore displayed. I did a save (complete web page) to my hard drive.
Title: Server issues
Post by: rva on October 10, 2006, 11:09:30 AM
Another thing you can try is just do a google search for something like "randomville If I had 100000 torturethon" or something.  Hostbaby has actually blocked google from crawling our pages temporarily so that the cache will be preserved.
Title: Server issues
Post by: Bronzetree on October 10, 2006, 11:33:47 AM
I nabbed a bunch of articles from Google's cache, but couldn't get any threads or torturethon stuff. Sounds like ella might have much of that, though. How do we go about reposting it?
Title: Server issues
Post by: rva on October 10, 2006, 11:43:33 AM
Just send me the pages.  I'll have to restore them post by post.  Like if you hover over the "posted" icon it has a link that ends with 90930.  So I know that's message 90930.  Then if I hover over your user id, there's a link that ends in 12.  So I know you're user 12.

So yeah, I go to the database and post the content in the content field, the user_id in the user_id field, etc.  And then hope it does some updating of the related tables on it's own (eg. postcount), otherwise I go to those tables and update them by hand.

I might be able to write a clever script that scrapes the info we need off the page and creates a SQL statement from it, but the amount of time it'd take for me to write that probably equals the amount of time it takes just to do it the hard way.  So basically, it's pretty much not going to be worth the effort except for the toturethon threads.
Title: Server issues
Post by: Ella Minnow Pea on October 10, 2006, 12:12:25 PM
If you need me to parse out the files I saved and sent you, let me know. Manipulating data is fun! (Yes, I am a geek.)
Title: Server issues
Post by: rva on October 10, 2006, 12:43:15 PM
Well, if you could send me the threads as an Excel table or some kind of delimited text file that'd be awesome.... but don't do it if it's too much work.

The columns I need would be:

post id, post time, user_id, post subject (almost always blank), and post_content.
Title: Server issues
Post by: Ella Minnow Pea on October 10, 2006, 01:05:14 PM
Since I'm not at work today, it would be more fun than cleaning house, which is what I'm supposed to be doing. I'll tackle the Torturethon threads first.
Title: Server issues
Post by: berzerker on October 10, 2006, 02:57:03 PM
Great gravy, W. That sounds like hella painstaking. Thanks for doing that, and keeping us updated... and thanks for the assist, lmnop! =D>
Title: Server issues
Post by: MissKitty on October 10, 2006, 09:56:57 PM
W, you rule.

Kudos for dealing with all of this crap.

{{hugs}}
Title: Server issues
Post by: Bronzetree on October 10, 2006, 10:15:02 PM
You are the man. That is all.
Title: Server issues
Post by: Nate on October 10, 2006, 11:09:09 PM
I concur with those statements above.
Title: Server issues
Post by: rva on October 10, 2006, 11:12:38 PM
Quote from: "sg7"
that really sucks! i'm sorry you guys have to go through such annoyances to get things working again. and i'm sad that i'm back to being a tourist, but oh well.


Everyone's post counts are a bit off now.  Obviously the lost posts won't count, but neither will the ones that were restored.  Sorry.  :(

But I did set you back to "summer resident" status.
Title: Server issues
Post by: trixi on October 11, 2006, 12:02:57 AM
RVA, you're great!  Thanks for all your effort in trying to get everything back!
Title: Server issues
Post by: rva on October 11, 2006, 12:16:04 AM
Thanks. everyone.

We got about 500 posts back today from the personal backup I had.  Not what y'all were hoping for, I know.  But still, some people got their birthday threads back and their CD and film counts updated a little bit.
Title: Server issues
Post by: Cockney Rebel on October 11, 2006, 01:07:14 AM
RVA, once again you are, indeed, the dog's bollocks.

Thanks for all your time and effort on this. An exacto knife to to the scrote of whomever was responsible at ProbstBaby - or whatever the hosts are called - but immediate hospital care in view of their new pricing offer
Title: Server issues
Post by: JohnnyRoyale on October 11, 2006, 01:10:39 AM
Yeah, thanks Wendell
Title: Server issues
Post by: rva on October 12, 2006, 03:03:07 AM
A big thank you to Ella Minnow Pea for sending us her personal cache of randomville files!

That's about another 500 posts we got back, including several torturethon threads in their entireity.
Title: Server issues
Post by: kcneon on October 12, 2006, 09:41:32 AM
Ella rocks!  So do you, RVA - thanks for all the hard work.   =D>
Title: Server issues
Post by: Bronzetree on October 12, 2006, 09:53:20 AM
I second that. Awesome work on both your parts. Thanks!
Title: Server issues
Post by: Dan on October 12, 2006, 12:08:27 PM
Awesome work.  
FWIW: I have not logged onto r'ville from my home computer since Friday night...thus I could try to do something useful tonight through the cache's and stuff.  Let me know what you'd like me to look for.... and remember that this is something I"ve never done before, so feel free to treat me like I'm dumb.  I mean...other than the normal dumbness.
Title: Server issues
Post by: Ella Minnow Pea on October 12, 2006, 12:33:59 PM
I didn't get Butter or CR's torturethon threads, so that could be something you check. Once starting your browser, immediately select Work Offline. Open up the History panel (under View -> Explorer Bar in IE and under Go in Firefox). If you find a Randomville page that has been saved in your cache, do a save and make sure you select web page complete. Be sure you don't go back online until you've saved everything.

Once I found all I had, I created a zip file with the pages and corresponding directories to send to rva. He took it from there.
Title: Server issues
Post by: clemsonfan on October 12, 2006, 12:48:12 PM
I have pages 3 & 4 of Butter's torturethon saved now. I'll see what else I can retrieve.
Title: Server issues
Post by: Dan on October 12, 2006, 12:48:48 PM
Thanks. Yeah, I'm on Firefox. I'll look tonight...late tonight...or tomorrow. But I won't go to rville on that computer until I've looked through.  If anyone else wants me to look for something, just let me know.
Title: Server issues
Post by: clemsonfan on October 12, 2006, 12:58:27 PM
Ok, it looks like I have some of Butter's and pretty much all of CR's torturethon saved and also the signups thread. Now what should I do?
Title: Server issues
Post by: Buzzstein on October 12, 2006, 05:07:52 PM
OK I haven't cleared my history in forever so I'll see what I have.
Title: Server issues
Post by: Buzzstein on October 12, 2006, 07:22:03 PM
OK, I don't think this is working.  Should it display the cached web page in my browser when I click on it?  All I get is a gray page saying "Firefox is currently in off-line mode and can't browse the Web."  Also, when I open a page I saved it doesn't display properly either.
Title: Server issues
Post by: sg7 on October 12, 2006, 07:23:42 PM
Quote from: "rva"
Quote from: "sg7"
that really sucks! i'm sorry you guys have to go through such annoyances to get things working again. and i'm sad that i'm back to being a tourist, but oh well.


Everyone's post counts are a bit off now.  Obviously the lost posts won't count, but neither will the ones that were restored.  Sorry.  :(

But I did set you back to "summer resident" status.


yeah, i know it affects everyone, which sucks. all those lost posts! :(

thank you so much for working on the issues and for setting me back! you are the awesome!!!
Title: Server issues
Post by: Dan on October 12, 2006, 09:47:46 PM
unfortunately, I spent a solid fifteen minutes looking through my firefox and couldn't find anything that looked like a website saved in the cache. Maybe I have a setting set up to not do that.  It made me sad, but alas, I couldnt' figure it out.
Sorry...
Title: Server issues
Post by: Ella Minnow Pea on October 12, 2006, 11:50:04 PM
Quote from: "Buzzstein"
OK, I don't think this is working.  Should it display the cached web page in my browser when I click on it?  All I get is a gray page saying "Firefox is currently in off-line mode and can't browse the Web."  Also, when I open a page I saved it doesn't display properly either.

The gray page means the file has been deleted from your cache. Mine was set to only keep 50 MB, so I didn't have many pages left. Luckily, Randomville was one of the last places I had visited on my laptop.
Title: Server issues
Post by: rva on October 13, 2006, 12:34:31 AM
I got some more stuff from clemsonfan today (so everyone thank her!).

I'm still sorting through it, but we did get a lot of missing pages from CR's torment.
There's also some stuff from butter's endeavors, though not all of it.  All in all, I'd say the torturethon forum is maybe 85-90% recovered.
Title: Server issues
Post by: whigsgeek on October 13, 2006, 10:26:45 AM
Thanks, CF, and everyone else who has been able to help us piece the content back together!
Title: Server issues
Post by: clemsonfan on October 13, 2006, 10:59:14 AM
Not a problem!
Title: Server issues
Post by: Bronzetree on October 13, 2006, 11:07:40 AM
Quote from: "Dan"
unfortunately, I spent a solid fifteen minutes looking through my firefox and couldn't find anything that looked like a website saved in the cache. Maybe I have a setting set up to not do that.  It made me sad, but alas, I couldnt' figure it out.
Sorry...


Yeah, I've got Firefox set to delete everything upon exit but the cookies I've chosen to accept. Glad a few people aren't nearly as paranoid as I, or we wouldn't have gotten back what we did.

Thanks to everyone who spent time on this for us. MUCH appreciated.