Around 2pm PDT there was a power outage in the SOMA neighborhood of San Francisco which affected over 30,000 people in the San Francisco area, as well Six Apart's co-location facilities. This power outage caused downtime in several large networks, including all of Six Apart's services (LiveJournal, Vox, TypePad and Movable Type) and other networks such as Craigslist, Technorati and Yelp. Usually when there are outages (both planned and unplanned) we are able to immediately post a short message to users and site visitors on a status page on LiveJournal, but because this was a full power outage there was a period of time (around 90 minutes) where we could not access or update a status page. We got the status page up as soon as possible, but it was periodically unavailable due to high amounts of traffic accessing the page.
Once power was restored, Six Apart staff began an ordered process of restoring data to each of our sites. This process lasted over a span of several hours, as there is a step-by-step process to bring machines back up and make sure the network is running.
How will Paid members be compensated?
The outage was beyond our control, however we do want to compensate our Paid members for the window of time where the site was not accessible. We have a compensation plan in place and we are working on getting a page up and running with the full details for Paid members to request compensation. We will update this post with information as soon as we have it, and we will cross post to paidmembers as well.
Update: Please see information about the compensation here.
Thankfully, this was a brief outage and not a full internet crash.