BARBELITH underground
 

Subcultural engagement for the 21st Century...
Barbelith is a new kind of community (find out more)...
You can login or register.


Archiving material on Barbelith

 
 
Less searchable M0rd4nt
11:59 / 12.01.09
Regardless of whether or not people want the site to stay open, Barbelith is in a rather precarious position at the moment. Just in case the site should happen to go down with no warning, here are some useful tools for people who want to back up material that's important to them.

Unless Tom (or some future domain ownder) should choose to change the site's robot.txt file, you should continue to be able to veiw Barbelith via The Internet Archive's Wayback Machine. Just plug www.barbelith.com into the search field and away you go. (Incidentally, I recommend having a general poke around that sit if you haven't alread--there's a lot of interesting material squirrelled away there).

There are many packages available cheap or free, at least on a trial basis, which will let you download the whole board and save it to disk. Inspyder's Web2Disk is one, SurfOffline is another. I like Firefox's Scrapbook add-on, as this not only allows archiving of threads but is the only solution I've found to the problem of dl'ing private messages. If you've been here for a while and made heavy use of the PM system, you might have a few hundred to a couple thousand and wading through them all manually would be a bit of a nightmare, so this is quite handy.

Anyone got any more helpful links?
 
 
Quantum
14:34 / 12.01.09
Thanks!
 
 
grant
15:11 / 12.01.09
Oh man, I have to use one of those to gank a blog I can't get into any more.

Good tools!

Wasn't there another Wayback-like thing that had Barbelith-of-yore on it?
 
 
Anna de Logardiere
15:17 / 12.01.09
Thanks, that's an extremely sensible suggestion!
 
 
Less searchable M0rd4nt
15:45 / 12.01.09
Wasn't there another Wayback-like thing that had Barbelith-of-yore on it?

If you mean what I think you mean, I believe that was a member's own webspace that was being used to host some old threads. You can go quite a long way back with Wayback as well.
 
 
Spatula Clarke
18:08 / 12.01.09
Twig had some of the old Nexus threads archived - they're still up here, although it's more of a nostalgia trip than anything else.
 
 
Hallo, Paper Spaceboy
20:54 / 12.01.09
I'm curious about that Scrapbook plug-in for Firefox, might look at that tonight when I get home. I'd like to keep a copy of the A*S thread at the very least.
 
 
Spaniel
09:04 / 14.01.09
I know I'm about to sound thick, but how does web2disk know when to stop? My attempt at archiving has been going since yesterday morning
 
 
Tsuga
09:22 / 14.01.09
You might check your hard disk space to see how much is being used? Personally, I have no idea what the size of this entire site would be (I mean, does it grab and archive linked photos?).
 
 
Spaniel
09:31 / 14.01.09
I have checked it. 1.6 gigs so far.

SAGE?
 
 
Less searchable M0rd4nt
11:46 / 14.01.09
How many links deep did you tell it to go? Starting from the front page, you only need to go two or three links deep--forum, then thread, then pages in thread. If you tell it to go any deeper than that, it'll start looking at links people have posted in thread, then following links from those pages...
 
 
Spaniel
12:19 / 14.01.09
Ahhhhhhhh
 
 
Less searchable M0rd4nt
14:37 / 14.01.09
I found Firefox's ScrapBook better, because it lists all the pages that it's planning to archive then ticks them off for you as it goes. You can pause it, look at the list, see if it's going anywhere it oughtn't and either uncheck those pages in the queue if there aren't too many or cancel and start over.

NB: if using ScrapBook to archive PMs, you'll need to make sure you uncheck the link to the logout page to stop it from loading that one. Depending on your settings, going to the logout page might log you out and thus stop ScarpBook accessing your PMs.
 
 
Spaniel
17:18 / 14.01.09
I shall be using scrapbook. Thanks, SAGE
 
  
Add Your Reply