Tags: hardy heron

05/15/10

  04:20:00 pm, by The Dreamer   , 1373 words  
Categories: Software, Computer, Storage, Ubuntu

5-bay RAID and backuppc

Ever since I learned about 5-bay port multiplier SATA enclosures, I've been wanting to get one to play with. And, when I acquired 'orac'...I sought out a port multiplier eSATA adapter to include in the build of the system. And, then waited for support of the adapter in ubuntu. Stopped on 8.04LTS and waited for inclusion in a kernel.

I took a step closer when I finally got the 2-bay enclosure to mirror a pair of drives I had impulsively purchased. Since it worked, I then then bought a 5-bay enclosure (it came up as a NewEgg ShellShocker).

But, after some thought, I decided that what I wanted to do was build a 5 disk RAID5 using 1.5TB drives....so it would get me at least 5TB of real storage. And, set that I would wait until 1.5TB drives were under $100.

In the meantime, I collected a bunch of old SATA drives to see what I trouble I could get into....it didn't last long, as one was definitely dead and two quickly failed. Of course, two of the had been kicked out of RAID1 setups previously, and the other was a failing drive that I replaced/upgraded. So, it was back to waiting.

Eventually, I got 3 Samsung 1.5TB drives through NewEgg ShellShocker. And, I set up a 3 disk RAID5. Sadly, it didn't last very long....one of the drives failed while I was building the array. I exchanged it for a new drive with NewEgg, and waited for it before trying again. While I was waiting, I formatted it a bunch of times and learning about smartctl and various things of drive repair. One of the remaining two original drives, was showing signs of slow death and one unrecoverable sector. When, the new drive arrived...I did a long self test and a quick, but full, format....taking a couple days before I created the 3 disk RAID 5.

Once, that was done, I created a new big filesystem that is /var/lib/backuppc to have backuppc on 'orac'. Initially a 1TB filesystem.

Then one day, the bad happened. A drive on 'gumby' failed. It was time to stop putting off figuring out how to setup backuppc and start putting stuff into it. It turned out to be a lot easier than it thought to get started, though I did have to rebuild smbclient to have a longer timeout to get it successfully complete a full backup of a given partition. I then learned some other stuff and fine tuned the configs.... One big change was I broke out the windows hosts into individual partitions (ie, gumby_c, gumby_e, gumby_f), and came up with a 'semaphore' solution so that it wouldn't backup more than one partition at a time from a windows host. Eventually, I had all my systems in it (it fully backs up everything except itself, where it backs up only key parts....) I even got it backing up my work Mac Book Pro.

I later grew the filesystem out to 2TB.

Pages: 1· 2

05/08/10

  02:31:00 pm, by The Dreamer   , 990 words  
Categories: Software, Computer, Ubuntu

Upgrading to Lucid Lynx

Since I got back from Penguicon 2010, it had been my plan to test out upgrading to Lucid Lynx.

I didn't get around to it the first day back to work, since I was busy catching up on 1000s of emails and making sure things that my co-workers had ignored or overlooked during my absence got done. I then came home with a fever, and ended up taking the next day off from work. The fever broke Thursday night, so I went back to work on Friday...even though head is still all stuffed up and I had a killer sinus headache.

Finally, near the end of the day, I remembered that I wanted to try the upgrade....

At work, I have two Karmic Koala VMs, running in VirtualBox on a Sun Ultra 20 running Solaris 10/x64.

One VM is/was a 32-bit server....it runs BOINC all the time, got a squid instance when I was testing something and more recently I set up backuppc so that I'd have backups of my windows desktop at work. The other VM is a 32-bit desktop which is mainly so I can offload and run my mail/calendar client on...since the Windows computer is starting to suffer with the bloat and growth of apps...the more recent versions of Thunderbird and Firefox are very resource intensive, and I can't run both at the same time anymore.

Though what I do now is run Thunderbird and direct it to open on Cygwin/X running on the Windows box. Since, I want it to be visible all the time as I'm doing tasks come from emails. Makes it strange opening links and attachments though, since they won't go to the Firefox/apps on my windows box....etc.

I first upgraded the server VM, and it largely worked without any major issues....the only thing is that it does complain with "Your CPU is lacking expected security protection"....the checker says the CPU family has NX, but my BIOS isn't ... but the box to enable PAE/NX in VirtualBox is checked. So, guess its just a bug with Ubuntu running in VirtualBox.

I then upgraded the desktop VM...again that went okay.

The server VM originally started out as a Jaunty Jackalope, and went to Karmic Koala...so that was my first experience that 32-bit servers are no longer supported by Ubuntu (I mentioned it as the Ubuntu Q+A at Penguicon, but was ignored...when they were saying that Ubuntu supports a wide range of older hardware..I have older hardware that won't run 64-bit that I use a servers at home...plus I ran into a lot of problems getting 32-bit apps to work on my 64-bit hardy heron server.) Hopefully someday there'll be a way to go from 32-bit to 64-bit, on the machines that can support 64-bit but had 32-bit Ubuntu installed on them.

So, last night....after making backuppc complete that day's incremental. I set out to upgrade my laptop 'ulkc' to Lucid Lynx. This is a laptop, and I originally installed Jaunty Jackalope 32-bit on it, even though its a Core 2 Duo. Main thing is that boxee didn't support 64-bit, and it was one of the key apps I wanted to run...at the time (I've never actually used it on here though...since the streams that wouldn't show on my AppleTV+Boxee also wouldn't work on here. Forcing me to resort to iTunes/AppleTV to get the content.

The upgrade was largely straight forward....though along with disabling 3rdparty sources, it removed picasa (that's the main thing I noticed missing).

Afterwards, I left the computer on, and ran a new full backup into backuppc.

This morning I did some poking around of the usual apps that I use...Firefox/Thunderbird. Of course, Thunderbird is now 3.04...so it did its upgrade/migrate thing and loss of extensions that haven't been updated for 3.x and don't work if I do 'make compatible'. I hope someday these extensions will appear....mainly the View Header toggle button and Mail Redirect.

Being that I some how am an email admin at work, needing to see full headers is something that happens regularly....and mail redirect is handy when I send a message, and then realize that I forgot to CC/BCC somebody...I can then do that with redirect and they won't see the alteration to the email that forwarding does. Also useful to 'cc' a copy of an email that was sent directly to me rather than through proper channels (even if I'll be the one that ends up doing the work).

I left the computer on again...so Thunderbird can do its new (annoying) thing....and guess it'll eventually get picked up for today's incremental...unless I go back to using it before it runs and suspend it.

Not sure when I'm going to upgrade my Ubuntu servers. 'box' is currently a karmic koala 32-bit server (older P4 that doesn't do 64-bit)...was a jaunty jackalope...though I probably should've made it a hardy heron...to match 'orac'...since there are things (namely DHCP fail-over) that I can't do due to version mismatches. But, the plan is to make both servers run the 10.04LTS...where they'll stay until 12.04LTS comes out, or not?

I'm very hesitant about touching 'orac'....because its working, has critical functions, and its temperamental. Of course, 'box' has functions more critical to my overall home network...but I'm going to risk the upgrade of it, to get it to an LTS version.

It was my original intent to not upgrade the servers until at least a couple months have past...since when I had upgraded 'box' to karmic koala shortly after its release, stuff important to me (name DNS) didn't work. apparmor was breaking it. Eventually they released the kernel upgrade that resolved the issue. Though building a 32-bit server kernel each time, etc. was also kind of painful. I've since opted to just have the server running on the 'generic-pae' kernel.

'orac' can continue to be a server, since it is a 64-bit system.

I'll probably go back to the waiting...there are other things I should get to first....

Now instead of subjecting some poor random forum to a long rambling thought, I will try to consolidate those things into this blog where they can be more easily ignored profess to be collected thoughts from my mind.

Latest Poopli Updaters -- http://lkc.me/poop

bloglovin

There are 20 years 1 month 25 days 21 hours 46 minutes and 42 seconds until the end of time.
And, it has been 4 years 11 months 1 day 16 hours 16 minutes and 14 seconds since The Doctor saved us all from the end of the World!

Search

November 2017
Mon Tue Wed Thu Fri Sat Sun
 << <   > >>
    1 2 3 4 5
6 7 8 9 10 11 12
13 14 15 16 17 18 19
20 21 22 23 24 25 26
27 28 29 30      
Google

Linkblog

  XML Feeds

Who's Online?

  • Guest Users: 0
This seal is issued to lawrencechen.net by StopTheHacker Inc.
free blog tool

hosted by
Green Web Hosting! This site hosted by DreamHost.

monitored by
Monitored by eXternalTest
SiteUptime Web Site Monitoring Service
website uptime