Tags: 8.04lts

06/21/10

  05:57:00 pm, by The Dreamer   , 1339 words  
Categories: Software, Computer, Storage, Ubuntu

declaring 'orac' alive again.

'orac' is back, long live 'orac'.

'orac' had gone away on Thursday, it actually started in Wednesday.... For some unknown reason, I decided to start the upgrade of 'orac' from 8.04LTS to 10.04LTS.

The upgrade seemed to go okay, but when I rebooted....it wouldn't boot. I scrambled around looking for a livecd to boot with....did have any 64bit ones handy and 10.04 was hit and miss on booting. But, I could see vg0 (root, home, swap) with all the livecds except 10.04.

Something about 10.04 didn't like how vg0 was set up. I looked at 'box', which had been running 10.04 for a while and was working. Noticed the main difference between the all the other md's and vg's...was that they weren't fdisk'd md's. When I had originally set up 'orac', I had used a recipe that I had found online on how to do it...since initial install of ubuntu onto Raid wasn't straight forward then. and after md1 was created, I had fdisk'd and then pvcreate/vgcreate, etc. on it.

When I added the other two raid sets....I just pvcreated the md and then used it...no fdisk of the md.

In retrospect I should probably have done a backup of the filesystems while I was running a livecd that could see it....and then perhaps remade the disk and restored into it. But, I didn't and while trying to 'fix' the problem...I corrupted things, and I wasn't able to recover (tried pvcreate -u + vgcfgrestore...but couldn't get the filesystems to come back.

After lots of other attempts and such, I reached the point where I decided things were lost and set on to figure out if I can get back.

backuppc localhost doesn't back up the entire localhost....but it had my home directory backed up (but not all of /home), and it was also backing up /etc. Realized the the one thing it wouldn't get is my crontab files. But I had a dd image of most of the disk (the front part munged)....so I string'd and recovered my crontab from it. And, then set out to install 10.04LTS new.

Since md1 was going to get redone, I decided to redo md0..../boot. Made it a bit bigger than before so that it won't get as crowded from accumulating every new kernel that is released until 12.04LTS comes out. Or some future release needed more than the old size to work. Had actually run into this problem years ago at my previous job....

But, the install kept failing....asking for the disk again....I burned several copies, download from other sources, but no go. So, I tried to 9.10 (thinking I would upgrade to 10.04 immediately), but it also didn't work. Eventually, I found a reference on google that said the 10.04 (and 9.10) installs were picky about what kind of optical drive was being used. It specifically mentioned a particular DVD burner, with 'orac' came with a DVD burner...though I have never used the drive since I did the original install. I tried a USB stick, but couldn't get the machine to use that, and the other external drive I could find was firewire (and there's no BIOS option to boot from firewire).

So, I took apart my machine and the firewire drive. And, put the DVD-ROM drive that was in the firewire enclosure into the machine. The DVD-ROM drive had original come from my circa 2003 Dell, known as 'tardis'.....when I had swapped in a DVD burner.

'box' is the Linux machine that I do cd burning on....and I hardly do DVDs anymore, though I did get a new DVD burner recently for the new 'gumby'.

Anyways....with the 'new' optical drive in 'orac'....I was able to get 10.04LTS to install, and then started the long process of getting my environment back. First problem was backuppc installed with a different uid/gid....so it wouldn't access the old /var/lib/backuppc storage. I opted to fix it the wrong way....that took forever....doing the chown of the files/directories. Should've just changed the uid/gid that backuppc had installed itself as. But, then I tried to do the restore....next problem was sudoers, had forgotten about that.

I then restored /etc to another place, and restored my home directory along side of the one the install had created. When done I swapped my home dir and rebooted. That was a mess. The desktop was all messed up...not just missing apps. Figured it was because the desktop didn't like the old settings....but couldn't find any details on how to upgrade desktop, if I hadn't done an upgrade. I thought other OSs handled this kind of thing. But, not here. So, I flipped back and slowly copied stuff over and restored settings etc. And, reinstalled various apps as I went.

Then I decided that I had made sufficient progress on getting 'orac' configured, that I didn't want to lose things. I had disabled backupc from doing automatic backups during the restore. So I turned it back on and back up the other systems around my home (after first doing a new backup of the new 'orac'). It didn't like .gvfs in my home directory....in old version it complained but continued, in this version it complained and the tar returned an error due to previous error...causing the rest of the backup to fail (the localhost backup does 4 'shares')....so I tweaked the config to get it to work.

The only thing I saw was that it tried to backup 'ulkc', my ubuntu notebook...but it wasn't on at the moment, so it failed. It wasn't going to automatically back up anything else yet, since its one of my blackout periods. So, I started kicking off manual backups of various things, and watched it work. First thing that didn't work was a backup of a windows share. Seems smbclient changed since 8.04LTS...and one of the options was used in backuppc 3.0 didn't work anymore. The new is 3.1, and the default options is minus that one switch....so I matched things up and it did its thing.

The only problem that still didn't work, which I think was the reason I decided to bite the bullet and upgrade to 10.04LTS (to get the newer backuppc) was incremental backup where a very large file has changed since the full. Usually the virtual harddrive of a VirtualBox. Sadly this wasn't fixed in 3.1. Guess I'll have to look at some other way to deal with it. Like exclude it from the regular policy and create a new one that only does that one file....or something. Or maybe ....

I continued to work on other things, as I worked through comparing the old /etc with the new 'orac' /etc. Though interrupted by trying to get file shares working (I had exported my Dropbox directory from another server for access from other computers on my home network....though LAN sync is available now, I haven't undone the stuff yet). And, getting snmpd working again....so I could see the impact to resources and network from all the backuppc jobs running in cacti.

One strange problem is that 'orac' can not access the NFS shares on 'lhaven' (RedHat 7.3), but 'box' can....the only difference I can think of is that 'box' was upgraded to 10.04LTS.... Though I guess it is time I worked on moving services off of 'lhaven' and figure out what I'm going to do to either replace or upgrade it.

The other issue was Handbrake. Originally, I had built it by hand...since there wasn't a package for 64-bit Linux. Though later, I got a newer version via PPA. But, the version that I got via PPA for Lucid didn't work. So, I eventually went and built my own again...from the subversion....my build works....

Hopefully, when 12.04LTS comes along....things'll just upgrade smoothly.

The other odd thing, is that 10.04LTS seems slower....particular in file I/O. The machine seems to really degrade in performance doing a large file copy (as was happening when I was copying directories from my old home dir to the new one.) All the CPUs are bored while this is happening (it's a 2.4GHz Core 2 Quad....with 8G of memory....) Hopefully something that'll resolve itself later?

05/18/10

  08:29:00 am, by The Dreamer   , 703 words  
Categories: Software, Computer, Networking, BOINC, Ubuntu

'Accidentally' Upgraded 'box' to Lucid

Last night I wasn't thinking....running into the fact that my boinc-client package is broken on 'box', I thought..."why isn't it running the boinc-client from Lucid?" And, I proceeded to fix it with "apt-get"...and then realized that I'm still running karmic and unbreaking it wasn't. The boinc-client pre-Lucid is too old for a project I'm in, and it is annoying how ubuntu doesn't update packages within releases (which get's really annoying with LTS.)

Anyways....I decided the way to resolve the mess I had now made by downgrading my boinc-client, was to upgrade to Lucid Lynx 10.04LTS. It was my plan to upgrade both my Ubuntu servers to 10.04LTS (the other being 'orac' which is currently 8.04LTS)....but I was going to put it off to when I had more time and allow time for the release to stabilize (given all the issues I had when I first started running box on fresh Karmic).

So, it started....things got a little annoying, in that the upgrade requires attention....and I didn't want to spend my whole evening watching it upgrade. So, I'd check it now and then, and sometimes find it stuck waiting for me to make a decision for it, though the first one where it wants to restart stuff after a pam upgrade...that's annoying. Just do it okay, stuff it restarted weren't working right along the way anyways. Namely I found that I couldn't access websites...at first I thought the squid had become dorked, and I couldn't restart it because invoking /etc/init.d/squid said it was now a service...but using service didn't find it. Though later I realized it wasn't working because DNS was broke ('box' is my primary DNS server)... I was able to restart that in the usual manner.

Partly because of the pauses, and a bit due to slow download....it wasn't looking like I would finish before 'bedtime'....but it seemed that it would be close enough.... It wasn't, but I ended up staying up to the bitter end. So, that I could reboot and do a quick check that all was clean.

Namely, I checked that named, dhcpd, ntpd and squid were running (since these were some key services of this server, and were ones that often failed to start after boot in karmic...especially named. Manual start always worked...at one time I was restarting these services in rc.local where it always worked rather than at the 'normal' time).

Then I went to fill in the missing icons in my launcher panel....there were two holes, there also seemed to be a hole in the tray area. The missing icons were Evolution (which I right-clicked to make reappear), and boxee (which I installed the latest of). I then called it a night.

The next morning, I continued to poke around some more....adjust appearance, add some chat/broadcast accounts...and look into my ubuntuone issue....first the tray thing was missing, apparently its by design...but, I don't remember that. I poked around some more and some more....then I looked at 'ulkc' and saw that it also didn't have the tray applet anymore, and I just didn't miss it... So, I then went to check that it was connected to my account and sync'd. Actually, it really was syncing, etc. When I was at Penguicon, I had put a copy of the pictures I had taken into my cloud...expecting to see them later on 'box' when I got home. But, it would never appear. Upgrading 'ulkc' didn't help things.

During the poking around, I disconnected 'box' and reconnected...and that apparently fixed whatever was wrong, as it started syncing...and soon the folders appeared.

While this was going on, I thought that maybe I would need to finish things up by remote....so sadly I discovered that remote desktop still doesn't work in Lucid. Turning it on, consumes 50% of my CPU. My 8.04LTS (orac) doesn't suffer from this problem. But, I want to bring both servers in sync eventually, so I can see about getting failover for dhcp working between the two.

Oh well....at least it seems more successful than when I had upgraded 'box' to Karmic. And, now I'm at an LTS where it can stay for the next 2 years.... We'll see what happens when I upgrade from 8.04LTS to 10.04LTS next month....

05/15/10

  04:20:00 pm, by The Dreamer   , 1373 words  
Categories: Software, Computer, Storage, Ubuntu

5-bay RAID and backuppc

Ever since I learned about 5-bay port multiplier SATA enclosures, I've been wanting to get one to play with. And, when I acquired 'orac'...I sought out a port multiplier eSATA adapter to include in the build of the system. And, then waited for support of the adapter in ubuntu. Stopped on 8.04LTS and waited for inclusion in a kernel.

I took a step closer when I finally got the 2-bay enclosure to mirror a pair of drives I had impulsively purchased. Since it worked, I then then bought a 5-bay enclosure (it came up as a NewEgg ShellShocker).

But, after some thought, I decided that what I wanted to do was build a 5 disk RAID5 using 1.5TB drives....so it would get me at least 5TB of real storage. And, set that I would wait until 1.5TB drives were under $100.

In the meantime, I collected a bunch of old SATA drives to see what I trouble I could get into....it didn't last long, as one was definitely dead and two quickly failed. Of course, two of the had been kicked out of RAID1 setups previously, and the other was a failing drive that I replaced/upgraded. So, it was back to waiting.

Eventually, I got 3 Samsung 1.5TB drives through NewEgg ShellShocker. And, I set up a 3 disk RAID5. Sadly, it didn't last very long....one of the drives failed while I was building the array. I exchanged it for a new drive with NewEgg, and waited for it before trying again. While I was waiting, I formatted it a bunch of times and learning about smartctl and various things of drive repair. One of the remaining two original drives, was showing signs of slow death and one unrecoverable sector. When, the new drive arrived...I did a long self test and a quick, but full, format....taking a couple days before I created the 3 disk RAID 5.

Once, that was done, I created a new big filesystem that is /var/lib/backuppc to have backuppc on 'orac'. Initially a 1TB filesystem.

Then one day, the bad happened. A drive on 'gumby' failed. It was time to stop putting off figuring out how to setup backuppc and start putting stuff into it. It turned out to be a lot easier than it thought to get started, though I did have to rebuild smbclient to have a longer timeout to get it successfully complete a full backup of a given partition. I then learned some other stuff and fine tuned the configs.... One big change was I broke out the windows hosts into individual partitions (ie, gumby_c, gumby_e, gumby_f), and came up with a 'semaphore' solution so that it wouldn't backup more than one partition at a time from a windows host. Eventually, I had all my systems in it (it fully backs up everything except itself, where it backs up only key parts....) I even got it backing up my work Mac Book Pro.

I later grew the filesystem out to 2TB.

Pages: 1· 2

05/08/10

  02:31:00 pm, by The Dreamer   , 990 words  
Categories: Software, Computer, Ubuntu

Upgrading to Lucid Lynx

Since I got back from Penguicon 2010, it had been my plan to test out upgrading to Lucid Lynx.

I didn't get around to it the first day back to work, since I was busy catching up on 1000s of emails and making sure things that my co-workers had ignored or overlooked during my absence got done. I then came home with a fever, and ended up taking the next day off from work. The fever broke Thursday night, so I went back to work on Friday...even though head is still all stuffed up and I had a killer sinus headache.

Finally, near the end of the day, I remembered that I wanted to try the upgrade....

At work, I have two Karmic Koala VMs, running in VirtualBox on a Sun Ultra 20 running Solaris 10/x64.

One VM is/was a 32-bit server....it runs BOINC all the time, got a squid instance when I was testing something and more recently I set up backuppc so that I'd have backups of my windows desktop at work. The other VM is a 32-bit desktop which is mainly so I can offload and run my mail/calendar client on...since the Windows computer is starting to suffer with the bloat and growth of apps...the more recent versions of Thunderbird and Firefox are very resource intensive, and I can't run both at the same time anymore.

Though what I do now is run Thunderbird and direct it to open on Cygwin/X running on the Windows box. Since, I want it to be visible all the time as I'm doing tasks come from emails. Makes it strange opening links and attachments though, since they won't go to the Firefox/apps on my windows box....etc.

I first upgraded the server VM, and it largely worked without any major issues....the only thing is that it does complain with "Your CPU is lacking expected security protection"....the checker says the CPU family has NX, but my BIOS isn't ... but the box to enable PAE/NX in VirtualBox is checked. So, guess its just a bug with Ubuntu running in VirtualBox.

I then upgraded the desktop VM...again that went okay.

The server VM originally started out as a Jaunty Jackalope, and went to Karmic Koala...so that was my first experience that 32-bit servers are no longer supported by Ubuntu (I mentioned it as the Ubuntu Q+A at Penguicon, but was ignored...when they were saying that Ubuntu supports a wide range of older hardware..I have older hardware that won't run 64-bit that I use a servers at home...plus I ran into a lot of problems getting 32-bit apps to work on my 64-bit hardy heron server.) Hopefully someday there'll be a way to go from 32-bit to 64-bit, on the machines that can support 64-bit but had 32-bit Ubuntu installed on them.

So, last night....after making backuppc complete that day's incremental. I set out to upgrade my laptop 'ulkc' to Lucid Lynx. This is a laptop, and I originally installed Jaunty Jackalope 32-bit on it, even though its a Core 2 Duo. Main thing is that boxee didn't support 64-bit, and it was one of the key apps I wanted to run...at the time (I've never actually used it on here though...since the streams that wouldn't show on my AppleTV+Boxee also wouldn't work on here. Forcing me to resort to iTunes/AppleTV to get the content.

The upgrade was largely straight forward....though along with disabling 3rdparty sources, it removed picasa (that's the main thing I noticed missing).

Afterwards, I left the computer on, and ran a new full backup into backuppc.

This morning I did some poking around of the usual apps that I use...Firefox/Thunderbird. Of course, Thunderbird is now 3.04...so it did its upgrade/migrate thing and loss of extensions that haven't been updated for 3.x and don't work if I do 'make compatible'. I hope someday these extensions will appear....mainly the View Header toggle button and Mail Redirect.

Being that I some how am an email admin at work, needing to see full headers is something that happens regularly....and mail redirect is handy when I send a message, and then realize that I forgot to CC/BCC somebody...I can then do that with redirect and they won't see the alteration to the email that forwarding does. Also useful to 'cc' a copy of an email that was sent directly to me rather than through proper channels (even if I'll be the one that ends up doing the work).

I left the computer on again...so Thunderbird can do its new (annoying) thing....and guess it'll eventually get picked up for today's incremental...unless I go back to using it before it runs and suspend it.

Not sure when I'm going to upgrade my Ubuntu servers. 'box' is currently a karmic koala 32-bit server (older P4 that doesn't do 64-bit)...was a jaunty jackalope...though I probably should've made it a hardy heron...to match 'orac'...since there are things (namely DHCP fail-over) that I can't do due to version mismatches. But, the plan is to make both servers run the 10.04LTS...where they'll stay until 12.04LTS comes out, or not?

I'm very hesitant about touching 'orac'....because its working, has critical functions, and its temperamental. Of course, 'box' has functions more critical to my overall home network...but I'm going to risk the upgrade of it, to get it to an LTS version.

It was my original intent to not upgrade the servers until at least a couple months have past...since when I had upgraded 'box' to karmic koala shortly after its release, stuff important to me (name DNS) didn't work. apparmor was breaking it. Eventually they released the kernel upgrade that resolved the issue. Though building a 32-bit server kernel each time, etc. was also kind of painful. I've since opted to just have the server running on the 'generic-pae' kernel.

'orac' can continue to be a server, since it is a 64-bit system.

I'll probably go back to the waiting...there are other things I should get to first....

Now instead of subjecting some poor random forum to a long rambling thought, I will try to consolidate those things into this blog where they can be more easily ignored profess to be collected thoughts from my mind.

Latest Poopli Updaters -- http://lkc.me/poop

bloglovin

There are 20 years 1 month 29 days 1 hour 14 minutes and 5 seconds until the end of time.
And, it has been 4 years 10 months 29 days 12 hours 48 minutes and 51 seconds since The Doctor saved us all from the end of the World!

Search

November 2017
Mon Tue Wed Thu Fri Sat Sun
 << <   > >>
    1 2 3 4 5
6 7 8 9 10 11 12
13 14 15 16 17 18 19
20 21 22 23 24 25 26
27 28 29 30      
Google

Linkblog

  XML Feeds

Who's Online?

  • Guest Users: 0
This seal is issued to lawrencechen.net by StopTheHacker Inc.
blogtool

hosted by
Green Web Hosting! This site hosted by DreamHost.

monitored by
Monitored by eXternalTest
SiteUptime Web Site Monitoring Service
website uptime