Tags: raid5

08/23/11

  08:24:32 am, by The Dreamer   , 1100 words  
Categories: Hardware, Software, Computer, Storage

Oops!Backup, Crashplan and RAID5 OCE on Zen

I may have mentioned that I've been trialing Oops!Backup on Zen....the 30-day free trial period ended last week, and a few days before it ended. I went and bought a license. But, not the 20% off that I found an email for after I had gotten the license....wonder if the 120-day guarantee still applies.

Because on Saturday my system crashed....it was acting weird, and the desktop had gotten messed up...figured explorer had crashed on me, and not all my systray icons came back. So, I logged out to log back in. Except instead of the login screen after the black one....I watched the bios boot sequence :??: And, it got stuck. So, I had to powercycle to get it to try again.

Starting to question my decision to go with HP. Especially since they sold me an extended warranty that doesn't apply to the computer that I bought it with... :## At least Dell did good with its extended warranty service....they replaced my Dell monitor that died under the Dell system warranty, even though I bought the monitor after I got the computer + warranty. (The Dell 18" LCD was a step down from the 21" CRT that I had....but it's an LCD!)

Anyways....things eventually came back up and everything seemed fine....until the hour, Oops!Backup failed with "Oops!Backup encountered an error while versioning your files. Please try backing up again. (4043)". So, I tried it again. And, again.... I think the software needs some kind of self-repair?

It continued to not work for a while, so I tried looking online for an easy fix....found nothing. So, I fired off an email to support. Didn't really expect much, given that it was Saturday night. But, got an email on Sunday to download and run a tool to collect logs and send them the result. Almost the size of a typical explorer :>>

But, then I didn't hear anything until Tuesday morning. The explanation is that a particular metadata XML file has been corrupted or tampered with for some reason.

First I'm to make sure that I didn't tamper with it, and that I'm not continuing to tamper with it.... umm, sure blame me.

So, I'm to delete it, exclude it, backup, re-include, backup....and then what?

A backup takes a really long time....a lot of stuff has changed since Saturday night. Current attempt has been running for over 30 minutes....though the backup destination is busy with other things as well (more later).

No joy. :`(

It had said the metadata XML file that was corrupt was the one for the _gsdata_ under Documents. Digging around, I eventually found where the error logs are kept...and see that its now complaining about _gsdata_ under Pictures. Wonder if its more that there's a race every hour when GoodSync is running and sync'ng my Documents/Pictures/Music/Videos folders or it was just the crash that killed it. Or, if there's any need to have _gsdata_ backed up by Oops!Backup

17.17GB of changes with both _gsdata_'s excluded.... Another 70.75MB after including them back. Guess we'll see in 37 minutes if its all fine again.... U-(

Pages: 1· 2· 3

08/11/11

  07:47:49 am, by The Dreamer   , 718 words  
Categories: Hardware, Software, Computer, Storage

The storage upgrades on Orac and Zen begin

Because one of the 1TB RAID1 drives was starting to fail...I was looking at options to replace it.

I original had a plan to upgraded one of my 1.5TB RAID1's to a pair of 2TB drives....freeing one of the 1.5TB drives to test out the OCE/ORLM feature of the RR622 & TR5M-BP on Zen...converting the current 2x1.5TB RAID0 to a 3x1.5TB RAID5 (or perhaps 4x1.5TB) Oops!Backup seems to be doing well and its filling up the space, I'm sure there's a setting to tell it not to, but not an issue at the moment. Guess I should buy it before the 30 day trial runs out.

At first I was looking at new 1TB drives....though for $20 more I could get 2TB drives, the same kind as the 6x2TB RAID10. The 1TB and 1.5TB drives have been 7200RPM (as were all previous drives)....the Hitachi's are the first of the greener drives....5940RPM. Given that I'm doing PM RAID in a first gen PCI Express box, I'm probably still not seeing the full potential of the greener drives.

Full story »

07/09/11

  09:03:13 pm, by The Dreamer   , 1290 words  
Categories: Hardware, Software, Computer, Storage

New arrays on Orac

This is an owed post (of over 3 months in the making....) I had thought of lots of things to write for this since I meant to write it, but didn't write anything. And, now its so old...that I'm just going to be really terse....

:lalala:

The lead in to this posting was Worked on Orac yesterday. So, I got those 5 2TB drives...and first tried to make it RAID5 using mdadm. And, started filling it up....though the performance didn't seem to be much better using XFS, plus the new backuppc seemed to have regressed on handling XFS.... so I heard about ZFS on Linux....as kernel modules that do the taint. And, tried out RAIDZ, with its variable striping to maybe to do better on performance. It seemed nice, but then stack dumps filling up my logs....rebooted and then did a zpool scrub, and it went to work fixing lots and lots of errors, and then a few unrecoverable errors.

Guess no ZFS, and the XFS didn't seem enough of a gain to make it different from everything else. Even though there's one really big problem with ext4. Resizing it causes corruption. Supposed to be fixed now, but before I switched to the new array, I grew the backuppc volume for 3.75TB to 3.8TB, offline...and it resulted in corruption still.

So, I was making the new backuppc volume the full size of the array. As I mulled over the situtation...I decided that I would try RAID10, sure that wouldn't get as huge a boost over the old RAID6 array of 1.5TB, but it would still be an increase...and no idea what I'm going to do when I need more space. But, first I had to get a 6th 2TB drive to do RAID10. Plus it would mean that I would need to do something else with the 1.5TB drives. One was going to have to come out. Sure it could run degraded initially (though did find that it would come back after a reboot, guess the boot making degraded arrays come online...only does it for OS filesystems. Though the boot get's stuck because it can't mount filesystems and the recovery of mounting just doesn't work still. Getting into single user is such a pain too. Though after I broke my sudoers file recently, I turned off hiddenmenu.

The hard part about making the RAID10, was figuring out the ordering of devs...so that it was mirror across the eSATA channels and stripping with in. There's only 2 channels, and 6 drives in this array...so figured that was the best way to go. Though now that I've realized that its only PCI express 1.0, not sure if that was the best way to go. Though to try the other, would call for me to get 8 drives? And, who knows what the future holds for supporting backuppc....

internal bitmap on doesn't seem to degrade the RAID10 as much as RAID5 or RAID6, so I have that turned on now.

Now there was the question of what to do with the 4 remaining drive bays and the 4 1.5TB drives. Would I got with another RAID10, a couple of RAID1...would I concat them into the LVM for growth or make them separate.

Well, on the old 1TB array was my old MMC volume, which needed more space and part of the 5x1.5TB RAID6 was a backup volume...also in need of more space. I decided that I would go with two separate RAID1s using the Seagate 1.5TB drives (I had pulled the Samsung 1.5TB to make it degraded....that drive has since been hooked up to TARDIS for local backups).

Around this time, my Roku appeared...and I went through the various attempts to map a network drive to it for local content. Settling on the HSTI Media Stick and its 1TB maximum. I settled on going with 2 1.5TB RAID1 arrays. One of them was made fully available to be the new MMC volume. And, the other...I made a 1TB volume (called TARDIS) for the HSTI Media Stick, and the rest became the new backup volume.

The old 1TB RAID1 array stayed online, until it was recently repurposed into the volume for Time Machine backups (only 931GB).

Now I've been debating playing around with external bitmaps and/or external journaling to see if I can get more performance. But, external bitmaps go away after a reboot, and that just seems to be a bug that isn't going to get fixed anytime soon. external journaling would require me to find some devices for that....so I got the idea of PCI Compact Flash adapter and some compact flash cards....I have a couple of the PCI Compact Flash adapters....and I do have a few compact flash cards around. Though when I was playing around with ReadyBoost on Zen, I found they weren't really that great on speed. And, I was going to want to get as much speed out of things as I could here....so I did some checking and now I'm waiting to get around to buying some 600x CF cards to get around to trying this. The fastest card I have available in my collection is a 133x. And, I don't recall why I bought that one. Ones earlier than that would be left overs from when I had my PowerShot S20, then an REB1200 and then a Nikon Coolpix 5700.

These days, I'm all about the SD cards for my digital cameras (Eye-Fi), though been thinking of getting an ultracompact (and wearing my holster less often)....and some that I've looked at use MicroSD cards. Don't have any extra Class 10 ones laying about though....though I do have a couple of Class 6 8GB cards that need a home (I got them in a 2for1 sale, and the need for 1 didn't happen as planned....and when I do get around to getting that device, I'm sure I'll probably cave and get a 16GB or 32GB Class 10 MicroSD card.)

Full story »

03/28/11

  01:43:48 pm, by The Dreamer   , 837 words  
Categories: Hardware, Computer, Storage

Worked on Orac yesterday

Yesterday, I decided that I should poke around Orac in preparation for building that new 5x2TB RAID5 array. My backuppc pool keeps filling up, and deleting old backups isn't freeing up enough space anymore (5x1.5TB RAID6 array.)

At first it was just going to be a simple procedure to add two eSata cables from the computer to the Sans Digital MS2T+B, and then shutdown and move the two 1TB drives in RAID 1 from the bottoms slots of my TR5M-B (upper 3 are unoccupied). But, as I was pushing on the cables the bracket popped in...so I had to open the case to put it back in place.

While I was in, I decided to see what kind of fan is on the drive cage. A couple of weeks earlier, I had gotten a SMART alert of high temperature and cacti showed that there was a rise for a few hours in the late evening. It had been warm that day, warm enough that I touched the AC briefly in the earlier part of the evening. Guess I needed it to stay on the rest of the evening.... But, there was no fan...though there were mount holes for a fan, and there's supposed to be a fan connector on the motherboard for it. Though not all models had one, so evidently not the GT5635E. Though wonder if I should, maybe the addition of the second internal drive makes it desirable (so far I've had to replace the second drive twice....the current one is now a newer generation than the original drives, and runs cooler.)

Since there wasn't a fan, I didn't take the cage out....so I didn't measure what size fan might go in the spot. Though I have a rough guess as what size it is, so perhaps later on I'll pick up a fan to put there. I should probably see about a new rear fan....perhaps a faster one might help.

But, I put things back together and moved the drives, started things back up.

Of course, the first problem is now all my drive letters are different....which messed things up like cacti (hddtemp recording), gkrellm and rc.local (where I changed the i/o schedule for the RAID6 array drives to noop). There was also the complication that the filesystem on the drives I just moved hadn't been fsck'd in over 6 months. So, it needed to fsck them. root also needed be fsck'd. It took a long time to boot, but eventually did. Though the filesystem on the moved RAID1 array hadn't finished checking...had set 'nobootwait' on filesystem. I'll probably remove those now...since they have fixed Bug #563916. But, after fixing rc.local (and before fixing cacti) I rebooted....so it still needed to do the fsck.

Later I still had to reboot again, because two services that reference the filesystem....weren't happy...well, one was really unhappy and the other wasn't reporting valid information for it and needed a restart to make it work (I couldn't probably have fixed the issue without a reboot, but I wanted to make sure it rebooted right after another change I had made. There's still something odd going on, affecting a different RAID1 array....will look into that later (or I could opt to move the filesystem to the RAID6 array)....since it could use a grow.

Full story »

05/15/10

  04:20:00 pm, by The Dreamer   , 1373 words  
Categories: Software, Computer, Storage, Ubuntu

5-bay RAID and backuppc

Ever since I learned about 5-bay port multiplier SATA enclosures, I've been wanting to get one to play with. And, when I acquired 'orac'...I sought out a port multiplier eSATA adapter to include in the build of the system. And, then waited for support of the adapter in ubuntu. Stopped on 8.04LTS and waited for inclusion in a kernel.

I took a step closer when I finally got the 2-bay enclosure to mirror a pair of drives I had impulsively purchased. Since it worked, I then then bought a 5-bay enclosure (it came up as a NewEgg ShellShocker).

But, after some thought, I decided that what I wanted to do was build a 5 disk RAID5 using 1.5TB drives....so it would get me at least 5TB of real storage. And, set that I would wait until 1.5TB drives were under $100.

In the meantime, I collected a bunch of old SATA drives to see what I trouble I could get into....it didn't last long, as one was definitely dead and two quickly failed. Of course, two of the had been kicked out of RAID1 setups previously, and the other was a failing drive that I replaced/upgraded. So, it was back to waiting.

Eventually, I got 3 Samsung 1.5TB drives through NewEgg ShellShocker. And, I set up a 3 disk RAID5. Sadly, it didn't last very long....one of the drives failed while I was building the array. I exchanged it for a new drive with NewEgg, and waited for it before trying again. While I was waiting, I formatted it a bunch of times and learning about smartctl and various things of drive repair. One of the remaining two original drives, was showing signs of slow death and one unrecoverable sector. When, the new drive arrived...I did a long self test and a quick, but full, format....taking a couple days before I created the 3 disk RAID 5.

Once, that was done, I created a new big filesystem that is /var/lib/backuppc to have backuppc on 'orac'. Initially a 1TB filesystem.

Then one day, the bad happened. A drive on 'gumby' failed. It was time to stop putting off figuring out how to setup backuppc and start putting stuff into it. It turned out to be a lot easier than it thought to get started, though I did have to rebuild smbclient to have a longer timeout to get it successfully complete a full backup of a given partition. I then learned some other stuff and fine tuned the configs.... One big change was I broke out the windows hosts into individual partitions (ie, gumby_c, gumby_e, gumby_f), and came up with a 'semaphore' solution so that it wouldn't backup more than one partition at a time from a windows host. Eventually, I had all my systems in it (it fully backs up everything except itself, where it backs up only key parts....) I even got it backing up my work Mac Book Pro.

I later grew the filesystem out to 2TB.

Pages: 1· 2

Now instead of subjecting some poor random forum to a long rambling thought, I will try to consolidate those things into this blog where they can be more easily ignored profess to be collected thoughts from my mind.

Latest Poopli Updaters -- http://lkc.me/poop

bloglovin

There are 20 years 3 months 27 days 13 hours 46 minutes and 24 seconds until the end of time.
And, it has been 4 years 9 months 16 minutes and 32 seconds since The Doctor saved us all from the end of the World!

Search

September 2017
Mon Tue Wed Thu Fri Sat Sun
 << <   > >>
        1 2 3
4 5 6 7 8 9 10
11 12 13 14 15 16 17
18 19 20 21 22 23 24
25 26 27 28 29 30  
Google

Linkblog

  XML Feeds

Who's Online?

  • Guest Users: 3
This seal is issued to lawrencechen.net by StopTheHacker Inc.
powered by b2evolution

hosted by
Green Web Hosting! This site hosted by DreamHost.

monitored by
Monitored by eXternalTest
SiteUptime Web Site Monitoring Service
website uptime