{"id":5,"date":"2021-05-16T12:14:00","date_gmt":"2021-05-16T11:14:00","guid":{"rendered":""},"modified":"2021-06-08T18:51:04","modified_gmt":"2021-06-08T17:51:04","slug":"media-server-part-4-upgrade-time-tail","status":"publish","type":"post","link":"https:\/\/blog.hslracing.com\/myhome\/2021\/05\/media-server-part-4-upgrade-time-tail.html","title":{"rendered":"Media Server Part 4 &#8211; Upgrade time, A Tail of many Disk Controllers"},"content":{"rendered":"<p>As part of my original install I tried a couple of LSI controllers, but while the second one I tried was recognised by the motherboard, it would not boot from a disk attached to it, and it is not officially supported anyway.<\/p>\n<p>I also gave up on having all of the extra disks mounted on top of the server, as the was I was addressing the disks caused them to randomly re-number after each reboot.<\/p>\n<\/p>\n<p>I was able to locate some extra RAM and so it now has 16GB which is the maximum the motherboard will address.<\/p>\n<p>I have now after 4 years reached a point where I am running out of space on the media server so it is time for some upgrades.<\/p>\n<p>With regards what I had running on this server, I have since scrapped many of the docker containers and I have migrated the web sites to my new Dell r210 ii, so the media server can now concentrate on a much reduced set of responsibilities: Plex server, and a couple of Minecraft servers for my children.<\/p>\n<p>The 4 x 3TB drives were setup in a Raid 10 configuration under ZFS giving me 5.38TB of space after allowing for the OS, this is now down to less than 1TB free, so I need to consider a storage upgrade.<\/p>\n<p>I have ordered a number of items from eBay: an <a href=\"https:\/\/support.hpe.com\/hpesc\/public\/docDisplay?docId=c03223666&amp;docLocale=en_US\">HP P420<\/a> SAS controller (\u00a315.00).<\/p>\n<div style=\"clear: both;text-align: center\"><a href=\"https:\/\/blog.hslracing.com\/wp-content\/uploads\/sites\/6\/2021\/05\/HP-2BP420.jpg\" style=\"margin-left: 1em;margin-right: 1em\"><img decoding=\"async\" border=\"0\" data-original-height=\"625\" data-original-width=\"1280\" src=\"https:\/\/blog.hslracing.com\/wp-content\/uploads\/sites\/6\/2021\/05\/HP-2BP420-300x146.jpg\" width=\"320\" \/><\/a><\/div>\n<p>A 2GB Flash Backed Write Cache) FBWC with super capacitor backup (\u00a315.00)<\/p>\n<div style=\"clear: both;text-align: center\"><a href=\"https:\/\/blog.hslracing.com\/wp-content\/uploads\/sites\/6\/2021\/05\/HP-2B2GB-2BFBWC.jpg\" style=\"margin-left: 1em;margin-right: 1em\"><img decoding=\"async\" border=\"0\" data-original-height=\"1094\" data-original-width=\"1600\" src=\"https:\/\/blog.hslracing.com\/wp-content\/uploads\/sites\/6\/2021\/05\/HP-2B2GB-2BFBWC-300x205.jpg\" width=\"320\" \/><\/a><\/div>\n<p><\/p>\n<p>and 4 x 6TB SAS drives (\u00a370.00 each).<\/p>\n<p>The 6TB SAS drives are half the price of what I originally paid for the 3TB drives and are enterprise rated so should be good for being on 100% of the time. <\/p>\n<p>The drive cage on the MicroServer Gen 8 will accept SATA or SAS drives, but the on-board B210i controller is SATA only.<\/p>\n<p>If I attach the 4 bay cage to the <a href=\"https:\/\/support.hpe.com\/hpesc\/public\/docDisplay?docId=c03223666&amp;docLocale=en_US\">HP P420<\/a>, it should then allow me to use SAS drives instead of SATA.<\/p>\n<p>The <a href=\"https:\/\/support.hpe.com\/hpesc\/public\/docDisplay?docId=c03223666&amp;docLocale=en_US\">HP P420<\/a>, will be recognised by the iLO and while not officially supported, being an HP product it should allow the server to boot from it, this will allow me to use 2 x 300GB SAS drives in a hardware Raid 10 setup for the boot disks and the 4 x 6TB disks as pass through devices to setup as Raid 10 under ZFS.<\/p>\n<p>If I can&#8217;t boot from the 300GB disks via the <a href=\"https:\/\/support.hpe.com\/hpesc\/public\/docDisplay?docId=c03223666&amp;docLocale=en_US\">HP P420<\/a>,&nbsp; I will use a couple of SATA SSDs instead and connect them to the on-board controller.<\/p>\n<p>This is all well and good for a new build, but I need to save the data that I have on the server already.<\/p>\n<p>My intention is to attach one or more of the new 6TB disks to the <a href=\"https:\/\/support.hpe.com\/hpesc\/public\/docDisplay?docId=c03223666&amp;docLocale=en_US\">HP P420<\/a>, create a new zpool and copy the data across.<\/p>\n<p>I can then install a new OS on the 300GB SAS drives, install ZFS and import the Zpool.<\/p>\n<p>This will give me a clean install and I can then re-install Docker and just load the images I am actually still using.<\/p>\n<p>So the parts all arrive safely and I install the <a href=\"https:\/\/support.hpe.com\/hpesc\/public\/docDisplay?docId=c03223666&amp;docLocale=en_US\">HP P420<\/a>, attach a 300GB SAS drive and a 6TB SAS drive to it and boot up the server, go into the <a href=\"https:\/\/support.hpe.com\/hpesc\/public\/docDisplay?docId=c03223666&amp;docLocale=en_US\">HP P420<\/a> controller configuration and I only see the 300GB SAS drive!<\/p>\n<p>I swap out the 6TB drive for a second one and try again with same end result.<\/p>\n<p>Some searching on the web later and it turns out that the 6TB SAS drives I have are 4kn drives and are NOT supported on my <a href=\"https:\/\/support.hpe.com\/hpesc\/public\/docDisplay?docId=c03223666&amp;docLocale=en_US\">HP P420<\/a> controller, see this <a href=\"https:\/\/techmikeny.com\/blogs\/techtalk\/compatibility-pain-points-4kn-hard-drives-and-backwards-compatibility-with-raid-controllers\">article<\/a> for an explanation.<\/p>\n<p>It turns out that none of my LSI controllers support 4kn drives according to the compatibility list at <a href=\"https:\/\/bitdeals.tech\/blogs\/news\/4kn-lsi-compatibility-list\">BitDeals<\/a>.<\/p>\n<p>Here&#8217;s wishing I had known about this incompatibility before I bought the <a href=\"https:\/\/support.hpe.com\/hpesc\/public\/docDisplay?docId=c03223666&amp;docLocale=en_US\">HP P420<\/a>, ah well live and learn I suppose &#8211; I can always sell it on to someone else.<\/p>\n<p>I have now purchased an <a href=\"https:\/\/www.google.com\/url?q=https:\/\/www.ebay.com\/sch\/i.html?_nkw%3Dlsi%2B9267&amp;sa=D&amp;ust=1564802374475000\">LSI 9267-8i <\/a>controller for $18.22 (\u00a313.15) with free P&amp;P from China.<\/p>\n<div style=\"clear: both;text-align: center\"><a href=\"https:\/\/blog.hslracing.com\/wp-content\/uploads\/sites\/6\/2021\/05\/LSI-2B9267-8i.jpg\" style=\"margin-left: 1em;margin-right: 1em\"><img decoding=\"async\" border=\"0\" data-original-height=\"1334\" data-original-width=\"1334\" height=\"320\" src=\"https:\/\/blog.hslracing.com\/wp-content\/uploads\/sites\/6\/2021\/05\/LSI-2B9267-8i-300x300.jpg\" \/><\/a><\/div>\n<p>This controller has the <a href=\"https:\/\/www.google.com\/url?q=https:\/\/docs.broadcom.com\/docs\/MegaRAID-SAS-Gen2.5CompatibilityList&amp;sa=D&amp;ust=1564802374478000\">2208<\/a> chipset that does support 4kn drives as well as RAID0, 1 and 10.<\/p>\n<p>It remains to be seen if I can boot from this controller and use my 300GB SAS drives for the OS, or if I will need to use some SATA SSD drives connected to the on-board B210i controller instead.<\/p>\n<p>The controller arrived after about 14 days, which was not bad. <\/p>\n<p>Well as luck would have it, this controller sees the 4kn drives, but as 498GB unsupported disks!<\/p>\n<p>I then did loads more searching and was considering a Dell Perc H310, but that was around \u00a380.00 ($110.00) and would also have meant all sorts of extra cables and adapters, totalling nearly the same as the card itself.<\/p>\n<p>I then stubbled across a post on the <a href=\"https:\/\/community.hpe.com\/t5\/ProLiant-Servers-ML-DL-SL\/Why-P840-or-H240-not-support-4Kn-HDD-in-Raid-mode-but-work-for\/td-p\/7084560\">HP forums<\/a> about why the <a href=\"https:\/\/support.hpe.com\/hpesc\/public\/docDisplay?docId=emr_na-c04495034\">HP P840<\/a> or <a href=\"https:\/\/support.hpe.com\/hpesc\/public\/docDisplay?docId=emr_na-c04496620\">HP H240<\/a> do not support 4Kn drives in RAID but work for HBA mode.<\/p>\n<p>The <a href=\"https:\/\/support.hpe.com\/hpesc\/public\/docDisplay?docId=emr_na-c04496620\">HP H240<\/a> is a 12Gbps card and in HBA mode simply passes the drives straight through to the OS even though it cannot even see them, just like the <a href=\"https:\/\/support.hpe.com\/hpesc\/public\/docDisplay?docId=c03223666&amp;docLocale=en_US\">HP P420<\/a> if you look in the disk configuration utility.<\/p>\n<p>I purchased an <a href=\"https:\/\/support.hpe.com\/hpesc\/public\/docDisplay?docId=emr_na-c04496620\">HP H240<\/a> HBA card for \u00a326.00 ($36.00) from an Ebay in Lancashire.<\/p>\n<div style=\"clear: both;text-align: center\"><a href=\"https:\/\/blog.hslracing.com\/wp-content\/uploads\/sites\/6\/2021\/05\/HP-2BP420-1.jpg\" style=\"margin-left: 1em;margin-right: 1em\"><img decoding=\"async\" border=\"0\" data-original-height=\"625\" data-original-width=\"1280\" src=\"https:\/\/blog.hslracing.com\/wp-content\/uploads\/sites\/6\/2021\/05\/HP-2BP420-1-300x146.jpg\" width=\"320\" \/><\/a><\/div>\n<p>This arrived by next day delivery and was installed in the Microserver and sure enough a 6TB 4Kn drive was visible to the OS!<\/p>\n<p>Finally I could move forwards with the upgrade.<\/p>\n<p>I attached 2 6TB disks to the <a href=\"https:\/\/support.hpe.com\/hpesc\/public\/docDisplay?docId=emr_na-c04496620\">HP H240<\/a> HBA and configured them as a new zpool of 10.9TB in size.<\/p>\n<p>Next I used zfs send\/receive to copy all of the data from the existing zpool to the new one &#8211; I take snapshot backups of all the file systems on a nightly basis so I can just pick which snapshot to use for the transfers.<\/p>\n<p>The transfers were averaging around 1.46Gbps &#8211; a 2.55TB file system transferred in just over 3 hours 58 minutes. <\/p>\n<p>I then saved a load of configuration information (passwd, shadow, group, sudoers, crontabs, etc) onto the new disks before shutting the server down and removing all the disks.<\/p>\n<p>I attached my 2 x 300GB SAS drives and mounted an Ubuntu ISO via the remote console and installed a new OS using software RAID onto the disks.<\/p>\n<p>After the install had completed and successfully booted, I installed the zfs software, shut down the server&nbsp; swapped the disk caddies over, installed the 4 x 6TB SAS drives in the bays at the front of the Microserver and moved the SFF-8087 connection from the B210i connection on the motherboard to the <a href=\"https:\/\/support.hpe.com\/hpesc\/public\/docDisplay?docId=emr_na-c04496620\">HP H240<\/a> HBA.<\/p>\n<p>After booting up I was able to import and rename the new zpool and re-install docker and zabbix.<\/p>\n<p>Finally I attached the remaining 2 x 6TB disks as mirrors.<\/p>\n<p>After all the drama over the disk controllers, the upgrade itself was simple by comparison with no issues.<\/p>\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>As part of my original install I tried a couple of LSI controllers, but while the second one I tried was recognised by the motherboard, it would not boot from a disk attached to it, and it is not officially supported anyway. I also gave up on having all of the extra disks mounted on&hellip;<\/p>\n","protected":false},"author":1,"featured_media":86,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[5,3],"class_list":["post-5","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorised","tag-homelab","tag-networking"],"_links":{"self":[{"href":"https:\/\/blog.hslracing.com\/myhome\/wp-json\/wp\/v2\/posts\/5","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.hslracing.com\/myhome\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.hslracing.com\/myhome\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.hslracing.com\/myhome\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.hslracing.com\/myhome\/wp-json\/wp\/v2\/comments?post=5"}],"version-history":[{"count":2,"href":"https:\/\/blog.hslracing.com\/myhome\/wp-json\/wp\/v2\/posts\/5\/revisions"}],"predecessor-version":[{"id":262,"href":"https:\/\/blog.hslracing.com\/myhome\/wp-json\/wp\/v2\/posts\/5\/revisions\/262"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blog.hslracing.com\/myhome\/wp-json\/wp\/v2\/media\/86"}],"wp:attachment":[{"href":"https:\/\/blog.hslracing.com\/myhome\/wp-json\/wp\/v2\/media?parent=5"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.hslracing.com\/myhome\/wp-json\/wp\/v2\/categories?post=5"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.hslracing.com\/myhome\/wp-json\/wp\/v2\/tags?post=5"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}