![\"\"](\"https:\/\/i0.wp.com\/jamesdevine.info\/wp-content\/uploads\/2021\/06\/server-build.jpg?resize=625%2C469&ssl=1\")
<\/figure>\r\n<\/div>\r\n\r\n\r\n\r\nThe Rack<\/h2>\r\n\r\n\r\n\r\n
After some back and forth on rack size, I went with the tallest that would fit in my closet. Fortunately, that was a 1\/4 height 12U rack. One main constraint was on depth. I only had about 25″ total. This meant no standard-length servers, but that aligned with the servers that would soon live to call the rack home. After a lot of searching I landed on this rack<\/a> on Amazon. It paired nicely with the CyberPower CPS1215RMS<\/a>. Since this is mostly a lab environment a UPS didn’t make too much sense and I’ve been burned by batteries dying and causing issues. Fortunately, I’ve got pretty solid power that’s been more reliable than any of the rack-based UPSs I’ve seen.<\/p>\r\n\r\n\r\n\r\n After looking through a lot of options for lab ESXi servers I landed on the Supermicro 5018D-FN8T<\/a>. With a built-in processor, low power, quiet fan mode, 10 x 1GbE ports, and 2 x 10GbE it made the most sense. Oh and this bad boy can pack in up to 128GB of DDR4 ECC RDIMMs, in addition to a host of other ports and features along with built-in rack ears. I went with RDIMMs so I can pack in maximum RAM. For this build it was 2 x 32GB sticks<\/a> per server so there is room for upgrade in the future. I slapped in a 2.5″ SSD and HDD so there was local VM storage. For the ESXi hypervisor a 32GB USB 3.0 thumb drive worked out just fine. The processor was already installed so it was a pretty straight forward build overall. Two of these servers made for a decently sized and flexible cluster. I was considering vSAN, but have been burned enough times that I wasn’t going to even bother with it. Enter a FreeNAS custom built server for NAS\/SAN.<\/p>\r\n\r\n\r\n\r\n My main requirement for a storage was a 1U server footprint. Thanks to short form factor if the rack, I needed a short footprint server which took quite a bit of searching. I went with Supermicro SYS-1019S-MC0T<\/a> due to it’s short length, 1U form factor, 2x10GbE ports, and 8 x SAS\/SATA 2.5″ drive bays. It was a perfect match for the rack, with the exception of the full length rails that came with it. Thankfully, Supermicro makes a shorter version of the rails (model number MCP-290-00056-0N<\/a>). One issue that became immediately apparent was the noise. This server SCREAMS at idle. Out of box it’s not suitable for a small condo. Some additional searching lead me to swap out the OEM fans with Noctua NF-A4x20 PWM<\/a>. They are a tad underpowered, but pretty much silent. So far so good with the server staying cool enough and being whisper quiet.<\/p>\r\n\r\n\r\n\r\n With this barebones server I did need to get a processor, but found a cheap Intel Core i3-7100 that has been doing the job just fine. Since the board accepts standard RAM and I happen to have this memory kit<\/a> laying around that I was able to put it to good use.<\/p>\r\n\r\n\r\n\r\n FreeNAS was an obvious choice for for the storage OS. It’s super lightweight and support iSCSI multi-pathing as well as VAAI <\/a>so ESXi can offload storage tasks to the storage server. The server’s 10GbE NICs are also officially supported. My first attempt was an old Supermicro server from eBay with a cheap 10GbE adapter. Turns out neither was suited for FreeNAS, lesson learned.<\/p>\r\n\r\n\r\n\r\n That just left drives. I happen to like the Samsung SSDs so I went with 4 x 1 TB SAMSUNG 870 QVO. Since I still had 4 more drive bays open, I was on the hunt for more drives. The backplane works with SAS so I figured why not enterprise SAS. I picked up 4 x 900GB Toshiba SAS drives for $20 each. That should have been my go to for all 8 drive bays! Although now I can sport two tiers of storage. I still have some benchmarking to do for NFS vs iSCSI on both SSD and SAS 10K RPM driver.<\/p>\r\n\r\n\r\n\r\n With all these 10GbE capable servers, it was time for a 10GbE capable switch. It turns out they get pretty expensive. I landed on the Ubiquiti Switch XG 16<\/a> (found it on Facebook marketplace for 1\/2 off) after a lot of searching for the optimal feature-to-price breakdown. I got the box all setup and then the first problem arose – I needed to have a Uibuiti controller. They offer this through their cloud, but you need to have 10 devices under managed. My budget and available rackspace, let alone requirements, did not make that viable. I had already purchased a 6-port EdgeRouter<\/a> (Which has a local management plane), but was not compatible with the new switch. It is worth mentioning that the EdgeRouter is kick-ass and faster router for the money, albeit something I quickly outgrew for this build. I was able to setup the UISP management software<\/a> on a VM, but I didn’t want have to manage another VM with all the care and feeding needs.<\/p>\r\n\r\n\r\n\r\nESXi Servers<\/h2>\r\n\r\n\r\n\r\n
![\"\"](\"https:\/\/i0.wp.com\/jamesdevine.info\/wp-content\/uploads\/2021\/06\/570713_1-1.jpg?resize=661%2C246&ssl=1\")
<\/figure>\r\n<\/div>\r\n\r\n\r\n\r\nFreeNAS – SAN\/NAS<\/h2>\r\n\r\n\r\n\r\n
![\"\"](\"https:\/\/i0.wp.com\/jamesdevine.info\/wp-content\/uploads\/2021\/06\/freenas-storage-server.jpg?resize=575%2C431&ssl=1\")
<\/figure>\r\n<\/div>\r\n\r\n\r\n\r\nNetwork Overhaul<\/h2>\r\n\r\n\r\n\r\n
![\"\"](\"https:\/\/i0.wp.com\/jamesdevine.info\/wp-content\/uploads\/2021\/07\/vmware-usage.png?resize=270%2C161&ssl=1\")
<\/figure>\r\n<\/div>\r\n","protected":false},"excerpt":{"rendered":"