Main Page: Difference between revisions

From Jeremy Bryan Smith
Jump to navigation Jump to search
No edit summary
 
(37 intermediate revisions by the same user not shown)
Line 5: Line 5:
<br>
<br>


== Find Me On ==
* [https://noc.social/@helamonster Mastodon]
* [https://github.com/helamonster Github]
* [https://www.linkedin.com/in/helamonster/ Linked In]
* [https://www.reddit.com/user/mr_helamonster Reddit]
* [https://twitter.com/helamonster Twitter]
* [https://www.facebook.com/helamonster/notes Facebook]
* [https://www.instagram.com/mr_helamonster/ Instagram]
* [https://www.youtube.com/c/JeremySmithBryan YouTube] - See my playlists
* [https://open.spotify.com/user/1277771794 Spotify] - See my playlists
==[[Veganism]]==
==Green Living==
===Air===
TODO: Add air filtration stuff here...
===Water===
You can never trust your municipal water supply. Nor can you trust that any source of water (including bottled) has not been contaminated. Do not drink unfiltered tap water. Just don't.
<br>
<br>
I have used a reverse osmosis water filter system since 2014 and have never looked back. The one I happened to have purchased was the:<br> [https://www.amazon.com/gp/product/B005A3WM6C/ref=ppx_yo_dt_b_search_asin_title?ie=UTF8&psc=1 Home Master TMAFC Artesian Full Contact Undersink Reverse Osmosis Water Filter System]
<br>
<br>
And the following replacement filters:<br>
* [https://www.amazon.com/gp/product/B07BPX8K5K/ref=ppx_yo_dt_b_search_asin_title?ie=UTF8&psc=1 Membrane Solutions 75 GPD Reverse Osmosis Membrane]
* [https://www.amazon.com/gp/product/B005A3WNWK/ref=ppx_yo_dt_b_search_asin_title?ie=UTF8&psc=1 Home Master ISetTMA8 Artesian And HydroGardener Replacement Water Filter Change Set]
Along with this UV sterilizer:<br>
[https://www.amazon.com/gp/product/B0110LTT1I/ref=ppx_yo_dt_b_search_asin_title?ie=UTF8&psc=1 Bluonics Ultraviolet Light Water Purifier UV Sterilizer]
Super easy to install and  maintain. I removed the tank once the bladder was no longer holding water and instead attached it to an ice maker:<br>
[https://www.amazon.com/gp/product/B0B3DH6S9D/ref=ppx_yo_dt_b_search_asin_title?ie=UTF8&psc=1 Countertop Hot & Cold Water Dispenser and Ice Maker]
===Composting===
I use this: [https://www.amazon.com/gp/product/B0121G9ZJW/ref=as_li_tl?ie=UTF8&camp=1789&creative=9325&creativeASIN=B0121G9ZJW&linkCode=as2&tag=highandlowtec-20&linkId=a27cf44c5167bf80b590bf96a469739d Envirocycle USA-made, Food Safe, BPA and Rust Free Composting Tumbler and Compost Tea Maker]
{{Special:IframePage|AmazonAffiliate|path=widgets/q?ServiceVersion=20070822&OneJS=1&Operation=GetAdHtml&MarketPlace=US&source=ac&ref=tf_til&ad_type=product_link&tracking_id=highandlowtec-20&marketplace=amazon&region=US&placement=B0121G9ZJW&asins=B0121G9ZJW&linkId=4312303f6850d7bdc370558b69a34599&show_border=false&link_opens_in_new_window=false&price_color=333333&title_color=0066c0&bg_color=ffffff}}


== Technology ==
== Technology ==
===Random===
At some point I will organize this stuff better.
* [[Booting via GRUB 2 prompt]]
* [[Simulating keystrokes from clipboard]]
* [[Making Block Devices Read Only]]


===Applications and Plug-ins===
===Applications and Plug-ins===
Line 14: Line 60:


===Devices===
===Devices===
* [[Samsung Galaxy Note 3]]
* Cars
* [[Samsung Galaxy Tab S 10.5]]
** 2012 Toyota / Scion XB
* [[Motorola Backflip (MB300)]]
* Televisions
* [[APC Smart UPS]]
** [[Seiki Digital SE50UY04 50-Inch 4K UHD 120Hz LED HDTV]]
* [[Toshiba Qosmio G35-AV660]]
** [https://www.lg.com/us/tvs/lg-oled55cxpua-oled-4k-tv LG OLED55CXPUA 55" Class HDR 4K UHD Smart OLED TV (2020 Model)]
* [[Dell Latitude E6430s]]
 
* [[Sierra Wireless AirCard 313U]]
* Smart Phones
* [[LSI SAS HBA]]
** [[Samsung Galaxy Note 3]]
* [[Lantronix SpiderDuo]] - Single port KVM over IP with USB mass storage
** [[Samsung Galaxy Tab S 10.5]]
* [[Asus DisplayLink 2 External USB 3 Monitor]] x 2
** [[Motorola Backflip (MB300)]]
* [[Google Pixelbook (eve)]]
** [[Google Pixel Phone]]
* [[Google Pixel Phone]]
** [[Google Pixel 2 XL Phone]]
* [[Google Pixel 2 XL Phone]]
 
* [[HPE Proliant MicroServer Gen10]]
* Tablets
** [[Samsung Galaxy Tab S 10.5" (SM-T800)]]
 
* eReaders
** [[Kindle Paperwhite E-reader (7th Generation)]]
 
* HTPCs
** [[MAGNUS EN1080 10 Year Anniversary Edition (ZBOX-EN1080)]]
 
* Modems
** TP-LINK TC-7620 DOCSIS 3.0 cable modem
* Servers
** [[HPE Proliant MicroServer Gen10]]
** [[Dell PowerEdge R720]]
 
* SoCs
** [[Intel Compute Stick STK1AW32SC]]
** [[Raspberry Pi]]
** [[Minnowboard Max]]
 
* Notebooks
** [[Toshiba Qosmio G35-AV660]]
** [[Dell Latitude E6430s]]
** [[Lenovo Thinkpad X1 Extreme Gen 2]]
** [[Google Pixelbook (eve)]]
 
* Monitors / Displays
** 2 x [[Asus DisplayLink 2 External USB 3 Monitor]]
** 2 x [[ACHIEVA Shimian QH270-Lite Quad HD 2560x1440 Monitor]]
** [https://epson.com/For-Home/Projectors/Home-Cinema/PowerLite-Home-Cinema-1080-UB-Projector/p/V11H262120 Epson EPPLHC1080UB PowerLite Home Cinema 1080 UB Projector]
 
* Power
** [[APC Smart UPS]]
** [[APC Smart-UPS SRT 2200VA 230V and APC Smart-UPS SRT 72V 2.2kVA Battery Pack]]
 
* Sound
** [[Logitech Z-5500 THX-Certified 5.1 Digital Surround Sound Speaker System]]
 
* Cameras
** [[Canon PowerShot G9]]
** Raspberry PI 5MP Camera Board Module
** Raspberry Pi HQ Camera Module
** Arducam Day and Night Vision IMX477 HQ Camera
** Logitech HD Pro Webcam C920 (960-000764)
** LOGITECH QUICKCAM PRO 9000 R Webcam
** [[Logitech Quickcam Express]]
 
* Home Appliances
** [[Tap Master TMAFC Artesian Full Contact Reverse Osmosis Under Counter Water Filtration System]]
 
* Network
** [[SG-4860 pfSense® Security Gateway Appliance]]
** [[Protectli FW6D]] x 2
 
* Printers
** [[Canon MP-160]] All-in-one scanner, copier, printer
 
* Misc
** [http://www.istarusa.com/en/istarusa/products.php?model=WNG-1810 iStarUSA WNG-1810 18U 1000mm Depth Rack-mount Server Cabinet]
** [[Sierra Wireless AirCard 313U]]
** [[LSI SAS HBA]]
** [[Lantronix SpiderDuo]] - Single port KVM over IP with USB mass storage
** [[Apple iPod Shuffle 1st Gen/White 512 MB, Model A1112]]
** [[Chicony Saitek Eclipse II Keyboard]]
** [[GeForce 9500 GT]]
** [[GeForce GTX 550 Ti]]
** [[Snapmaker 2.0 Modular 3-in-1 3D Printer]]


===Software===
===Software===
* [[Web Browsers]]
* [[Web Browsers]]
* [[Configuration Management]]
* [[Configuration Management]]
* [[Boot-Related Tools]]


===Programming===
===Programming===
Line 49: Line 162:


===Storage===
===Storage===
====RAID====
=====From Hardware to Software=====
If you've ever been forced to use hardware RAID and then need to migrate from hardware RAID to software RAID ...
<br>
I had 6 disks behind a Dell PERC 6/i hardware RAID controller and wanted to set up a ZFS pool. But for reasons beyond my control at the time, changing out the controller for a proper HBA was not an option. So, I did the unthinkable and configured 6 RAID-0 devices on the PERC controller, one for each physical disk, and then created a zpool from the virtual disks the controller exposed to the OS. It worked well enough for my purposes for years, but now I have the ability to swap in a real HBA. But the question is, do I have to copy all of the data off, swap the controller, then copy all data back? I was surprised to discover that the data on the disks, with the exception of a small section of metadata at the end of each disk, was in-tact just as if the disks were being used directly. In fact, the metadata was in Linux MDADM RAID format! So that must be what those PERC controllers are doing behind the scene. No surprise there, taking advantage of open source. I wonder if they are violating the GPL. I'll have to look at the firmware. Anyway, This may only work if you configured each disk as a RAID-0. I haven't tested other configurations yet.
<br>
Resources:
* [https://raid.wiki.kernel.org/index.php/Linux_Raid Linux RAID Wiki]
** [https://raid.wiki.kernel.org/index.php/DDF_Fake_RAID DDF Fake RAID]
** [https://raid.wiki.kernel.org/index.php/RAID_setup RAID Setup]
<br>
This is what I saw:
<span style="font-weight:bold; user-select:none">root@ubuntu-server:~#</span> lsblk --nodeps -I 8 -o name,maj:min,rm,size,ro,type,pttype,ptuuid,fstype,uuid,label,model,vendor
<span style="color:#909090">NAME MAJ:MIN RM  SIZE RO TYPE PTTYPE PTUUID                              FSTYPE          UUID                                LABEL MODEL            VENDOR
sda    8:0    0 232.9G  0 disk gpt    5ace5e66-37f2-4d44-b518-f2a22834c3ab                                                            Samsung_SSD_860  ATA   
sdb    8:16  1  29.3G  0 disk dos    e16cd6ae                                                                                        Cruzer_Glide    SanDisk
sdc    8:32  0 465.8G  0 disk                                            ddf_raid_member Dell    \x10                              ST9500530NS      ATA   
sdd    8:48  0 465.8G  0 disk                                            ddf_raid_member Dell    \x10                              ST9500530NS      ATA   
sde    8:64  0 465.8G  0 disk                                            ddf_raid_member Dell    \x10                              ST9500530NS      ATA   
sdf    8:80  0 465.8G  0 disk                                            ddf_raid_member Dell    \x10                              ST9500530NS      ATA   
sdg    8:96  0 465.8G  0 disk                                            ddf_raid_member Dell    \x10                              ST9500530NS      ATA   
sdh    8:112  0 465.8G  0 disk                                            ddf_raid_member Dell    \x10                              ST9500530NS      ATA   
sdi    8:128  1 235.8G  0 disk dos    be730627                                                                                        Voyager_SliderX2 Corsair
sdj    8:144  0  3.7T  0 disk gpt    b5dcd625-9112-4f29-9b67-64e935bf15b3                                                            My_Passport_25E2 WD     
sdk    8:160  0  3.7T  0 disk gpt    31d5cc46-33c7-4806-80a6-57aaba69b38e                                                            My_Passport_25E2 WD     
sdl    8:176  1  58.9G  0 disk dos    d02d781a                            zfs_member      17764476958699951102                upool Voyager_SliderX2 Corsair
sdm    8:192  1  58.9G  0 disk dos    642fafbd                            zfs_member      12354630986627173815                upool Voyager_SliderX2 Corsair
sdn    8:208  1  118G  0 disk dos    604144b7                                                                                        Voyager_SliderX2 Corsair
sdo    8:224  1  118G  0 disk dos    8f6dbdcd                                                                                        Voyager_SliderX2 Corsair
sdp    8:240  1 116.5G  0 disk dos                                                                                                    Cruzer_Glide    SanDisk
</span>
You can see the 6 500GB disks as well as a few USB drives attached. We'll ignore those and list any Linux RAID devices...
<span style="font-weight:bold; user-select:none">root@ubuntu-server:~#</span> mdadm --query /dev/sd{c,d,e,f,g,h}
<span style="color:#909090">/dev/sdc: is not an md array
/dev/sdc: device -1393767213 in 6 device undetected container /dev/md/ddf0.  Use mdadm --examine for more detail.
/dev/sdd: is not an md array
/dev/sdd: device -1811426553 in 6 device undetected container /dev/md/ddf0.  Use mdadm --examine for more detail.
/dev/sde: is not an md array
/dev/sde: device 764605963 in 6 device undetected container /dev/md/ddf0.  Use mdadm --examine for more detail.
/dev/sdf: is not an md array
/dev/sdf: device 1584381922 in 6 device undetected container /dev/md/ddf0.  Use mdadm --examine for more detail.
/dev/sdg: is not an md array
/dev/sdg: device 896654598 in 6 device undetected container /dev/md/ddf0.  Use mdadm --examine for more detail.
/dev/sdh: is not an md array
/dev/sdh: device -2108342859 in 6 device undetected container /dev/md/ddf0.  Use mdadm --examine for more detail.
</span>
Hmm, not quite right, let's try dmraid ...
<span style="font-weight:bold; user-select:none">root@ubuntu-server:~#</span>root@ubuntu-server:~# dmraid -r
<span style="color:#909090">/dev/sdh: ddf1, ".ddf1_disks", GROUP, ok, 975699968 sectors, data@ 0
/dev/sdc: ddf1, ".ddf1_disks", GROUP, ok, 975699968 sectors, data@ 0
/dev/sde: ddf1, ".ddf1_disks", GROUP, ok, 975699968 sectors, data@ 0
/dev/sdg: ddf1, ".ddf1_disks", GROUP, ok, 975699968 sectors, data@ 0
/dev/sdd: ddf1, ".ddf1_disks", GROUP, ok, 975699968 sectors, data@ 0
/dev/sdf: ddf1, ".ddf1_disks", GROUP, ok, 975699968 sectors, data@ 0
</span>
We see that the Ok, now let's inspect one of those disks' partition table...
<span style="font-weight:bold; user-select:none">root@ubuntu-server:~#</span> parted /dev/sdg unit b p
<span style="color:#909090">Warning: Not all of the space available to /dev/sdg appears to be used, you can fix the GPT to use all of the space (an extra 1073200 blocks) or continue with the current setting?
Fix/Ignore? Ignore                                                       
Model: ATA ST9500530NS (scsi)
Disk /dev/sdg: 500107862016B
Sector size (logical/physical): 512B/512B
Partition Table: gpt
Disk Flags:
Number  Start      End            Size          File system  Name      Flags
  1      1048576B  9437183B      8388608B                    Reserved
  2      10485760B  18874367B      8388608B                    GRUB      bios_grub
  3      20971520B  499558366719B  499537395200B  zfs          ZFS
</span>
Let's step back and take a look at how the disks, partitions, and RAID devices are related ...
<span style="font-weight:bold; user-select:none"> lsblk -I 8,9 -o name,maj:min,size,type /dev/sdg
<span style="color:#909090"> NAME        MAJ:MIN  SIZE TYPE
sdg          8:96  465.8G disk
|-sdg1        8:97      8M part
|-sdg2        8:98      8M part
|-sdg3        8:99  465.2G part
`-md125      9:125 465.3G raid0
  |-md125p1 259:3      8M part
  |-md125p2 259:4      8M part
  `-md125p3 259:5  465.2G part
</span>
Inspecting the corresponding MDADM RAID(s):
<span style="font-weight:bold; user-select:none">root@ubuntu-server:~#</span> grep sdg /proc/mdstat
<span style="color:#909090">md125 : active raid0 sdg[0]
md127 : inactive sdf[5](S) sdh[4](S) sde[3](S) sdd[2](S) sdg[1](S) sdc[0](S)
</span>
<span style="font-weight:bold; user-select:none">root@ubuntu-server:~#</span> mdadm --detail /dev/md125
<span style="color:#909090">/dev/md125:
          Container : /dev/md/ddf0, member 0
        Raid Level : raid0
        Array Size : 487849984 (465.25 GiB 499.56 GB)
      Raid Devices : 1
      Total Devices : 1
              State : clean
    Active Devices : 1
    Working Devices : 1
    Failed Devices : 0
      Spare Devices : 0
        Chunk Size : 128K
Consistency Policy : none
    Container GUID : 44656C6C:20202020:10000079:10281F17:4B825EED:49CB41EA
                  (Dell    02/22/20 10:39:41)
                Seq : 00000004
      Virtual Disks : 6
    Number  Major  Minor  RaidDevice State
        0      8      96        0      active sync  /dev/sdg
</span>
<span style="font-weight:bold; user-select:none">root@ubuntu-server:~#</span> mdadm --detail /dev/md127
<span style="color:#909090">/dev/md127:
            Version : ddf
        Raid Level : container
      Total Devices : 6
    Working Devices : 6
    Container GUID : 44656C6C:20202020:10000079:10281F17:4B825EED:49CB41EA
                  (Dell    02/22/20 10:39:41)
                Seq : 00000004
      Virtual Disks : 6
      Member Arrays : /dev/md/disk1_0 /dev/md/disk5_0 /dev/md/disk3_0 /dev/md/disk4_0 /dev/md/disk2_0 /dev/md122
    Number  Major  Minor  RaidDevice
        -      8      64        -        /dev/sde
        -      8      32        -        /dev/sdc
        -      8      112        -        /dev/sdh
        -      8      80        -        /dev/sdf
        -      8      48        -        /dev/sdd
        -      8      96        -        /dev/sdg
</span>
And the partitions on the RAID device itself:
<span style="font-weight:bold; user-select:none">root@ubuntu-server:~#</span> parted /dev/md125 unit b p
<span style="color:#909090">Model: Linux Software RAID Array (md)
Disk /dev/md125: 499558383616B
Sector size (logical/physical): 512B/512B
Partition Table: gpt
Disk Flags:
Number  Start      End            Size          File system  Name      Flags
  1      1048576B  9437183B      8388608B                    Reserved
  2      10485760B  18874367B      8388608B                    GRUB      bios_grub
  3      20971520B  499558366719B  499537395200B  zfs          ZFS
</span>
So, capacity of the disk itself is 500,107,862,016 bytes and the capacity of the RAID-0 device presented is 499,558,383,616 bytes.<br>
So, there is 500,107,862,016 - 499,558,383,616 = 549,478,400 bytes / 1024 = 536,600 KiB / 1024 = 524.0234375 MiB used up by the MDADM RAID signature at the end of the disk.<br>
Cool! So, can we just zero out that mdadm signature and use the disks normally? Let's see...
====Controllers====
====Controllers====
See Serve the Home's [https://www.servethehome.com/buyers-guides/top-hardware-components-freenas-nas-servers/top-picks-freenas-hbas/ Top Picks for FreeNAS HBAs] for a good overview.<br>
See Serve the Home's [https://www.servethehome.com/buyers-guides/top-hardware-components-freenas-nas-servers/top-picks-freenas-hbas/ Top Picks for FreeNAS HBAs] for a good overview.<br>
Line 84: Line 359:
* [[VPNs]] - Virtual Private Networks
* [[VPNs]] - Virtual Private Networks
* [[TCP over DNS]] - Bypass Wifi logins to get internet access
* [[TCP over DNS]] - Bypass Wifi logins to get internet access
* [[Terminals]] - Tips and tricks for shells


=== Security/Privacy ===
=== Security/Privacy ===
Line 106: Line 382:
== Lists ==
== Lists ==
* [[Travel]] - Lists for things to do before and things to bring when travelling.
* [[Travel]] - Lists for things to do before and things to bring when travelling.
* [[Playlists]] - Playlists of music, movies, etc.

Latest revision as of 09:03, 30 December 2023

Welcome to the Wiki of Jeremy Bryan Smith. Here I shall disseminate knowledge that I deem important enough that I may need to recall at a later point in time and/or that I believe may be useful for others out there.
Feel free to poke around, make comments, suggestions, and ingest the bits of information I have to share.

Regards,
Jeremy Bryan Smith


Find Me On

Veganism

Green Living

Air

TODO: Add air filtration stuff here...

Water

You can never trust your municipal water supply. Nor can you trust that any source of water (including bottled) has not been contaminated. Do not drink unfiltered tap water. Just don't.

I have used a reverse osmosis water filter system since 2014 and have never looked back. The one I happened to have purchased was the:
Home Master TMAFC Artesian Full Contact Undersink Reverse Osmosis Water Filter System

And the following replacement filters:

Along with this UV sterilizer:
Bluonics Ultraviolet Light Water Purifier UV Sterilizer

Super easy to install and maintain. I removed the tank once the bladder was no longer holding water and instead attached it to an ice maker:
Countertop Hot & Cold Water Dispenser and Ice Maker

Composting

I use this: Envirocycle USA-made, Food Safe, BPA and Rust Free Composting Tumbler and Compost Tea Maker

Special:IframePage

Technology

Random

At some point I will organize this stuff better.

Applications and Plug-ins

Here I will provide my opinions, recommendations on usage and optimal configuration, links to related third-party tools, and my own related tools

  • Web Browsers - The web browsers and related extensions / plug-ins, and tweaks for usability and security, etc. that I recommend
  • vim - My text editor of choice

Devices

  • Cameras
    • Canon PowerShot G9
    • Raspberry PI 5MP Camera Board Module
    • Raspberry Pi HQ Camera Module
    • Arducam Day and Night Vision IMX477 HQ Camera
    • Logitech HD Pro Webcam C920 (960-000764)
    • LOGITECH QUICKCAM PRO 9000 R Webcam
    • Logitech Quickcam Express

Software

Programming

Android

Microsoft Windows

E-mail

Storage

RAID

From Hardware to Software

If you've ever been forced to use hardware RAID and then need to migrate from hardware RAID to software RAID ...
I had 6 disks behind a Dell PERC 6/i hardware RAID controller and wanted to set up a ZFS pool. But for reasons beyond my control at the time, changing out the controller for a proper HBA was not an option. So, I did the unthinkable and configured 6 RAID-0 devices on the PERC controller, one for each physical disk, and then created a zpool from the virtual disks the controller exposed to the OS. It worked well enough for my purposes for years, but now I have the ability to swap in a real HBA. But the question is, do I have to copy all of the data off, swap the controller, then copy all data back? I was surprised to discover that the data on the disks, with the exception of a small section of metadata at the end of each disk, was in-tact just as if the disks were being used directly. In fact, the metadata was in Linux MDADM RAID format! So that must be what those PERC controllers are doing behind the scene. No surprise there, taking advantage of open source. I wonder if they are violating the GPL. I'll have to look at the firmware. Anyway, This may only work if you configured each disk as a RAID-0. I haven't tested other configurations yet.
Resources:


This is what I saw:

root@ubuntu-server:~# lsblk --nodeps -I 8 -o name,maj:min,rm,size,ro,type,pttype,ptuuid,fstype,uuid,label,model,vendor
NAME MAJ:MIN RM   SIZE RO TYPE PTTYPE PTUUID                               FSTYPE          UUID                                 LABEL MODEL            VENDOR
sda    8:0    0 232.9G  0 disk gpt    5ace5e66-37f2-4d44-b518-f2a22834c3ab                                                            Samsung_SSD_860  ATA     
sdb    8:16   1  29.3G  0 disk dos    e16cd6ae                                                                                        Cruzer_Glide     SanDisk 
sdc    8:32   0 465.8G  0 disk                                             ddf_raid_member Dell    \x10                               ST9500530NS      ATA     
sdd    8:48   0 465.8G  0 disk                                             ddf_raid_member Dell    \x10                               ST9500530NS      ATA     
sde    8:64   0 465.8G  0 disk                                             ddf_raid_member Dell    \x10                               ST9500530NS      ATA     
sdf    8:80   0 465.8G  0 disk                                             ddf_raid_member Dell    \x10                               ST9500530NS      ATA     
sdg    8:96   0 465.8G  0 disk                                             ddf_raid_member Dell    \x10                               ST9500530NS      ATA     
sdh    8:112  0 465.8G  0 disk                                             ddf_raid_member Dell    \x10                               ST9500530NS      ATA     
sdi    8:128  1 235.8G  0 disk dos    be730627                                                                                        Voyager_SliderX2 Corsair 
sdj    8:144  0   3.7T  0 disk gpt    b5dcd625-9112-4f29-9b67-64e935bf15b3                                                            My_Passport_25E2 WD      
sdk    8:160  0   3.7T  0 disk gpt    31d5cc46-33c7-4806-80a6-57aaba69b38e                                                            My_Passport_25E2 WD      
sdl    8:176  1  58.9G  0 disk dos    d02d781a                             zfs_member      17764476958699951102                 upool Voyager_SliderX2 Corsair 
sdm    8:192  1  58.9G  0 disk dos    642fafbd                             zfs_member      12354630986627173815                 upool Voyager_SliderX2 Corsair 
sdn    8:208  1   118G  0 disk dos    604144b7                                                                                        Voyager_SliderX2 Corsair 
sdo    8:224  1   118G  0 disk dos    8f6dbdcd                                                                                        Voyager_SliderX2 Corsair 
sdp    8:240  1 116.5G  0 disk dos                                                                                                    Cruzer_Glide     SanDisk 

You can see the 6 500GB disks as well as a few USB drives attached. We'll ignore those and list any Linux RAID devices...

root@ubuntu-server:~# mdadm --query /dev/sd{c,d,e,f,g,h}
/dev/sdc: is not an md array
/dev/sdc: device -1393767213 in 6 device undetected container /dev/md/ddf0.  Use mdadm --examine for more detail.
/dev/sdd: is not an md array
/dev/sdd: device -1811426553 in 6 device undetected container /dev/md/ddf0.  Use mdadm --examine for more detail.
/dev/sde: is not an md array
/dev/sde: device 764605963 in 6 device undetected container /dev/md/ddf0.  Use mdadm --examine for more detail.
/dev/sdf: is not an md array
/dev/sdf: device 1584381922 in 6 device undetected container /dev/md/ddf0.  Use mdadm --examine for more detail.
/dev/sdg: is not an md array
/dev/sdg: device 896654598 in 6 device undetected container /dev/md/ddf0.  Use mdadm --examine for more detail.
/dev/sdh: is not an md array
/dev/sdh: device -2108342859 in 6 device undetected container /dev/md/ddf0.  Use mdadm --examine for more detail. 

Hmm, not quite right, let's try dmraid ...

root@ubuntu-server:~#root@ubuntu-server:~# dmraid -r
/dev/sdh: ddf1, ".ddf1_disks", GROUP, ok, 975699968 sectors, data@ 0
/dev/sdc: ddf1, ".ddf1_disks", GROUP, ok, 975699968 sectors, data@ 0
/dev/sde: ddf1, ".ddf1_disks", GROUP, ok, 975699968 sectors, data@ 0
/dev/sdg: ddf1, ".ddf1_disks", GROUP, ok, 975699968 sectors, data@ 0
/dev/sdd: ddf1, ".ddf1_disks", GROUP, ok, 975699968 sectors, data@ 0
/dev/sdf: ddf1, ".ddf1_disks", GROUP, ok, 975699968 sectors, data@ 0

We see that the Ok, now let's inspect one of those disks' partition table...

root@ubuntu-server:~# parted /dev/sdg unit b p
Warning: Not all of the space available to /dev/sdg appears to be used, you can fix the GPT to use all of the space (an extra 1073200 blocks) or continue with the current setting? 
Fix/Ignore? Ignore                                                        
Model: ATA ST9500530NS (scsi)
Disk /dev/sdg: 500107862016B
Sector size (logical/physical): 512B/512B
Partition Table: gpt
Disk Flags: 

Number  Start      End            Size           File system  Name      Flags
 1      1048576B   9437183B       8388608B                    Reserved
 2      10485760B  18874367B      8388608B                    GRUB      bios_grub
 3      20971520B  499558366719B  499537395200B  zfs          ZFS

Let's step back and take a look at how the disks, partitions, and RAID devices are related ...

 lsblk -I 8,9 -o name,maj:min,size,type /dev/sdg
 NAME        MAJ:MIN   SIZE TYPE
sdg           8:96  465.8G disk
|-sdg1        8:97      8M part
|-sdg2        8:98      8M part
|-sdg3        8:99  465.2G part
`-md125       9:125 465.3G raid0
  |-md125p1 259:3       8M part
  |-md125p2 259:4       8M part
  `-md125p3 259:5   465.2G part

Inspecting the corresponding MDADM RAID(s):

root@ubuntu-server:~# grep sdg /proc/mdstat 
md125 : active raid0 sdg[0]
md127 : inactive sdf[5](S) sdh[4](S) sde[3](S) sdd[2](S) sdg[1](S) sdc[0](S)

root@ubuntu-server:~# mdadm --detail /dev/md125
/dev/md125:
         Container : /dev/md/ddf0, member 0
        Raid Level : raid0
        Array Size : 487849984 (465.25 GiB 499.56 GB)
      Raid Devices : 1
     Total Devices : 1

             State : clean 
    Active Devices : 1
   Working Devices : 1
    Failed Devices : 0
     Spare Devices : 0

        Chunk Size : 128K

Consistency Policy : none

    Container GUID : 44656C6C:20202020:10000079:10281F17:4B825EED:49CB41EA
                  (Dell     02/22/20 10:39:41)
               Seq : 00000004
     Virtual Disks : 6

    Number   Major   Minor   RaidDevice State
       0       8       96        0      active sync   /dev/sdg

root@ubuntu-server:~# mdadm --detail /dev/md127
/dev/md127:
           Version : ddf
        Raid Level : container
     Total Devices : 6

   Working Devices : 6

    Container GUID : 44656C6C:20202020:10000079:10281F17:4B825EED:49CB41EA
                  (Dell     02/22/20 10:39:41)
               Seq : 00000004
     Virtual Disks : 6

     Member Arrays : /dev/md/disk1_0 /dev/md/disk5_0 /dev/md/disk3_0 /dev/md/disk4_0 /dev/md/disk2_0 /dev/md122

    Number   Major   Minor   RaidDevice

       -       8       64        -        /dev/sde
       -       8       32        -        /dev/sdc
       -       8      112        -        /dev/sdh
       -       8       80        -        /dev/sdf
       -       8       48        -        /dev/sdd
       -       8       96        -        /dev/sdg

And the partitions on the RAID device itself:

root@ubuntu-server:~# parted /dev/md125 unit b p
Model: Linux Software RAID Array (md)
Disk /dev/md125: 499558383616B
Sector size (logical/physical): 512B/512B
Partition Table: gpt
Disk Flags: 

Number  Start      End            Size           File system  Name      Flags
 1      1048576B   9437183B       8388608B                    Reserved
 2      10485760B  18874367B      8388608B                    GRUB      bios_grub
 3      20971520B  499558366719B  499537395200B  zfs          ZFS

So, capacity of the disk itself is 500,107,862,016 bytes and the capacity of the RAID-0 device presented is 499,558,383,616 bytes.
So, there is 500,107,862,016 - 499,558,383,616 = 549,478,400 bytes / 1024 = 536,600 KiB / 1024 = 524.0234375 MiB used up by the MDADM RAID signature at the end of the disk.
Cool! So, can we just zero out that mdadm signature and use the disks normally? Let's see...

Controllers

See Serve the Home's Top Picks for FreeNAS HBAs for a good overview.
Basically:

  • Stay away from hardware RAID
  • There are a few RAID cards that can be flashed to IT mode to support proper HBA (passthrough/JBOD) mode.
  • There are many re-branded / OEM versions that should also work fine (Dell, IBM)
  • There are many being sold used

Check these out:

  • Internal
    • LSI SAS HBA 9201-8i: 8 port, SATA III, 6 Gbps, ~ $40 - $50 USD on ebay as of 2020-03-02
      Good replacement for PERC 6/i
    • IBM M1015 (LSI 9220-8i): 8 port, SATA III, 6 Gbps,
    • Dell H200: 8 port, SATA III, 6 Gbps, $30 - $40 USD on ebay as of 2020-03-02
      Good replacement for PERC 6/i
  • External

Filesystems

Data Integrity

Storage Analysis

Misc

Security/Privacy

Admirable People

Life Lessons

Lists

  • Travel - Lists for things to do before and things to bring when travelling.
  • Playlists - Playlists of music, movies, etc.