list of good and bad miniPCIe and PCIe sATA and SAS controller for Linux - Page 1
Forum section: electronics / general

author: DiTBho
author_rank: Super Contributor
timestamp: April 09, 2023, 01:30:33 pm
content: as kind of "hardware aggregator" topic, let's list good and bad HBA

author: DiTBho
author_rank: Super Contributor
timestamp: April 09, 2023, 01:43:06 pm
content: Marvell 88SE9215This chip is a four-port 3/6 Gbps SATA Host Bus Adapter that provides a one-lane PCIe 2.0 interface and sATA,PCIe 2.0 x1 4-port sATA 6 Gb/sand it's available in both miniPCIe and PCIe solutions.On Linux, it only requiresCONFIG_ATACONFIG_SATA_AHCIso it's served bydrivers/ata/ahci.cas class 010601, means it's a common sATA-AHCI HBADoes anyone have any positive/negative experience with this?

author: tunk
author_rank: Super Contributor
timestamp: April 09, 2023, 03:23:22 pm
content: Support for some cards have been removed in RHEL 8 (and I guess 9):https://access.redhat.com/discussions/3722151

author: DiTBho
author_rank: Super Contributor
timestamp: April 11, 2023, 11:08:56 am
content: RAID vs HBA SAS controllers: what's the difference? Which is better?Next question: which HBA is non-x86(1) Linux-friendly?(not easy to answer)(1) { arm, arm64, mips, mips64, hppa, ppc, ppc64 }

author: BradC
author_rank: Super Contributor
timestamp: April 11, 2023, 11:40:32 am
content: Quote from: DiTBho on April 09, 2023, 01:30:33 pmWaste more resources because you're too lazy to use a search engine :https://forums.servethehome.com/index.php?threads/lsi-raid-controller-and-hba-complete-listing-plus-oem-models.599/

author: Ed.Kloonk
author_rank: Super Contributor
timestamp: April 11, 2023, 11:43:21 am
content: Just promise me that you'll confirm that the SATA cable is up to scratch before you deem a controller or driver as dodgy. Otherwise, I don't have a dog in the hunt.

author: DiTBho
author_rank: Super Contributor
timestamp: April 11, 2023, 12:32:22 pm
content: Quote from: Ed.Kloonk on April 11, 2023, 11:43:21 amI am testing several { PCI, PCie, miniPCIe } HBAs on weird GNU/Linux platforms.Spent 15UKP forSilverStone SST-CP11-300premium Low Profile Ultra Thin 90 Degree 6Gb/s SATA bables(yup, 15UKP each cable)

author: Ed.Kloonk
author_rank: Super Contributor
timestamp: April 11, 2023, 12:40:46 pm
content: Hey, big spender.

author: DiTBho
author_rank: Super Contributor
timestamp: April 11, 2023, 12:59:39 pm
content: Thelistof LSI HBA is a nice thing to have, but megaRAID (as well as others, including Marwell') has some quirks and issue with- 64bit kernel PCIe-64bit transactions where not correctly supported (e.g. RPI, ...)- PCI-BAR wants laaaaaaaaaaaaaaaarger sizeneed to buy more HBAs for testing/mastering all of these technologiescrazy, one of my testing machine is thisCode:____________________________| can do hw-RAID || || HBA PPC440 SAS --------- 4x sATA DISK| 512MB ram || 8M flash rtOS ||___ _________________|| || PCIe || ||PCI-to-PCIe |___|______________|_________| || GNU/Linux || software kernel raid || uart| SBC PPC40x || 128MB ram eth0 ------ sshfs| ramrootfs ||___________________________|actually the HBA has more clock, ram, and horse power than the SBCAccepting 20MB/sec, it is enough to run kernel software RAID-{ 0, 1, 5, 6 } without any advanced file-system { ZFS, BTRFS} on it.it does not make any sense, done *** because science ***

author: nomead
author_rank: Contributor
timestamp: April 11, 2023, 01:39:50 pm
content: miniPCIe probably limits the choices to ASMedia and Marvell SATA offerings. As a "dumb" controller ASM1061 seems to work decently on x86.Your setup looks like quite Commodore 64'ish. Mass storage being even smarter than the host.Is that PCI-to-PCIe conversion done with chip from ITE or Pericom?

author: DiTBho
author_rank: Super Contributor
timestamp: April 11, 2023, 02:22:46 pm
content: Quote from: nomead on April 11, 2023, 01:39:50 pmyeah, DeLock has some interesting miniPCIe productsDeLock 95233 -> Asmedia ASM1061 dumb controllerDeLock 95264 -> Asmedia ASM1061R (needs to be re-programmed), offers { SPAN, hw-raid0, hw-raid1 }DeLock 95000 -> Marvell 88SE9215 (needs to be re-programmed) and it has SFF-8087 female connectorcost { 25, 50, 90 } euro: I'm going to buy some samplesQuote from: nomeadPCI-to-PCIe conversion done with chip from ITE ('cause was the first thing found around on eBay)

author: BravoV
author_rank: Super Contributor
timestamp: April 12, 2023, 08:50:23 am
content: Ok, I'm cheap, but I love server's grade stuffs, and luckily I was able to score these babies cheaply, and I got two identical, one as backup for my storage stuffs.Bought used ones, as just can not afford the new one, as each cost a kidney.Its Dell PERC H730 1GB cache with on board battery backup RAID controller, 8 ports 12Gbps PCI Express (PCIe) supporting 3Gbps, 6Gbps and 12Gbps SAS or SATA hard-disk or solid-state drives.

author: DiTBho
author_rank: Super Contributor
timestamp: April 12, 2023, 10:10:08 am
content: Quote from: BravoV on April 12, 2023, 08:50:23 amI think something similar, brand new, costs in the range 1200-1500 eurothere are some suspiciouslytoo-cheapcontrollers on Aliexpress and eBay/China for 50-100 euro (WHAT?!?)but, if no matter how you get your RAID controller and how much you pay for it: will the Linux kernel v6 able to manage the "hardware RAID" engine on non-x86 machines?This is the main question ... and usually the answer is ...noOn { HPPA, MIPS, PPC, SH } you can't use the x86-BIOS-extension mechanism, therefore the MEGA-RAID cannot use re-configuring functions, written in x86 assembly.When you are lucky, you can temporarily plug the card into a x86 Windows/Linux SBC to make good use of the BIOS extension mechanism and re-configure the controller. Usually a text interface appears during booting, and you can scroll and press the enter-key or space-bar to confirm settings.This, if and only if, there is a NVRAM able to keep the configuration, the battery is OK and the controller doesn't need to automatically reset the NVRAM if it doesn't find an x86-BIOS-extension environment.plus, sometimes you also get GNU/Linux x86{32, 64}bit binaries as RAID utilities to run-time interact with the controller.Two possible solutionsadd an x86 emulator in userspace with a door opened in kernel space to execute such a x86 codereverse engineer the MEGA-RAID BIOS-extension and x86-utilities to understand which/how registers you have to configurewhy is life so complex?

author: alm
author_rank: Super Contributor
timestamp: April 12, 2023, 10:30:40 am
content: You should be able to find hardware RAID controllers for cheap. Server CPUs have gotten so powerful that there's little performance benefit, and storage technology has moved on from the old RAID levels. For large scale storage people use ZFS, and for performance they use PCIe SSDs. That doesn't leave much room for hardware RAID.How are you going to boot from these controllers if you can't run their BIOS?

author: DiTBho
author_rank: Super Contributor
timestamp: April 12, 2023, 12:04:41 pm
content: Quote from: alm on April 12, 2023, 10:30:40 amCode:. |--------|| || config || ||--------|| |swhw_reset --->| |---+|routines| |exceptions --->| | || | ||--------| || |<--+| u-Boot || |---+|--------| || | || |<--+| kernel || |-------> load(ramroots,CF0)-----> /sbin/init -> { boot-scripts { kernel drivers }, { Apps } }|--------|ROM{0,3}my hw doesn't to boot from the HBA. The kernel is loaded from the ROM (flash, 16MByte), while the rootfs is loaded from a CompactFlash (32Mbyte, MUSL-stripped), and, once in running in ram, the kernel can load the HBA kernel module, etc ...Currently the best result has been obtained with a four channel SIL PCI-HBA, without any BIOS extension, so it is pure kernel software RAID.PCIe-HBAs add more complexity for me, and my MEGA raid controller has been lobotomized and re-programmed - getting rid of 90% of its firmware - to act as a dumb HBA.Which is ... pure shame, but at least it works ... just, I still cannot make good use of its large 512 Mbyte ram, which is mostly (only 8 of 512 Mbyte used) unused with the controller in "dumb" mode, but I am trying to re-map it as system ram so I could "expand" the limited physical ram I have on the PPC40x SBC.I feel it as frustrating waste of precious resources, which, as much as I try to come up with tricks ... I haven't succeeded yet to make good use.---The other test machines are native PCIe with 8 Gbytes of RAM, 1.1Ghz CPU, and boot from a SCSI disk. Again the sATA HBA kernel driver is loaded by a userspace script once the kernel is already booted and running.

author: BravoV
author_rank: Super Contributor
timestamp: April 13, 2023, 06:58:05 am
content: Quote from: DiTBho on April 12, 2023, 10:10:08 amYep, its expensive when new.I got mine both for about < $250, and it was quite an effort and needed some detective works involved, like querying/phone calling at local companies that do computer's scrap, as these kind of server stuffs most were write off from big companies, like those banks, and this kind of controller usually used in small or mid sized server, used in branches, and once the company did a periodic so called technology refresh, these stuff are usually thrown away as scraps.As I said, to procure this kind of stuffs, needs some effort, at least for me here locally.Quote from: DiTBho on April 12, 2023, 10:10:08 amSorry, can't offer much help here on non x-86 machines, as I use it in x86 platform.