[elrepo] Support for older Mellanox network cards in RHEL 8.

Thu Apr 16 15:58:57 EDT 2020

Hi All,

If I may I second the request. We also use Connectx-2 (QDR Infiniband). I believe they have sam driver with the 10GE cards, mlnx4 . Thats what we use:

08:00.0 InfiniBand [0c06]: Mellanox Technologies MT25408A0-FCC-QI ConnectX, Dual Port 40Gb/s InfiniBand / 10GigE Adapter IC with PCIe 2.0 x8 5.0GT/s In... (rev a0)

--
Grigory Shamov
WestGrid Site Lead / HPC Specialist
University of Manitoba
E2-588 EITC Building,
(204) 474-9625

From: <elrepo-bounces at lists.elrepo.org<mailto:elrepo-bounces at lists.elrepo.org>> on behalf of Jeremy Reben <jeremy.reben at gmail.com<mailto:jeremy.reben at gmail.com>>
Reply-To: EL Repo General Mailing List <elrepo at lists.elrepo.org<mailto:elrepo at lists.elrepo.org>>
Date: Thursday, April 16, 2020 at 1:59 PM
To: EL Repo General Mailing List <elrepo at lists.elrepo.org<mailto:elrepo at lists.elrepo.org>>
Subject: Re: [elrepo] Support for older Mellanox network cards in RHEL 8.

Caution: This message was sent from outside the University of Manitoba.

0d:00.0 Ethernet controller [0200]: Mellanox Technologies MT26448 [ConnectX EN 10GigE, PCIe 2.0 5GT/s] [15b3:6750] (rev b0)

0d:00.0 Ethernet controller: Mellanox Technologies MT26448 [ConnectX EN 10GigE, PCIe 2.0 5GT/s] (rev b0)
        Subsystem: Mellanox Technologies Device 0021
        Physical Slot: 3
        Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0, Cache Line Size: 32 bytes
        Interrupt: pin A routed to IRQ 11
        NUMA node: 0
        Region 0: Memory at c7c00000 (64-bit, non-prefetchable) [size=1M]
        Region 2: Memory at c5800000 (64-bit, prefetchable) [size=8M]
        Expansion ROM at c7b00000 [disabled] [size=1M]
        Capabilities: [40] Power Management version 3
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
                Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
        Capabilities: [48] Vital Product Data
                Product Name: HP ConnectX-2 SFP+
                Read-only fields:
                        [PN] Part number: 666172-001
                        [EC] Engineering changes: A1
                        [SN] Serial number: IL214805EG
                        [V0] Vendor specific: PCIe Gen2 x8
                        [RV] Reserved: checksum good, 0 byte(s) reserved
                Read/write fields:
                        [V1] Vendor specific: N/A
                        [YA] Asset tag: N/A
                        [RW] Read-write area: 102 byte(s) free
                End
        Capabilities: [9c] MSI-X: Enable- Count=128 Masked-
                Vector table: BAR=0 offset=0007c000
                PBA: BAR=0 offset=0007d000
        Capabilities: [60] Express (v2) Endpoint, MSI 00
                DevCap: MaxPayload 256 bytes, PhantFunc 0, Latency L0s <64ns, L1 unlimited
                        ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset+ SlotPowerLimit 0.000W
                DevCtl: Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
                        RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop- FLReset-
                        MaxPayload 256 bytes, MaxReadReq 512 bytes
                DevSta: CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
                LnkCap: Port #8, Speed 5GT/s, Width x8, ASPM L0s, Exit Latency L0s unlimited
                        ClockPM- Surprise- LLActRep- BwNot- ASPMOptComp-
                LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- CommClk-
                        ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                LnkSta: Speed 5GT/s, Width x8, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
                DevCap2: Completion Timeout: Range ABCD, TimeoutDis+, LTR-, OBFF Not Supported
                         AtomicOpsCap: 32bit- 64bit- 128bitCAS-
                DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled
                         AtomicOpsCtl: ReqEn-
                LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-
                         Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                         Compliance De-emphasis: -6dB
                LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
                         EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
        Capabilities: [100 v1] Alternative Routing-ID Interpretation (ARI)
                ARICap: MFVC- ACS-, Next Function: 0
                ARICtl: MFVC- ACS-, Function Group: 0
        Capabilities: [148 v1] Device Serial Number 00-02-c9-03-00-52-b9-12

On Wed, Apr 15, 2020 at 4:00 PM Akemi Yagi <amyagi at gmail.com<mailto:amyagi at gmail.com>> wrote:
On Wed, Apr 15, 2020 at 12:48 AM Jeremy Reben <jeremy.reben at gmail.com<mailto:jeremy.reben at gmail.com>> wrote:
>
> I have an ancient MT26448 that worked in Fedora 28 and I would assume in CentOS 7.
> I had found a help ticket for ConnectX2 devices that it only required compiling the kmod with CONFIG_MLX4_CORE_GEN2 to enable support and was hoping it would be something similar for my card; that I believe to be of the first generation.
> The relevant trouble ticket can be found at https://bugs.centos.org/view.php?id=16726
> I hate to see perfectly good hardware become trash due to "progression".

Hi Jeremy,

It wouldl help if you can show us your device IDs [xxxx:yyyy] as
reported by 'lspci -nn'.

Akemi
_______________________________________________
elrepo mailing list
elrepo at lists.elrepo.org<mailto:elrepo at lists.elrepo.org>
http://lists.elrepo.org/mailman/listinfo/elrepo
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.elrepo.org/pipermail/elrepo/attachments/20200416/ae9df244/attachment-0001.html>