<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=utf-8"><meta name=Generator content="Microsoft Word 15 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:"Calibri Light";
panose-1:2 15 3 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
{mso-style-priority:34;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:.5in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:1797483569;
mso-list-type:hybrid;
mso-list-template-ids:2086187786 67698705 67698713 67698715 67698703 67698713 67698715 67698703 67698713 67698715;}
@list l0:level1
{mso-level-text:"%1\)";
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level2
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level3
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l0:level4
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level5
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level6
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l0:level7
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level8
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level9
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
ol
{margin-bottom:0in;}
ul
{margin-bottom:0in;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=EN-US link=blue vlink=purple><div class=WordSection1><p class=MsoNormal>So we’ve discovered two issues during testing so far:<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><ol style='margin-top:0in' start=1 type=1><li class=MsoListParagraph style='margin-left:0in;mso-list:l0 level1 lfo1'>With AES-NI enabled in BIOS and kernel-ml el6 installed (whether booted into or not), KVM guest template installs take exactly 10 minutes. libguestfs-test-tool takes 3 minutes after hanging at the section in the attached output.<br><br>With AES-NI disabled, installs take the regular time (<1 min) and libguestfs-test-tool completes in about 10 seconds.<o:p></o:p></li></ol><p class=MsoNormal><o:p> </o:p></p><ol style='margin-top:0in' start=2 type=1><li class=MsoListParagraph style='margin-left:0in;mso-list:l0 level1 lfo1'>With the host running kernel-ml el6, new KVM guests with CPU passthrough enabled display CPU cores incorrectly after installing the OS, running yum/apt-get update, and rebooting.<o:p></o:p></li></ol><p class=MsoListParagraph><o:p> </o:p></p><p class=MsoNormal># lscpu<o:p></o:p></p><p class=MsoNormal>Architecture: x86_64<o:p></o:p></p><p class=MsoNormal>CPU op-mode(s): 32-bit, 64-bit<o:p></o:p></p><p class=MsoNormal>Byte Order: Little Endian<o:p></o:p></p><p class=MsoNormal>CPU(s): 2<o:p></o:p></p><p class=MsoNormal>On-line CPU(s) list: 0<o:p></o:p></p><p class=MsoNormal>Off-line CPU(s) list: 1<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoListParagraph>All cores show online after another reboot. This happens whether the OS is installed via template or ISO. It happens regardless of AES being enabled or disabled. It does not happen with CPU passthrough disabled.<o:p></o:p></p><p class=MsoListParagraph><o:p> </o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>Has anyone seen anything like this or have any idea what additional troubleshooting steps we should take?<o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;background:white'><span style='font-size:9.0pt;font-family:"Calibri Light",sans-serif;color:#1F497D'>Regards,</span><span style='font-size:9.5pt;font-family:"Arial",sans-serif;color:#500050'><o:p></o:p></span></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;background:white'><span style='font-size:9.0pt;font-family:"Calibri Light",sans-serif;color:#1F497D'>Nick</span><span style='font-size:12.0pt;font-family:"Arial",sans-serif;color:#222222'> <o:p></o:p></span></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal><b>From:</b> Dave Chiluk <dchiluk@indeed.com> <br><b>Sent:</b> Thursday, August 16, 2018 3:39 PM<br><b>To:</b> nick@ramnode.com<br><b>Cc:</b> EL Repo General Mailing List <elrepo@lists.elrepo.org><br><b>Subject:</b> Re: [elrepo] AMD EPYC Support<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><div><p class=MsoNormal>The packages for centos 6 exist, I'm curious to hear how it goes. Considering you'll be running KVM on top of that, I'd guess there is probably some performance loss by running old version of KVM.<o:p></o:p></p><div><p class=MsoNormal><o:p> </o:p></p></div><div><p class=MsoNormal>-- Change is hard --<o:p></o:p></p></div><div><p class=MsoNormal><o:p> </o:p></p></div><div><p class=MsoNormal>Dave.<o:p></o:p></p></div><div><p class=MsoNormal><o:p> </o:p></p></div><div><p class=MsoNormal><o:p> </o:p></p></div></div><p class=MsoNormal><o:p> </o:p></p><div><div><p class=MsoNormal>On Thu, Aug 16, 2018 at 2:02 PM <<a href="mailto:nick@ramnode.com">nick@ramnode.com</a>> wrote:<o:p></o:p></p></div><blockquote style='border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in'><div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>Thanks Dave. What do you think about trying kernel-ml on CentOS 6? We’re trying to do a direct swap of Intel for AMD without disrupting the existing systems (CentOS 6/kernel-lt el6 running KVM). Hoping to keep changes down to just reconfiguring networking.<o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'> <o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;background:white'><span style='font-size:9.0pt;font-family:"Calibri Light",sans-serif;color:#1F497D'>Regards,</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;background:white'><span style='font-size:9.0pt;font-family:"Calibri Light",sans-serif;color:#1F497D'>Nick </span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'> <o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><b>From:</b> <a href="mailto:elrepo-bounces@lists.elrepo.org" target="_blank">elrepo-bounces@lists.elrepo.org</a> <<a href="mailto:elrepo-bounces@lists.elrepo.org" target="_blank">elrepo-bounces@lists.elrepo.org</a>> <b>On Behalf Of </b>Dave Chiluk via elrepo<br><b>Sent:</b> Thursday, August 16, 2018 10:24 AM<br><b>To:</b> EL Repo General Mailing List <<a href="mailto:elrepo@lists.elrepo.org" target="_blank">elrepo@lists.elrepo.org</a>><br><b>Subject:</b> Re: [elrepo] AMD EPYC Support<o:p></o:p></p></div></div><div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'> <o:p></o:p></p><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>As hardware support is accomplished primarily through the kernel, and you've likely replaced it with an elrepo kernel the Redhat documentation would not apply. Additionally since Epyc is such a new processor you might have better luck running the kernel-ml instead of the kernel-lt as large driver backports are typically not accepted according to the linux-stable rules.<o:p></o:p></p><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'> <o:p></o:p></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>If I were you and intent on running an Epyc machine I'd move up to cent 7 + the kernel-ml, or move to Ubuntu Bionic which has a 4.15 kernel where they may have attempted to backport some of the Epyc enablement.<o:p></o:p></p></div><div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'> <o:p></o:p></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>Good luck,<o:p></o:p></p></div></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>Dave.<o:p></o:p></p></div></div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'> <o:p></o:p></p><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>On Wed, Aug 15, 2018 at 7:15 PM <<a href="mailto:nick@ramnode.com" target="_blank">nick@ramnode.com</a>> wrote:<o:p></o:p></p></div><div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>Hello,<o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'> <o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>Has anyone tried running kernel-lt 4.4 (el6) on AMD EPYC processors? RedHat documentation seems to indicate that RHEL/CentOS 6 is not supported on the EPYC lineup, but AMD’s documentation is unclear.<o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'> <o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;background:white'><span style='font-size:9.0pt;font-family:"Calibri Light",sans-serif;color:#1F497D'>Regards,</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;background:white'><span style='font-size:9.0pt;font-family:"Calibri Light",sans-serif;color:#1F497D'>Nick</span><o:p></o:p></p></div></div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>_______________________________________________<br>elrepo mailing list<br><a href="mailto:elrepo@lists.elrepo.org" target="_blank">elrepo@lists.elrepo.org</a><br><a href="http://lists.elrepo.org/mailman/listinfo/elrepo" target="_blank">http://lists.elrepo.org/mailman/listinfo/elrepo</a><o:p></o:p></p></div></div></blockquote></div></div></body></html>