Repository: gpustack/gpustack

Issue #1785: MindIE parameter --metrics doesn't take effect
Created: 2025-04-16T10:05:44Z
Steps to reproduce

Deploy a model using MindIE and config --metrics
View metrics via GET https://{ip}:{port}/metrics.

Result

qwen2.5-7b-instruct-aQCny_2025-04-16_18-03-44.txt

[ma-user ~]$netstat -tuln | grep 40002
tcp        0      0 127.0.0.2:40002         0.0.0.0:*               LISTEN
tcp        0      0 0.0.0.0:40002           0.0.0.0:*               LISTEN
[ma-user ~]$curl http://127.0.0.2:40002/metrics
<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01//EN" "http://www.w3.org/TR/html4/strict.dtd">
<html><head>
<meta type="copyright" content="Copyright (C) 1996-2017 The Squid Software Foundation and contributors">
<meta http-equiv="Content-Type" CONTENT="text/html; charset=utf-8">
<title>ERROR: The requested URL could not be retrieved</title>
<style type="text/css"><!--
 /*
 * Copyright (C) 1996-2017 The Squid Software Foundation and contributors
 *
 * Squid software is distributed under GPLv2+ license and includes
 * contributions from numerous individuals and organizations.
 * Please see the COPYING and CONTRIBUTORS files for details.
 */

/*
 Stylesheet for Squid Error pages
 Adapted from design by Free CSS Templates
 http://www.freecsstemplates.org
 Released for free under a Creative Commons Attribution 2.5 License
*/

/* Page basics */
* {
	font-family: verdana, sans-serif;
}

html body {
	margin: 0;
	padding: 0;
	background: #efefef;
	font-size: 12px;
	color: #1e1e1e;
}

/* Page displayed title area */
#titles {
	margin-left: 15px;
	padding: 10px;
	padding-left: 100px;
	background: url('/squid-internal-static/icons/SN.png') no-repeat left;
}

/* initial title */
#titles h1 {
	color: #000000;
}
#titles h2 {
	color: #000000;
}

/* special event: FTP success page titles */
#titles ftpsuccess {
	background-color:#00ff00;
	width:100%;
}

/* Page displayed body content area */
#content {
	padding: 10px;
	background: #ffffff;
}

/* General text */
p {
}

/* error brief description */
#error p {
}

/* some data which may have caused the problem */
#data {
}

/* the error message received from the system or other software */
#sysmsg {
}

pre {
    font-family:sans-serif;
}

/* special event: FTP / Gopher directory listing */
#dirmsg {
    font-family: courier;
    color: black;
    font-size: 10pt;
}
#dirlisting {
    margin-left: 2%;
    margin-right: 2%;
}
#dirlisting tr.entry td.icon,td.filename,td.size,td.date {
    border-bottom: groove;
}
#dirlisting td.size {
    width: 50px;
    text-align: right;
    padding-right: 5px;
}

/* horizontal lines */
hr {
	margin: 0;
}

/* page displayed footer area */
#footer {
	font-size: 9px;
	padding-left: 10px;
}


body
:lang(fa) { direction: rtl; font-size: 100%; font-family: Tahoma, Roya, sans-serif; float: right; }
:lang(he) { direction: rtl; }
 --></style>
</head><body id=ERR_CONNECT_FAIL>
<div id="titles">
<h1>ERROR</h1>
<h2>The requested URL could not be retrieved</h2>
</div>
<hr>

<div id="content">
<p>The following error was encountered while trying to retrieve the URL: <a href="http://127.0.0.2:40002/metrics">http://127.0.0.2:40002/metrics</a></p>

<blockquote id="error">
<p><b>Connection to 127.0.0.2 failed.</b></p>
</blockquote>

<p id="sysmsg">The system returned: <i>(111) Connection refused</i></p>

<p>The remote host or network may be down. Please try the request again.</p>

<p>Your cache administrator is <a href="mailto:webmaster?subject=CacheErrorInfo%20-%20ERR_CONNECT_FAIL&amp;body=CacheHost%3A%20squid.notebook.dev%0D%0AErrPage%3A%20ERR_CONNECT_FAIL%0D%0AErr%3A%20(111)%20Connection%20refused%0D%0ATimeStamp%3A%20Wed,%2016%20Apr%202025%2009%3A57%3A10%20GMT%0D%0A%0D%0AClientIP%3A%20198.19.130.3%0D%0AServerIP%3A%20127.0.0.2%0D%0A%0D%0AHTTP%20Request%3A%0D%0AGET%20%2Fmetrics%20HTTP%2F1.1%0AUser-Agent%3A%20curl%2F7.68.0%0D%0AAccept%3A%20*%2F*%0D%0AProxy-Connection%3A%20Keep-Alive%0D%0AHost%3A%20127.0.0.2%3A40002%0D%0A%0D%0A%0D%0A">webmaster</a>.</p>

<br>
</div>

<hr>
<div id="footer">
<p>Generated Wed, 16 Apr 2025 09:57:10 GMT by squid.notebook.dev (squid/3.5.27)</p>
<!-- ERR_CONNECT_FAIL -->
</div>
</body></html>

Environment

GPUStack version: main
OS: Ubuntu 20.04
GPU: 910B1

Duplicate issue #1777: Setting MINDIE env variables is not working
Created: 2025-04-16T03:57:50Z
Steps to reproduce

Using MindIE to deploy a model and setting the following env variables:

MIES_SERVICE_MONITOR_MODE=1
TORCH_AIE_PRINT_TO_STDOUT=0


Verify whether the env variables are effective.

Result

The env variables were not set successfully.


qwen2.5-7b-instruct-jJOl4_2025-04-16_11-54-24.txt
Environment

GPUStack version: main a841d6a
OS: Ubuntu 20.4
GPU: 910B1

Closing comment (2025-04-16T10:07:38Z): Closed as not a bug. But --metrics doesn't seem to work, tracked by #1785