HPMC User Guide v 1.00
© 2022 Bassem W. Jamaleddine
Your HPMC comes with the dcpus program that display the system stats. dcpus is a command that you issue at the command prompt. Since your HPMC has hundreds of cores, and your Xeon Phi MIC has as well hundreds of cores, you need a utility that can display the system stats while focusing on the busiest cores.
The chapter "Programming and Running by MIC Native Loading" showed how to run diffusion_omp by offloading it to the MIC. In the following we show how to use the dcpus command to display the stat of the cores as the program is executing.
To display the stats names on your system, you can simply use dcpus with the -info option:
# dcpus -info
dcpus can display all cores. Use -transpose option so that the 228 cores are displayed one per row, a neater view.
# (HPMC9) 03:59 root@mic0: /tools # ./dcpus -transpose -iter 7 -delay 1
Use the -prune option to display the cores by pruning a range between the beginning and the end:
# (HPMC9) 03:59 root@mic0: /tools # ./dcpus -transpose -iter 7 -delay 1 -prune 3,5
Displaying all the cores can be distracting, so to focus only on a range of cores, just add in -sortby option:
# (HPMC9) 04:02 root@mic0: /tools # ./dcpus -transpose -iter 7 -delay 1 -prune 3,5 -sortby system
To print all cores focusing on the RES interrupt, use this command:
# (HPMC9) 03:59 root@mic0: /tools # ./dcpus -transpose -iter 7 -delay 1 -sortby system
The following shows the dcpus command running on the MIC of hpmc9, where we focused on eight cores that are busy with the RES (Rescheduling interrupts). After each iteration the busiest cores with the system stat are displayed first. We used -prune to select the only the first three cores and the last five cores. The dcpus was started few seconds before launching the "xphi diffusion_omp_xphi", so the usage of the MIC went from 0 to 98%, showing all core stat activities.
# (HPMC9) 13:56 root@mic0: /tools # ./dcpus -transpose -iter 7 -delay 1 -prune 3,5 -sortby idle
(HPMC9) 13:56 root@mic0: /tools # ./dcpus -transpose -iter 7 -delay 1 -prune 3,5 -sortby idle
user nice system idle iowait irq softirq steal guest guestnice
2026-04-23 14:14:34 CPU30 0 0 0 218 0 0 0 0 0 0
2026-04-23 14:14:34 CPU29 0 0 0 213 0 0 1 0 0 0
2026-04-23 14:14:34 CPU26 0 0 0 207 0 0 0 0 0 0
...
2026-04-23 14:14:34 CPU13 0 0 0 86 0 0 0 0 0 0
2026-04-23 14:14:34 CPU16 0 0 0 78 0 0 0 0 0 0
2026-04-23 14:14:34 CPU18 0 0 0 72 0 0 0 0 0 0
2026-04-23 14:14:34 CPU22 0 0 40 31 0 0 0 0 0 0
2026-04-23 14:14:34 CPU14 0 0 0 11 0 0 0 0 0 0
summed 3 0 42 32427 0 0 18 0 0 0
used=63 idle=32427 usage 0.193905817174515%
user nice system idle iowait irq softirq steal guest guestnice
2026-04-23 14:14:35 CPU14 0 0 0 259 0 0 0 0 0 0
2026-04-23 14:14:35 CPU109 0 0 0 205 0 0 0 0 0 0
2026-04-23 14:14:35 CPU213 0 0 0 204 0 0 0 0 0 0
...
2026-04-23 14:14:35 CPU165 0 0 0 101 0 0 1 0 0 0
2026-04-23 14:14:35 CPU125 0 0 0 101 0 0 1 0 0 0
2026-04-23 14:14:35 CPU28 0 0 0 94 0 0 0 0 0 0
2026-04-23 14:14:35 CPU26 0 0 0 94 0 0 0 0 0 0
2026-04-23 14:14:35 CPU30 0 0 40 51 0 0 0 0 0 0
summed 7 0 41 34300 0 0 21 0 0 0
used=69 idle=34300 usage 0.200762314876779%
user nice system idle iowait irq softirq steal guest guestnice
2026-04-23 14:14:37 CPU169 0 0 0 204 0 0 0 0 0 0
2026-04-23 14:14:37 CPU36 0 0 0 204 0 0 0 0 0 0
2026-04-23 14:14:37 CPU40 0 0 0 204 0 0 0 0 0 0
...
2026-04-23 14:14:37 CPU18 0 0 0 102 0 0 0 0 0 0
2026-04-23 14:14:37 CPU118 0 0 0 102 0 0 0 0 0 0
2026-04-23 14:14:37 CPU90 0 0 0 102 0 0 1 0 0 0
2026-04-23 14:14:37 CPU181 0 0 0 101 0 0 4 0 0 0
2026-04-23 14:14:37 CPU220 0 0 0 101 0 0 0 0 0 0
summed 7 0 39 32906 0 0 15 0 0 0
used=61 idle=32906 usage 0.185033518366852%
user nice system idle iowait irq softirq steal guest guestnice
2026-04-23 14:14:38 CPU26 32 0 2 214 0 0 0 0 0 0
2026-04-23 14:14:38 CPU158 33 0 1 209 0 0 0 0 0 0
2026-04-23 14:14:38 CPU91 33 0 1 209 0 0 0 0 0 0
...
2026-04-23 14:14:38 CPU38 33 0 1 114 0 0 0 0 0 0
2026-04-23 14:14:38 CPU42 33 0 1 114 0 0 0 0 0 0
2026-04-23 14:14:38 CPU193 32 0 2 114 0 0 0 0 0 0
2026-04-23 14:14:38 CPU45 39 0 2 107 0 0 0 0 0 0
2026-04-23 14:14:38 CPU46 33 0 40 75 0 0 0 0 0 0
summed 7368 0 386 36271 0 0 14 0 0 0
used=7768 idle=36271 usage 17.6389109652808%
user nice system idle iowait irq softirq steal guest guestnice
2026-04-23 14:14:40 CPU225 0 0 0 156 0 0 0 0 0 0
2026-04-23 14:14:40 CPU0 9 0 0 146 0 0 0 0 0 0
2026-04-23 14:14:40 CPU226 0 0 46 110 0 0 0 0 0 0
...
2026-04-23 14:14:40 CPU206 149 0 3 4 0 0 0 0 0 0
2026-04-23 14:14:40 CPU90 151 0 1 4 0 0 0 0 0 0
2026-04-23 14:14:40 CPU32 149 0 2 4 0 0 0 0 0 0
2026-04-23 14:14:40 CPU127 150 0 2 4 0 0 0 0 0 0
2026-04-23 14:14:40 CPU1 151 0 4 0 0 0 0 0 0 0
summed 33576 0 543 1406 0 0 0 0 0 0
used=34119 idle=1406 usage 96.0422237860661%
user nice system idle iowait irq softirq steal guest guestnice
2026-04-23 14:14:42 CPU225 1 0 0 153 0 0 0 0 0 0
2026-04-23 14:14:42 CPU0 8 0 0 146 0 0 0 0 0 0
2026-04-23 14:14:42 CPU226 0 0 44 109 0 0 0 0 0 0
...
2026-04-23 14:14:42 CPU118 152 0 1 0 0 0 0 0 0 0
2026-04-23 14:14:42 CPU206 152 0 1 0 0 0 0 0 0 0
2026-04-23 14:14:42 CPU90 152 0 1 0 0 0 0 0 0 0
2026-04-23 14:14:42 CPU32 154 0 0 0 0 0 0 0 0 0
2026-04-23 14:14:42 CPU127 153 0 0 0 0 0 0 0 0 0
summed 34163 0 280 468 0 0 0 0 0 0
used=34443 idle=468 usage 98.6594483114205%
user nice system idle iowait irq softirq steal guest guestnice
2026-04-23 14:14:43 CPU227 0 0 32 160 0 0 0 0 0 0
2026-04-23 14:14:43 CPU0 6 0 0 149 0 0 0 0 0 0
2026-04-23 14:14:43 CPU225 0 0 45 111 0 0 0 0 0 0
...
2026-04-23 14:14:43 CPU118 156 0 0 0 0 0 0 0 0 0
2026-04-23 14:14:43 CPU206 156 0 0 0 0 0 0 0 0 0
2026-04-23 14:14:43 CPU90 154 0 2 0 0 0 0 0 0 0
2026-04-23 14:14:43 CPU32 154 0 1 0 0 0 0 0 0 0
2026-04-23 14:14:43 CPU127 154 0 2 0 0 0 0 0 0 0
summed 34726 0 293 528 0 0 0 0 0 0
used=35019 idle=528 usage 98.5146425858722%
While the above command showed the interrupts activity on the MIC, the following command shows the stats on the host hpmc9. It is captured while an OMP program was running over the xphi. Notice that the system is idle since the xphi dispatched all the work to the MIC.
# 14:14 root@HPMC9: /tools # ./dcpus -transpose -iter 7 -delay 1 -prune 3,5
14:14 root@HPMC9: /tools # ./dcpus -transpose -iter 7 -delay 1 -prune 3,5
user nice system idle iowait irq softirq steal guest guestnice
2026-04-23 14:15:21 CPU0 0 0 0 101 0 0 0 0 0 0
2026-04-23 14:15:21 CPU1 0 0 0 101 0 0 0 0 0 0
2026-04-23 14:15:21 CPU2 1 0 0 100 0 0 0 0 0 0
...
2026-04-23 14:15:21 CPU107 0 0 0 101 0 0 0 0 0 0
2026-04-23 14:15:21 CPU108 0 0 0 101 0 0 0 0 0 0
2026-04-23 14:15:21 CPU109 0 0 0 101 0 0 0 0 0 0
2026-04-23 14:15:21 CPU110 0 0 0 100 0 0 0 0 0 0
2026-04-23 14:15:21 CPU111 0 0 0 101 0 0 0 0 0 0
summed 1 0 0 11284 0 0 0 0 0 0
used=1 idle=11284 usage 0.00886132033673017%
user nice system idle iowait irq softirq steal guest guestnice
2026-04-23 14:15:22 CPU0 0 0 0 101 0 0 0 0 0 0
2026-04-23 14:15:22 CPU1 0 0 0 101 0 0 0 0 0 0
2026-04-23 14:15:22 CPU2 0 0 0 100 0 0 0 0 0 0
...
2026-04-23 14:15:22 CPU107 0 0 0 101 0 0 0 0 0 0
2026-04-23 14:15:22 CPU108 0 0 0 101 0 0 0 0 0 0
2026-04-23 14:15:22 CPU109 0 0 0 101 0 0 0 0 0 0
2026-04-23 14:15:22 CPU110 0 0 0 102 0 0 0 0 0 0
2026-04-23 14:15:22 CPU111 0 0 0 101 0 0 0 0 0 0
summed 0 0 1 11331 0 0 0 0 0 0
used=1 idle=11331 usage 0.00882456759618779%
user nice system idle iowait irq softirq steal guest guestnice
2026-04-23 14:15:23 CPU0 0 0 0 101 0 0 0 0 0 0
2026-04-23 14:15:23 CPU1 0 0 0 102 0 0 0 0 0 0
2026-04-23 14:15:23 CPU2 1 0 1 101 0 0 0 0 0 0
...
2026-04-23 14:15:23 CPU107 0 0 0 101 0 0 0 0 0 0
2026-04-23 14:15:23 CPU108 0 0 0 101 0 0 0 0 0 0
2026-04-23 14:15:23 CPU109 0 0 0 101 0 0 0 0 0 0
2026-04-23 14:15:23 CPU110 0 0 0 101 0 0 0 0 0 0
2026-04-23 14:15:23 CPU111 0 0 0 101 0 0 0 0 0 0
summed 1 0 1 11339 0 0 0 0 0 0
used=2 idle=11339 usage 0.0176351291773212%
user nice system idle iowait irq softirq steal guest guestnice
2026-04-23 14:15:24 CPU0 0 0 0 101 0 0 0 0 0 0
2026-04-23 14:15:24 CPU1 0 0 0 101 0 0 0 0 0 0
2026-04-23 14:15:24 CPU2 1 0 0 100 0 0 0 0 0 0
...
2026-04-23 14:15:24 CPU107 0 0 0 102 0 0 0 0 0 0
2026-04-23 14:15:24 CPU108 0 0 0 102 0 0 0 0 0 0
2026-04-23 14:15:24 CPU109 0 0 0 101 0 0 0 0 0 0
2026-04-23 14:15:24 CPU110 0 0 0 101 0 0 0 0 0 0
2026-04-23 14:15:24 CPU111 0 0 0 101 0 0 0 0 0 0
summed 1 0 2 11323 0 0 0 0 0 0
used=3 idle=11323 usage 0.0264877273529931%
user nice system idle iowait irq softirq steal guest guestnice
2026-04-23 14:15:25 CPU0 0 0 0 101 0 0 0 0 0 0
2026-04-23 14:15:25 CPU1 0 0 0 101 0 0 0 0 0 0
2026-04-23 14:15:25 CPU2 0 0 0 101 0 0 0 0 0 0
...
2026-04-23 14:15:25 CPU107 0 0 0 101 0 0 0 0 0 0
2026-04-23 14:15:25 CPU108 0 0 0 101 0 0 0 0 0 0
2026-04-23 14:15:25 CPU109 0 0 0 102 0 0 0 0 0 0
2026-04-23 14:15:25 CPU110 0 0 0 101 0 0 0 0 0 0
2026-04-23 14:15:25 CPU111 0 0 0 102 0 0 0 0 0 0
summed 1 0 0 11331 0 0 0 0 0 0
used=1 idle=11331 usage 0.00882456759618779%
user nice system idle iowait irq softirq steal guest guestnice
2026-04-23 14:15:26 CPU0 0 0 0 101 0 0 0 0 0 0
2026-04-23 14:15:26 CPU1 0 0 0 101 0 0 0 0 0 0
2026-04-23 14:15:26 CPU2 1 0 0 100 0 0 0 0 0 0
...
2026-04-23 14:15:26 CPU107 0 0 0 101 0 0 0 0 0 0
2026-04-23 14:15:26 CPU108 0 0 0 101 0 0 0 0 0 0
2026-04-23 14:15:26 CPU109 0 0 0 101 0 0 0 0 0 0
2026-04-23 14:15:26 CPU110 0 0 0 101 0 0 0 0 0 0
2026-04-23 14:15:26 CPU111 0 0 0 101 0 0 0 0 0 0
summed 1 0 1 11332 0 0 0 0 0 0
used=2 idle=11332 usage 0.0176460208223046%
user nice system idle iowait irq softirq steal guest guestnice
2026-04-23 14:15:27 CPU0 0 0 0 101 0 0 0 0 0 0
2026-04-23 14:15:27 CPU1 0 0 0 101 0 0 0 0 0 0
2026-04-23 14:15:27 CPU2 1 0 0 100 0 0 0 0 0 0
...
2026-04-23 14:15:27 CPU107 0 0 0 101 0 0 0 0 0 0
2026-04-23 14:15:27 CPU108 0 0 0 101 0 0 0 0 0 0
2026-04-23 14:15:27 CPU109 0 0 0 101 0 0 0 0 0 0
2026-04-23 14:15:27 CPU110 0 0 0 101 0 0 0 0 0 0
2026-04-23 14:15:27 CPU111 0 0 0 101 0 0 0 0 0 0
summed 1 0 0 11327 0 0 0 0 0 0
used=1 idle=11327 usage 0.00882768361581921%