>Number: 55707
>Category: kern
>Synopsis: ZFS seems to trigger a lot of xcalls
>Confidential: no
>Severity: serious
>Priority: medium
>Responsible: kern-bug-people
>State: open
>Class: sw-bug
>Submitter-Id: net
>Arrival-Date: Fri Oct 09 08:15:00 +0000 2020
>Originator: Frank Kardel
>Release: NetBSD 9.99.73
>Organization:
>Environment:
System: NetBSD pip 9.99.73 NetBSD 9.99.73 (PIPGEN) #0: Tue Oct 6 22:46:19 CEST 2020 kardel@pip:/src/NetBSD/cur/src/obj.amd64/sys/arch/amd64/compile/PIPGEN amd64
Architecture: x86_64
Machine: amd64
>Description:
ZFS seems to trigger massive xcall work. How a single thread can can
take more that 100% escapes me but could be a top/sampling bug.
This is on a AMD Ryzen 9 X3950X (16 cores/32 threads).
The workload is a single threaded bareos(bacula derivitive) base
backup of ZFS file systems with ls4 compressen and deduplication.
I wonder whether the xcall load could be reduced. It is clear that
ZFS does a lot more kernel work (dedup, compression, raidz etc),
but does it need so any xcalls?
With that many xcalls I have seem CPU % to crep up above 1200%
which seems to be a high workload.
top:
PID LID USERNAME PRI STATE TIME WCPU CPU NAME COMMAND
0 210 root 127 xcall/10 286:11 337.06% 337.06% xcall/10 [system]
0 216 root 127 xcall/11 269:04 315.33% 315.33% xcall/11 [system]
0 164 root 127 xcall/13 257:14 235.69% 235.69% xcall/13 [system]
0 120 root 127 xcall/6 308:27 203.71% 203.71% xcall/6 [system]
0 198 root 127 xcall/8 291:53 193.16% 193.16% xcall/8 [system]
0 384 root 127 xcall/17 240:15 155.71% 155.71% xcall/17 [system]
0 414 root 127 xcall/22 194:37 129.35% 129.35% xcall/22 [system]
0 96 root 127 RUN/2 301:26 114.45% 114.45% xcall/2 [system]
0 304 root 127 xcall/25 170:53 88.62% 88.62% xcall/25 [system]
0 204 root 127 xcall/9 290:37 88.57% 88.57% xcall/9 [system]
0 222 root 127 xcall/12 263:09 80.81% 80.81% xcall/12 [system]
0 390 root 127 xcall/18 226:49 75.98% 75.98% xcall/18 [system]
0 396 root 127 xcall/19 204:52 63.62% 63.62% xcall/19 [system]
0 114 root 127 xcall/5 311:53 61.04% 61.04% xcall/5 [system]
0 402 root 127 xcall/20 226:08 56.98% 56.98% xcall/20 [system]
0 170 root 127 xcall/14 243:54 55.91% 55.91% xcall/14 [system]
0 298 root 127 xcall/24 176:27 54.20% 54.20% xcall/24 [system]
0 310 root 127 xcall/26 172:31 52.54% 52.54% xcall/26 [system]
0 328 root 127 xcall/29 140:24 52.39% 52.39% xcall/29 [system]
0 408 root 127 xcall/21 198:44 49.37% 49.37% xcall/21 [system]
0 102 root 127 xcall/3 313:49 46.97% 46.97% xcall/3 [system]
0 292 root 127 xcall/23 201:36 42.19% 42.19% xcall/23 [system]
0 182 root 127 xcall/16 238:50 39.26% 39.26% xcall/16 [system]
0 25 root 127 xcall/1 260:37 33.98% 33.98% xcall/1 [system]
9248 29770 root 32 CPU/1 309:46 29.88% 29.88% - bareos-fd
0 761 root 96 xclocv/1 246:05 24.80% 24.80% zfs [system]
0 176 root 127 xcall/15 235:02 23.05% 23.05% xcall/15 [system]
0 322 root 127 xcall/28 152:48 8.54% 8.54% xcall/28 [system]
0 7 root 127 xcall/0 224:40 7.71% 7.71% xcall/0 [system]
0 334 root 127 xcall/30 103:55 7.42% 7.42% xcall/30 [system]
0 340 root 127 xcall/31 106:06 5.08% 5.08% xcall/31 [system]
9900 915 bareossd 84 poll/3 70:33 4.35% 4.35% - bareos-sd
24461 24461 pgsql 85 poll/15 0:06 0.20% 0.20% - postgres
0 108 root 127 xcall/4 311:07 0.00% 0.00% xcall/4 [system]
0 192 root 127 xcall/7 297:59 0.00% 0.00% xcall/7 [system]
0 444 root 127 xcall/27 158:40 0.00% 0.00% xcall/27 [system]
0 978 root 126 pgdaem/1 6:34 0.00% 0.00% pgdaemon [system]
0 9 root 125 vdrain/1 3:11 0.00% 0.00% vdrain [system]
0 979 root 124 syncer/2 2:59 0.00% 0.00% ioflush [system]
0 755 root 123 physio/1 2:12 0.00% 0.00% physiod [system]
0 2791 root 221 raidio/1 0:39 0.00% 0.00% raidio2 [system]
0 763 root 96 zfscv/2 0:23 0.00% 0.00% zfs [system]
9370 9370 kdm 85 select/3 0:20 0.00% 0.00% - kdm_greet
0 2790 root 221 rfnode/1 0:18 0.00% 0.00% raid2 [system]
8341 8341 root 191 pause/0 0:16 0.00% 0.00% - ntpd
vmstat -e:
interrupt total rate type
bus_dma bounces 76055857 1148 misc
bus_dma loads 159639431 2411 misc
bus_dma nbouncebufs 151 0 misc
pdpolicy reactanon 1461551 22 misc
pdpolicy reactexec 86592 1 misc
vmcmd kills 22146 0 misc
vmcmd extends 9683 0 misc
vmcmd calls 104605 1 misc
entropy notify 6 0 misc
entropy request 1 0 misc
entropy consolidate 3 0 misc
entropy immediate 3 0 misc
pserialize exclusive access 6313 0 misc
vmem static_bt_inuse 200 0 misc
vmem static_bt_count 200 0 misc
TLB shootdown 185232513 2798 intr
cpu0 cprng_strong reseed 4 0 misc
cpu0 cprng_strong reseed 4 0 misc
softint net/0 40492228 611 misc
softint net block/0 81126 1 misc
softint bio/0 2221870 33 misc
softint bio block/0 42 0 misc
softint clk/0 6643944 100 misc
softint clk block/0 19602 0 misc
softint ser/0 3528946 53 misc
callout late/0 32 0 misc
callout wait/0 35 0 misc
crosscall unicast 1010 0 misc
crosscall broadcast 609278581 9203 misc
nfs timer 10 0 misc
nfs timer start 9 0 misc
nfs timer stop 9 0 misc
cpu0 timer 6619323 99 intr
cpu0 AST IPI 637001317 9622 misc
cpu0 generic IPI 37331730 563 misc
cpu0 xcall IPI 75133 1 misc
cpu0 kpreempt IPI 1154985 17 misc
cpu1 cprng_strong reseed 4 0 misc
cpu1 cprng_strong reseed 3 0 misc
softint net/1 349428 5 misc
softint net block/1 14 0 misc
softint bio/1 73326994 1107 misc
softint bio block/1 32255 0 misc
softint clk/1 3213706 48 misc
softint clk block/1 51 0 misc
softint ser/1 4751098 71 misc
softint ser block/1 1 0 misc
callout late/1 11 0 misc
callout wait/1 92 0 misc
cpu1 timer 6619113 99 misc
cpu1 AST IPI 626040633 9457 misc
cpu1 xcall IPI 87675 1 misc
cpu1 kpreempt IPI 1370822 20 misc
cpu2 cprng_strong reseed 3 0 misc
cpu2 cprng_strong reseed 2 0 misc
softint net/2 193838 2 misc
softint net block/2 2 0 misc
softint bio/2 22 0 misc
softint clk/2 2887556 43 misc
softint ser/2 9648 0 misc
cpu2 timer 6619600 99 misc
cpu2 AST IPI 625282278 9445 misc
cpu2 xcall IPI 91278 1 misc
cpu2 kpreempt IPI 503810 7 misc
cpu3 cprng_strong reseed 3 0 misc
cpu3 cprng_strong reseed 2 0 misc
softint net/3 105424 1 misc
softint bio/3 6 0 misc
softint clk/3 2318488 35 misc
softint ser/3 9648 0 misc
cpu3 timer 6619594 99 misc
cpu3 AST IPI 621167253 9383 misc
cpu3 xcall IPI 97750 1 misc
cpu3 kpreempt IPI 211776 3 misc
cpu4 cprng_strong reseed 3 0 misc
cpu4 cprng_strong reseed 2 0 misc
softint net/4 126084 1 misc
softint bio/4 4 0 misc
softint clk/4 1826916 27 misc
softint ser/4 9648 0 misc
cpu4 timer 6619591 99 misc
cpu4 AST IPI 618809723 9347 misc
cpu4 xcall IPI 98803 1 misc
cpu4 kpreempt IPI 148634 2 misc
cpu5 cprng_strong reseed 3 0 misc
cpu5 cprng_strong reseed 2 0 misc
softint net/5 91489 1 misc
softint clk/5 1450466 21 misc
softint ser/5 9648 0 misc
cpu5 timer 6619567 99 misc
cpu5 AST IPI 617105876 9322 misc
cpu5 xcall IPI 99623 1 misc
cpu5 kpreempt IPI 117579 1 misc
cpu6 cprng_strong reseed 2 0 misc
cpu6 cprng_strong reseed 2 0 misc
softint net/6 91482 1 misc
softint bio/6 4 0 misc
softint clk/6 1235827 18 misc
softint ser/6 9648 0 misc
cpu6 timer 6619599 99 misc
cpu6 AST IPI 616226396 9308 misc
cpu6 xcall IPI 99597 1 misc
cpu6 kpreempt IPI 128607 1 misc
cpu7 cprng_strong reseed 2 0 misc
cpu7 cprng_strong reseed 2 0 misc
softint net/7 91467 1 misc
softint clk/7 1144559 17 misc
softint ser/7 9648 0 misc
softint ser block/7 1 0 misc
cpu7 timer 6619579 99 misc
cpu7 AST IPI 616026692 9305 misc
cpu7 xcall IPI 99445 1 misc
cpu7 kpreempt IPI 107853 1 misc
cpu8 cprng_strong reseed 2 0 misc
cpu8 cprng_strong reseed 2 0 misc
softint net/8 91496 1 misc
softint net block/8 1 0 misc
softint clk/8 1271321 19 misc
softint ser/8 9648 0 misc
callout wait/8 1 0 misc
cpu8 timer 6619598 99 misc
cpu8 AST IPI 615761683 9301 misc
cpu8 xcall IPI 98898 1 misc
cpu8 kpreempt IPI 125666 1 misc
cpu9 cprng_strong reseed 2 0 misc
cpu9 cprng_strong reseed 2 0 misc
softint net/9 91468 1 misc
softint clk/9 1141547 17 misc
softint ser/9 9648 0 misc
cpu9 timer 6619601 99 misc
cpu9 AST IPI 614915934 9289 misc
cpu9 xcall IPI 99506 1 misc
cpu9 kpreempt IPI 120030 1 misc
cpu10 cprng_strong reseed 2 0 misc
cpu10 cprng_strong reseed 2 0 misc
softint net/10 91491 1 misc
softint clk/10 1019351 15 misc
softint ser/10 9648 0 misc
softint ser block/10 1 0 misc
cpu10 timer 6619585 99 misc
cpu10 AST IPI 614458607 9282 misc
cpu10 xcall IPI 99821 1 misc
cpu10 kpreempt IPI 105079 1 misc
cpu11 cprng_strong reseed 2 0 misc
cpu11 cprng_strong reseed 2 0 misc
softint net/11 91475 1 misc
softint clk/11 1068134 16 misc
softint ser/11 9648 0 misc
cpu11 timer 6619598 99 misc
cpu11 AST IPI 614540535 9283 misc
cpu11 xcall IPI 99234 1 misc
cpu11 kpreempt IPI 102304 1 misc
cpu12 cprng_strong reseed 2 0 misc
cpu12 cprng_strong reseed 2 0 misc
softint net/12 91473 1 misc
softint clk/12 1205121 18 misc
softint ser/12 9648 0 misc
cpu12 timer 6619596 99 misc
cpu12 AST IPI 614820677 9287 misc
cpu12 xcall IPI 98779 1 misc
cpu12 kpreempt IPI 119165 1 misc
cpu13 cprng_strong reseed 2 0 misc
cpu13 cprng_strong reseed 2 0 misc
softint net/13 91476 1 misc
softint clk/13 1344225 20 misc
softint ser/13 9648 0 misc
cpu13 timer 6619599 99 misc
cpu13 AST IPI 615010259 9290 misc
cpu13 xcall IPI 99011 1 misc
cpu13 kpreempt IPI 117963 1 misc
cpu14 cprng_strong reseed 2 0 misc
cpu14 cprng_strong reseed 2 0 misc
softint net/14 91507 1 misc
softint net block/14 3 0 misc
softint clk/14 2674465 40 misc
softint ser/14 9648 0 misc
callout wait/14 1 0 misc
cpu14 timer 6619601 99 misc
cpu14 AST IPI 617522880 9328 misc
cpu14 xcall IPI 98392 1 misc
cpu14 kpreempt IPI 106741 1 misc
cpu15 cprng_strong reseed 2 0 misc
cpu15 cprng_strong reseed 2 0 misc
softint net/15 91559 1 misc
softint net block/15 7 0 misc
softint clk/15 4036380 60 misc
softint clk block/15 1 0 misc
softint ser/15 9648 0 misc
softint ser block/15 1 0 misc
callout wait/15 4 0 misc
cpu15 timer 6619584 99 misc
cpu15 AST IPI 625956050 9455 misc
cpu15 xcall IPI 88385 1 misc
cpu15 kpreempt IPI 169277 2 misc
cpu16 cprng_strong reseed 2 0 misc
cpu16 cprng_strong reseed 2 0 misc
softint net/16 91462 1 misc
softint clk/16 533008 8 misc
softint ser/16 9648 0 misc
cpu16 timer 6619582 99 misc
cpu16 AST IPI 610648348 9224 misc
cpu16 xcall IPI 100268 1 misc
cpu16 kpreempt IPI 3601 0 misc
cpu17 cprng_strong reseed 2 0 misc
cpu17 cprng_strong reseed 2 0 misc
softint net/17 91463 1 misc
softint clk/17 395148 5 misc
softint ser/17 9648 0 misc
cpu17 timer 6619582 99 misc
cpu17 AST IPI 610524154 9222 misc
cpu17 xcall IPI 100285 1 misc
cpu17 kpreempt IPI 4052 0 misc
cpu18 cprng_strong reseed 2 0 misc
cpu18 cprng_strong reseed 2 0 misc
softint net/18 91463 1 misc
softint clk/18 191111 2 misc
softint ser/18 9648 0 misc
cpu18 timer 6619601 99 misc
cpu18 AST IPI 610323258 9219 misc
cpu18 xcall IPI 100544 1 misc
cpu18 kpreempt IPI 782 0 misc
cpu19 cprng_strong reseed 2 0 misc
cpu19 cprng_strong reseed 2 0 misc
softint net/19 91462 1 misc
softint clk/19 197297 2 misc
softint ser/19 9648 0 misc
cpu19 timer 6619601 99 misc
cpu19 AST IPI 610303077 9219 misc
cpu19 xcall IPI 100550 1 misc
cpu19 kpreempt IPI 430 0 misc
cpu20 cprng_strong reseed 1 0 misc
cpu20 cprng_strong reseed 2 0 misc
softint net/20 91463 1 misc
softint clk/20 71946 1 misc
softint ser/20 9648 0 misc
callout wait/20 1 0 misc
cpu20 timer 6619601 99 misc
cpu20 AST IPI 609850761 9212 misc
cpu20 xcall IPI 100592 1 misc
cpu20 kpreempt IPI 217 0 misc
cpu21 cprng_strong reseed 2 0 misc
cpu21 cprng_strong reseed 2 0 misc
softint net/21 91467 1 misc
softint net block/21 1 0 misc
softint clk/21 80410 1 misc
softint ser/21 9648 0 misc
cpu21 timer 6619600 99 misc
cpu21 AST IPI 609847715 9212 misc
cpu21 xcall IPI 100686 1 misc
cpu21 kpreempt IPI 319 0 misc
cpu22 cprng_strong reseed 2 0 misc
softint net/22 91463 1 misc
softint clk/22 83375 1 misc
softint ser/22 9648 0 misc
cpu22 timer 6619600 99 misc
cpu22 AST IPI 609793064 9211 misc
cpu22 xcall IPI 100658 1 misc
cpu22 kpreempt IPI 136 0 misc
cpu23 cprng_strong reseed 1 0 misc
cpu23 cprng_strong reseed 2 0 misc
softint net/23 91463 1 misc
softint clk/23 51690 0 misc
softint ser/23 9648 0 misc
cpu23 timer 6619600 99 misc
cpu23 AST IPI 609684437 9210 misc
cpu23 xcall IPI 100662 1 misc
cpu23 kpreempt IPI 181 0 misc
cpu24 cprng_strong reseed 1 0 misc
cpu24 cprng_strong reseed 2 0 misc
softint net/24 91463 1 misc
softint clk/24 81201 1 misc
softint ser/24 9648 0 misc
softint ser block/24 1 0 misc
cpu24 timer 6619600 99 misc
cpu24 AST IPI 609699934 9210 misc
cpu24 xcall IPI 100594 1 misc
cpu24 kpreempt IPI 520 0 misc
cpu25 cprng_strong reseed 1 0 misc
cpu25 cprng_strong reseed 2 0 misc
softint net/25 91463 1 misc
softint clk/25 70230 1 misc
softint ser/25 9648 0 misc
softint ser block/25 1 0 misc
cpu25 timer 6619595 99 misc
cpu25 AST IPI 609653962 9209 misc
cpu25 xcall IPI 100660 1 misc
cpu25 kpreempt IPI 82 0 misc
cpu26 cprng_strong reseed 1 0 misc
cpu26 cprng_strong reseed 2 0 misc
softint net/26 91463 1 misc
softint clk/26 54454 0 misc
softint ser/26 9648 0 misc
cpu26 timer 6619600 99 misc
cpu26 AST IPI 609614354 9208 misc
cpu26 xcall IPI 100606 1 misc
cpu26 kpreempt IPI 105 0 misc
cpu27 cprng_strong reseed 1 0 misc
cpu27 cprng_strong reseed 2 0 misc
softint net/27 91463 1 misc
softint clk/27 102875 1 misc
softint ser/27 9648 0 misc
cpu27 timer 6619600 99 misc
cpu27 AST IPI 609650842 9209 misc
cpu27 xcall IPI 100614 1 misc
cpu27 kpreempt IPI 282 0 misc
cpu28 cprng_strong reseed 1 0 misc
cpu28 cprng_strong reseed 2 0 misc
softint net/28 91463 1 misc
softint clk/28 95412 1 misc
softint ser/28 9648 0 misc
softint ser block/28 1 0 misc
cpu28 timer 6619600 99 misc
cpu28 AST IPI 609626733 9209 misc
cpu28 xcall IPI 100660 1 misc
cpu28 kpreempt IPI 267 0 misc
cpu29 cprng_strong reseed 2 0 misc
cpu29 cprng_strong reseed 2 0 misc
softint net/29 91467 1 misc
softint clk/29 218743 3 misc
softint ser/29 9648 0 misc
cpu29 timer 6619600 99 misc
cpu29 AST IPI 609824167 9212 misc
cpu29 xcall IPI 100440 1 misc
cpu29 kpreempt IPI 243 0 misc
cpu30 cprng_strong reseed 1 0 misc
cpu30 cprng_strong reseed 2 0 misc
softint net/30 91466 1 misc
softint clk/30 1108859 16 misc
softint ser/30 9648 0 misc
softint ser block/30 1 0 misc
cpu30 timer 6619595 99 misc
cpu30 AST IPI 610991451 9229 misc
cpu30 xcall IPI 100249 1 misc
cpu30 kpreempt IPI 111 0 misc
cpu31 cprng_strong reseed 2 0 misc
cpu31 cprng_strong reseed 2 0 misc
softint net/31 91464 1 misc
softint clk/31 2861956 43 misc
softint ser/31 9648 0 misc
callout wait/31 1 0 misc
cpu31 timer 6619589 99 misc
cpu31 AST IPI 614368932 9280 misc
cpu31 xcall IPI 95012 1 misc
cpu31 kpreempt IPI 334 0 misc
ioapic0 pin 1 6 0 intr
msix0 vec 0 38 0 intr
msix0 vec 1 83 0 intr
msix0 vec 2 653 0 intr
msix0 vec 3 16 0 intr
msix0 vec 5 4 0 intr
msix0 vec 7 4 0 intr
msix1 vec 1 30 0 intr
msix1 vec 2 56 0 intr
msix1 vec 3 6 0 intr
msix1 vec 4 6 0 intr
ioapic1 pin 6 161 0 intr
ioapic1 pin 4 717347 10 intr
ioapic1 pin 5 62320 0 intr
ioapic1 pin 7 397656 6 intr
msix2 vec 0 94877 1 intr
msix2 vec 1 83604 1 intr
msix2 vec 2 1 0 intr
msix3 vec 0 141155 2 intr
msix3 vec 1 13478 0 intr
msix3 vec 2 13612 0 intr
msix3 vec 3 33366 0 intr
msix3 vec 4 1 0 intr
msi4 vec 0 52 0 intr
msix5 vec 0 35 0 intr
msi6 vec 0 3877494 58 intr
msi7 vec 0 8539625 129 intr
msix9 vec 0 67827989 1024 intr
msix10 vec 0 1 0 intr
acpicpu0 C1 (HALT) 699740559 10570 misc
acpicpu0 P0 (3700 MHz) 352 0 misc
acpicpu0 P1 (2800 MHz) 331 0 misc
acpicpu0 P2 (2200 MHz) 257 0 misc
acpicpu1 C1 (HALT) 683204576 10320 misc
acpicpu1 P0 (3700 MHz) 352 0 misc
acpicpu1 P1 (2800 MHz) 331 0 misc
acpicpu1 P2 (2200 MHz) 257 0 misc
acpicpu2 C1 (HALT) 697384260 10534 misc
acpicpu2 P0 (3700 MHz) 352 0 misc
acpicpu2 P1 (2800 MHz) 331 0 misc
acpicpu2 P2 (2200 MHz) 257 0 misc
acpicpu3 C1 (HALT) 703514504 10627 misc
acpicpu3 P0 (3700 MHz) 352 0 misc
acpicpu3 P1 (2800 MHz) 331 0 misc
acpicpu3 P2 (2200 MHz) 257 0 misc
acpicpu4 C1 (HALT) 718806902 10858 misc
acpicpu4 P0 (3700 MHz) 352 0 misc
acpicpu4 P1 (2800 MHz) 331 0 misc
acpicpu4 P2 (2200 MHz) 257 0 misc
acpicpu5 C1 (HALT) 727584762 10991 misc
acpicpu5 P0 (3700 MHz) 352 0 misc
acpicpu5 P1 (2800 MHz) 331 0 misc
acpicpu5 P2 (2200 MHz) 257 0 misc
acpicpu6 C1 (HALT) 730667330 11037 misc
acpicpu6 P0 (3700 MHz) 352 0 misc
acpicpu6 P1 (2800 MHz) 331 0 misc
acpicpu6 P2 (2200 MHz) 257 0 misc
acpicpu7 C1 (HALT) 724562504 10945 misc
acpicpu7 P0 (3700 MHz) 352 0 misc
acpicpu7 P1 (2800 MHz) 331 0 misc
acpicpu7 P2 (2200 MHz) 257 0 misc
acpicpu8 C1 (HALT) 725187463 10954 misc
acpicpu8 P0 (3700 MHz) 352 0 misc
acpicpu8 P1 (2800 MHz) 331 0 misc
acpicpu8 P2 (2200 MHz) 257 0 misc
acpicpu9 C1 (HALT) 732968857 11072 misc
acpicpu9 P0 (3700 MHz) 352 0 misc
acpicpu9 P1 (2800 MHz) 331 0 misc
acpicpu9 P2 (2200 MHz) 257 0 misc
acpicpu10 C1 (HALT) 729234552 11015 misc
acpicpu10 P0 (3700 MHz) 352 0 misc
acpicpu10 P1 (2800 MHz) 331 0 misc
acpicpu10 P2 (2200 MHz) 257 0 misc
acpicpu11 C1 (HALT) 727013297 10982 misc
acpicpu11 P0 (3700 MHz) 352 0 misc
acpicpu11 P1 (2800 MHz) 331 0 misc
acpicpu11 P2 (2200 MHz) 257 0 misc
acpicpu12 C1 (HALT) 725551288 10960 misc
acpicpu12 P0 (3700 MHz) 352 0 misc
acpicpu12 P1 (2800 MHz) 331 0 misc
acpicpu12 P2 (2200 MHz) 257 0 misc
acpicpu13 C1 (HALT) 729637309 11022 misc
acpicpu13 P0 (3700 MHz) 352 0 misc
acpicpu13 P1 (2800 MHz) 331 0 misc
acpicpu13 P2 (2200 MHz) 257 0 misc
acpicpu14 C1 (HALT) 725378000 10957 misc
acpicpu14 P0 (3700 MHz) 352 0 misc
acpicpu14 P1 (2800 MHz) 331 0 misc
acpicpu14 P2 (2200 MHz) 257 0 misc
acpicpu15 C1 (HALT) 714850333 10798 misc
acpicpu15 P0 (3700 MHz) 352 0 misc
acpicpu15 P1 (2800 MHz) 331 0 misc
acpicpu15 P2 (2200 MHz) 257 0 misc
acpicpu16 C1 (HALT) 780913140 11796 misc
acpicpu16 P0 (3700 MHz) 352 0 misc
acpicpu16 P1 (2800 MHz) 331 0 misc
acpicpu16 P2 (2200 MHz) 257 0 misc
acpicpu17 C1 (HALT) 781392945 11803 misc
acpicpu17 P0 (3700 MHz) 352 0 misc
acpicpu17 P1 (2800 MHz) 331 0 misc
acpicpu17 P2 (2200 MHz) 257 0 misc
acpicpu18 C1 (HALT) 782578306 11821 misc
acpicpu18 P0 (3700 MHz) 352 0 misc
acpicpu18 P1 (2800 MHz) 331 0 misc
acpicpu18 P2 (2200 MHz) 257 0 misc
acpicpu19 C1 (HALT) 784627138 11852 misc
acpicpu19 P0 (3700 MHz) 352 0 misc
acpicpu19 P1 (2800 MHz) 331 0 misc
acpicpu19 P2 (2200 MHz) 257 0 misc
acpicpu20 C1 (HALT) 781765018 11809 misc
acpicpu20 P0 (3700 MHz) 352 0 misc
acpicpu20 P1 (2800 MHz) 331 0 misc
acpicpu20 P2 (2200 MHz) 257 0 misc
acpicpu21 C1 (HALT) 784666574 11853 misc
acpicpu21 P0 (3700 MHz) 352 0 misc
acpicpu21 P1 (2800 MHz) 331 0 misc
acpicpu21 P2 (2200 MHz) 257 0 misc
acpicpu22 C1 (HALT) 785147476 11860 misc
acpicpu22 P0 (3700 MHz) 352 0 misc
acpicpu22 P1 (2800 MHz) 331 0 misc
acpicpu22 P2 (2200 MHz) 257 0 misc
acpicpu23 C1 (HALT) 783972537 11842 misc
acpicpu23 P0 (3700 MHz) 352 0 misc
acpicpu23 P1 (2800 MHz) 331 0 misc
acpicpu23 P2 (2200 MHz) 257 0 misc
acpicpu24 C1 (HALT) 786051926 11874 misc
acpicpu24 P0 (3700 MHz) 352 0 misc
acpicpu24 P1 (2800 MHz) 331 0 misc
acpicpu24 P2 (2200 MHz) 257 0 misc
acpicpu25 C1 (HALT) 786580436 11882 misc
acpicpu25 P0 (3700 MHz) 352 0 misc
acpicpu25 P1 (2800 MHz) 331 0 misc
acpicpu25 P2 (2200 MHz) 257 0 misc
acpicpu26 C1 (HALT) 785940984 11872 misc
acpicpu26 P0 (3700 MHz) 352 0 misc
acpicpu26 P1 (2800 MHz) 331 0 misc
acpicpu26 P2 (2200 MHz) 257 0 misc
acpicpu27 C1 (HALT) 786748593 11884 misc
acpicpu27 P0 (3700 MHz) 352 0 misc
acpicpu27 P1 (2800 MHz) 331 0 misc
acpicpu27 P2 (2200 MHz) 257 0 misc
acpicpu28 C1 (HALT) 787221354 11891 misc
acpicpu28 P0 (3700 MHz) 352 0 misc
acpicpu28 P1 (2800 MHz) 331 0 misc
acpicpu28 P2 (2200 MHz) 257 0 misc
acpicpu29 C1 (HALT) 787905293 11902 misc
acpicpu29 P0 (3700 MHz) 352 0 misc
acpicpu29 P1 (2800 MHz) 331 0 misc
acpicpu29 P2 (2200 MHz) 257 0 misc
acpicpu30 C1 (HALT) 791359974 11954 misc
acpicpu30 P0 (3700 MHz) 352 0 misc
acpicpu30 P1 (2800 MHz) 331 0 misc
acpicpu30 P2 (2200 MHz) 257 0 misc
acpicpu31 C1 (HALT) 788347794 11908 misc
acpicpu31 P0 (3700 MHz) 352 0 misc
acpicpu31 P1 (2800 MHz) 331 0 misc
acpicpu31 P2 (2200 MHz) 257 0 misc
cpu0 cprng_fast reseed 3 0 misc
cpu1 cprng_fast reseed 3 0 misc
cpu2 cprng_fast reseed 2 0 misc
cpu3 cprng_fast reseed 2 0 misc
cpu4 cprng_fast reseed 2 0 misc
cpu5 cprng_fast reseed 2 0 misc
cpu6 cprng_fast reseed 2 0 misc
cpu7 cprng_fast reseed 2 0 misc
cpu8 cprng_fast reseed 2 0 misc
cpu9 cprng_fast reseed 2 0 misc
cpu10 cprng_fast reseed 2 0 misc
cpu11 cprng_fast reseed 2 0 misc
cpu12 cprng_fast reseed 2 0 misc
cpu13 cprng_fast reseed 2 0 misc
cpu14 cprng_fast reseed 2 0 misc
cpu15 cprng_fast reseed 2 0 misc
cpu16 cprng_fast reseed 2 0 misc
cpu17 cprng_fast reseed 2 0 misc
cpu18 cprng_fast reseed 2 0 misc
cpu19 cprng_fast reseed 2 0 misc
cpu20 cprng_fast reseed 2 0 misc
cpu21 cprng_fast reseed 2 0 misc
cpu22 cprng_fast reseed 2 0 misc
cpu23 cprng_fast reseed 2 0 misc
cpu24 cprng_fast reseed 2 0 misc
cpu25 cprng_fast reseed 2 0 misc
cpu26 cprng_fast reseed 2 0 misc
cpu27 cprng_fast reseed 2 0 misc
cpu28 cprng_fast reseed 2 0 misc
cpu29 cprng_fast reseed 2 0 misc
cpu30 cprng_fast reseed 2 0 misc
cpu31 cprng_fast reseed 2 0 misc
kpreempt defer: critical section 1047682 15 misc
kpreempt defer: kernel_lock 19898 0 misc
kpreempt immediate 9176145 138 misc
cpu0 entropy softint 131588 1 misc
cpu1 entropy softint 4966079 75 misc
msi12 vec 0 301 0 intr
wapbl fsid 0xa822/0x78b commit 6625 0 misc
wapbl fsid 0xa822/0x78b journal write total 312230 4 misc
wapbl fsid 0xa822/0x78b journal write finished async 16890 0 misc
wapbl fsid 0xa822/0x78b metadata async write 193102 2 misc
wapbl fsid 0xa822/0x78b cache flush 13250 0 misc
wapbl fsid 0xa821/0x78b commit 99 0 misc
wapbl fsid 0xa821/0x78b journal write total 51189 0 misc
wapbl fsid 0xa821/0x78b journal write finished async 1384 0 misc
wapbl fsid 0xa821/0x78b metadata async write 33412 0 misc
wapbl fsid 0xa821/0x78b cache flush 198 0 misc
wapbl fsid 0xa806/0x78b commit 19 0 misc
wapbl fsid 0xa806/0x78b journal write total 9090 0 misc
wapbl fsid 0xa806/0x78b journal write finished async 67 0 misc
wapbl fsid 0xa806/0x78b metadata async write 5937 0 misc
wapbl fsid 0xa806/0x78b cache flush 38 0 misc
>How-To-Repeat:
Use ZFS with dedup, lz4 compression on a 3 vdev raidz1 pool and
run a plain bareos base backup for some TBytes.
>Fix:
?
>Unformatted: