NetBSD-Bugs archive

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index][Old Index]

Re: PR/55707 CVS commit: src/external/cddl/osnet/dist/uts/common/fs/zfs



The following reply was made to PR kern/55707; it has been noted by GNATS.

From: Frank Kardel <kardel%netbsd.org@localhost>
To: gnats-bugs%netbsd.org@localhost, kern-bug-people <kern-bug-people%netbsd.org@localhost>
Cc: 
Subject: Re: PR/55707 CVS commit:
 src/external/cddl/osnet/dist/uts/common/fs/zfs
Date: Sat, 7 May 2022 20:54:13 +0200

 Further testing gives:
 
      - xcalls do not appear in significant counts
 
      - pgdaemon runs all the time after a while
 
      - zfs kernel pools (pool(9)) require a lot of memory (> 50% on a 
 64G machine) - somewhat expected ZFS behavior but seems not be limited
 
      - processes using ZFS pools slow down and wait on vmem and 
 zio_buf... and other zfs waitchannels
 
      - zfs pools (zfs abstraction) are unusable at this stage
 
 So, while this fix looked good at start it brings the ZFS system down 
 after a while.
 
 Looks like this needs more investigation.
 
 Maybe this fix should be backed out until then.
 
 Best regards,
 
    Frank
 
 vmstat -m
 
 Memory resource pool statistics
 Name        Size Requests Fail Releases Pgreq Pgrel Npage Hiwat Minpg 
 Maxpg Idle
 amappl        88   348824    0   315902   865   132   733 735     0   
 inf    0
 anonpl        40  8704909    0  4079863 52358  6398 45960 48565     0   
 inf    0
 arc_buf_hdr_t_f 208 6907754  0  4497447 130397 3538 126859 126861   0   
 inf    0
 arc_buf_t     40  2504702    0  2499075  3956  3815   141 656     0   
 inf    0
 ataspl       160 161409436   0 161409436 1139  1138     1 3     0   inf    1
 biopl        280  2144448   21  2144438 23004 23003     1 1136     0   
 inf    0
 buf16k      16896   13776    0    13203  1692  1494   198 281     0   
 inf    0
 buf1k       1536      168    0      168    83    82     1 83     0   
 inf    1
 buf2k       2560     1668    0     1668  1650  1649     1 957     0   
 inf    1
 buf32k      33280  643163  442   448649 414253 219738 194515 201563 0   
 inf    1
 buf4k       4096   777170    0   665295 527831 415955 111876 140565 0   
 inf    1
 buf512b     1024    16428    0    16427  1108  1107     1 930     0   
 inf    0
 buf64k      65536      12    0        0    13     0    13 13     0   
 inf    1
 buf8k       8704    26445    0    26122   925   876    49 131     0   
 inf    0
 bufpl        280   355070    0    47772 23653   103 23550 23551     0   
 inf    0
 cgdcpl        88     3076    0     3076    53    53     0 2     0   inf    0
 cwdi         192    11265    0    10887    23     4    19 19     0   
 inf    0
 dmu_buf_impl_t 216 8421890   0  8399719 130037 127513 2524 17241    0   
 inf    0
 dnode_t      640  6484618    0  6467510 425627 421251 4376 49015    0   
 inf    0
 execargs    262144  14923    0    14923  1126  1125     1 16     0    
 16    1
 extent        48       68    0       27     1     0     1 1     0   inf    0
 fcrpl        184      422    0      410     4     0     4 4     4   inf    3
 fdfile        64   225465    0   213580   334   112   222 296     0   
 inf    0
 ffsdino1     136  1458285    0  1458285 16421 16421     0 4393     0   
 inf    0
 ffsdino2     264 20330927    0 20182146 75494 65542  9952 14695     0   
 inf    0
 ffsino       280 21285904    0 21137123 63225 52565 10660 15745     0   
 inf    0
 file         128   136397    0   133647    92     0    92 92     0   
 inf    0
 filedesc     832    11245    0    10867   182    87    95 97     0   
 inf    0
 fstlwp       128    27298    0    25867    48     1    47 47     0   
 inf    0
 icmp          32     1693    0     1693   525   525     0 1     0   inf    0
 icmp6         32     2609    0     2609   857   857     0 1     0   inf    0
 igmppl        40        1    0        0     1     0     1 1     0   inf    0
 in6pcbpl     296  2985970    0  2985919    97    93     4 5     0   inf    0
 inmltpl       56      256    0      244     1     0     1 1     0   inf    0
 inpcbpl      256  3136768    0  3136472    46    24    22 30     0   
 inf    0
 kcpuset       64    21769    0    20881    15     0    15 15     0   
 inf    0
 kcredpl      192    33317    0    32207    69     3    66 69     0   
 inf    0
 kmem-00016    16  4031533    0  4001321  1519  1093   426 696     0   
 inf    0
 kmem-00032    32  2975151    0  2957902  3766  3256   510 1189     0   
 inf    0
 kmem-00064   128  6945586    0  6922587 27679 26212  1467 5814     0   
 inf    0
 kmem-00128   192  4411922    0  4378652 23929 21347  2582 7658     0   
 inf    0
 kmem-00192   256  3737248    0  3729453 40482 39292  1190 9243     0   
 inf    0
 kmem-00256   320  2644706    0  2641925 21832 21462   370 2495     0   
 inf    0
 kmem-00320   384    75860    0    71438   507     5   502 507     0   
 inf    0
 kmem-00384   448  4936259    0  4919108 176119 174123 1996 9637     0   
 inf    0
 kmem-00448   512    31893    0    30949   240    70   170 230     0   
 inf    0
 kmem-00512   576    17429    0    16819   134     6   128 134     0   
 inf    0
 kmem-00768   832    56191    0    44784  3372   515  2857 2865     0   
 inf    0
 kmem-01024  1088   231485    0   195622 15212  3216 11996 12993     0   
 inf    0
 kmem-02048  2112   510788    0   493001 225514 207725 17789 29465   0   
 inf    2
 kmem-04096  4096    47753    0    47020  7331  6595   736 1483     0   
 inf    3
 ksiginfo     136    62868    0    62865   165   164     1 14     0   
 inf    0
 ktrace       128     1165    0     1165    38    38     0 37     0   
 inf    0
 kva-12288   12288    1918    0     1901     4     1     3 4     0   inf    0
 kva-16384   16384  630073 2404   564606  6162  2067  4095 4095     0   
 inf    0
 kva-20480   20480     766    0      730    16    12     4 7     0   inf    0
 kva-24576   24576      37    0        2     4     0     4 4     0   inf    0
 kva-28672   28672     519    0      496    24    21     3 7     0   inf    0
 kva-32768   32768  332243  130   292975 18232 13314  4918 4919     0   
 inf    0
 kva-36864   36864     269    0        3    39     1    38 39     0   
 inf    0
 kva-49152   49152       4    0        2     1     0     1 1     0   inf    0
 kva-65536   65536  450540   38   413939 56288 47120  9168 14358     0   
 inf    0
 kva-8192    8192   365573    9   246580  4797  1076  3721 3722     0   
 inf    0
 llentrypl    280     1052    0     1039     2     1     1 2     0   inf    0
 lockf        112    12985    0    12920     8     2     6 8     0   inf    0
 lwppl       1088    18321    0    17038   585   127   458 567     0   
 inf    0
 mbpl         520  1066408    0  1064010  2051  1635   416 580     0   
 inf    0
 mclpl       2112   661475    0   659893 92254 90656  1598 2471     0 
 2094276 16
 metaslab_alloc_ 72 1416870   0  1416870  6925  6925     0 23     0   
 inf    0
 mutex         64 23895026    0 23744290  7072  4672  2400 3522     0   
 inf    0
 namecache    192 20339689    0 20189973 10680  3541  7139 7161     0   
 inf    0
 nfsnodepl    280        4    0        0     1     0     1 1     0   inf    0
 nfsvapl      184        4    0        0     1     0     1 1     0   inf    0
 npfcn4pl     144    14500    0    14493   238   237     1 100     0   
 inf    0
 npfcn6pl     192      735    0      735   384   384     0 4     0   inf    0
 npftblpl      48        2    0        0     1     0     1 1     0   inf    0
 pcache      2752      208    0        4   204     0   204 204     0   
 inf    0
 pcachecpu    128     6541    0        0   211     0   211 211     0   
 inf    0
 pcglarge    1088  1517560    0  1517544 120376 120367   9 2593     0   
 inf    1
 pcgnormal    320 48193604    0 48193514 367200 367189  11 5892     0   
 inf    0
 pdict16       80      630    0      566     2     0     2 2     0   inf    0
 pdict32       96       15    0        2     1     0     1 1     0   inf    0
 pdppl       4096    11260    0    10902  5538  5178   360 374     0   
 inf    2
 phpool-128    72     3766    0     3256    26     4    22 22     0   
 inf    0
 tmpfs_node   232    38115    0    37964    57    46    11 57     0   
 inf    0
 tstile       128    18321    0    17038    55     0    55 55     0   
 inf    0
 uaoeltpl     104     1106    0       76    29     0    29 29     0   
 inf    0
 uarea       24576   11079    0    10338  5043  4300   743 860     0   
 inf    2
 uareasys    24576    8912    0     8370  6692  6150   542 1122     0   
 inf    0
 ufsdir       272     1705    0     1704   629   628     1 2     0   inf    0
 ufsdq         88       58    0       28     1     0     1 1     0   inf    0
 vcachepl     640 23829477    0 23679536 139899 114898 25001 36871   0   
 inf    0
 vmembt        64  3048084    0  2701999  6422     0  6422 6422     0   
 inf    0
 vmmpepl      192  4391031    0  4332352  4595  1781  2814 2903     0   
 inf    9
 vmsppl       352    11179    0    10822    41     7    34 34     0   
 inf    0
 vndxpl       288     3081    0     3081    50    50     0 1     0   inf    0
 wapbldealloc  40     4494    0     4400   366   365     1 2     0   inf    0
 wapblentrypl  48    13636    0    13636   197   197     0 1     0   inf    0
 wapblinopl    40    14138    0    14135     1     0     1 1     0   inf    0
 xhcixfer     320        7    0        3     1     0     1 1     0   inf    0
 xhcixfer     320       15    0        3     2     0     2 2     0   inf    0
 xhcixfer     320        5    0        3     1     0     1 1     0   inf    0
 zfs_znode_cache 248 4064949  0  4064639 82052 81955    97 8726     0   
 inf    0
 zil_lwb_cache 208   14905    0    14874   259   257     2 45     0   
 inf    0
 zio_buf_1024 1536  647135    1   464116 157658 66120 91538 98121    0   
 inf    0
 zio_buf_10240 12288 92448    7    87488 32867 27907  4960 12109     0   
 inf    0
 zio_buf_114688 118784 15195  1    15195  6536  6536     0 330     0   
 inf    0
 zio_buf_12288 14336 87236   12    86034 28051 26849  1202 5257     0   
 inf    0
 zio_buf_131072 131072 570625 14  570368 69254 68997   257 1072     0   
 inf    0
 zio_buf_14336 16384 68628   10    67743 27309 26424   885 10181     0   
 inf    0
 zio_buf_1536 2048  496380    2   371712 86587 24202 62385 63619     0   
 inf    0
 zio_buf_16384 16384 989387 1571  986806 358824 356243 2581 13831    0   
 inf    0
 zio_buf_2048 2560  576027    2   479449 245068 148490 96578 97788   0   
 inf    0
 zio_buf_20480 24576 83274   33    82470 24472 23668   804 3309     0   
 inf    0
 zio_buf_24576 28672 83183   39    82399 20161 19377   784 1065     0   
 inf    0
 zio_buf_2560 3072  372835    3   286967 167567 81699 85868 109667   0   
 inf    0
 zio_buf_28672 32768 61214   22    60860 18234 17880   354 615     0   
 inf    0
 zio_buf_3072 3584  310332    9   155587 193755 39010 154745 155714  0   
 inf    0
 zio_buf_32768 32768 57565   51    57206 17773 17414   359 660     0   
 inf    0
 zio_buf_3584 4096  419924    3   189075 275481 44632 230849 232440  0   
 inf    0
 zio_buf_4096 4096  570671  108   498494 200689 128512 72177 75547   0   
 inf    0
 zio_buf_40960 45056 70018   18    69620 18892 18494   398 645     0   
 inf    0
 zio_buf_49152 53248 63271   35    53681 23738 14148  9590 9749     0   
 inf    0
 zio_buf_512 1024  6873852    0  6191358 434084 243580 190504 222715 0   
 inf    0
 zio_buf_5120 6144  179047   20   170924 55403 47280  8123 12460     0   
 inf    0
 zio_buf_57344 61440 50685    7    50391 16366 16072   294 585     0   
 inf    0
 zio_buf_6144 7168  100309   11    95804 27781 23276  4505 6375     0   
 inf    0
 zio_buf_512 1024  6873852    0  6191358 434084 243580 190504 222715 0   
 inf    0
 zio_buf_5120 6144  179047   20   170924 55403 47280  8123 12460     0   
 inf    0
 zio_buf_57344 61440 50685    7    50391 16366 16072   294 585     0   
 inf    0
 zio_buf_6144 7168  100309   11    95804 27781 23276  4505 6375     0   
 inf    0
 zio_buf_65536 65536 1639850  7  1639850 84010 84010     0 741     0   
 inf    0
 zio_buf_7168 8192  100042   13    89334 32608 21900 10708 11389     0   
 inf    0
 zio_buf_8192 8192  100777   12    91716 37259 28198  9061 9568     0   
 inf    0
 zio_buf_81920 86016 24692    0    24692  8580  8580     0 270     0   
 inf    0
 zio_buf_98304 102400 15669   0    15669  6950  6950     0 320     0   
 inf    0
 zio_cache    992  3890686    0  3890594 90299 90247    52 1247     0   
 inf    0
 zio_data_buf_10 1536 320653  0   279563 128878 108271 20607 20664   0   
 inf    0
 zio_data_buf_10 12288 109129 0    88203 64760 43834 20926 20938     0   
 inf    0
 zio_data_buf_11 118784 65455 0    64648 38245 37438   807 4384     0   
 inf    0
 zio_data_buf_12 14336 89334  0    74479 51705 36850 14855 14866     0   
 inf    0
 zio_data_buf_13 131072 2460355 0 2394583 667611 601839 65772 118796 0   
 inf    0
 zio_data_buf_14 16384 73563  0    62210 42336 30983 11353 11365     0   
 inf    0
 zio_data_buf_15 2048 199308  0   151679 76082 52267 23815 23815     0   
 inf    0
 zio_data_buf_16 16384 62453  0    53757 33598 24902  8696 8713     0   
 inf    0
 zio_data_buf_20 2560 172828  0   117171 133365 77708 55657 55661    0   
 inf    0
 zio_data_buf_20 24576 115344 0   101825 74640 61121 13519 13530     0   
 inf    0
 zio_data_buf_24 28672 120288 0   109807 85262 74781 10481 10517     0   
 inf    0
 zio_data_buf_25 3072 135280  0    91557 100274 56551 43723 43726    0   
 inf    0
 zio_data_buf_28 32768 84945  0    77602 55752 48409  7343 7353     0   
 inf    0
 zio_data_buf_30 3584 106880  0    73745 75474 42339 33135 33139     0   
 inf    0
 zio_data_buf_32 32768 82947  0    77325 55995 50373  5622 19870     0   
 inf    0
 zio_data_buf_35 4096 91374   0    65481 64707 38814 25893 25896     0   
 inf    0
 zio_data_buf_40 4096 77072   0    56626 52575 32129 20446 20446     0   
 inf    0
 zio_data_buf_40 45056 152006 0   143329 110362 101685 8677 32285    0   
 inf    0
 zio_data_buf_49 53248 114182 0   106732 75836 68386  7450 10019     0   
 inf    0
 zio_data_buf_51 1024 807255  0   730101 169098 149800 19298 19298   0   
 inf    0
 zio_data_buf_51 6144 118021  0    86095 81130 49204 31926 31928     0   
 inf    0
 zio_data_buf_57 61440 101030 0    94940 71166 65076  6090 12156     0   
 inf    0
 zio_data_buf_61 7168 97202   0    73880 63247 39925 23322 23330     0   
 inf    0
 zio_data_buf_65 65536 116590 0   112490 92774 88674  4100 24211     0   
 inf    0
 zio_data_buf_71 8192 79791   0    62525 47807 30541 17266 17276     0   
 inf    0
 zio_data_buf_81 8192 72922   0    58911 41948 27937 14011 14017     0   
 inf    0
 zio_data_buf_81 86016 104931 0   101590 67907 64566  3341 12569     0   
 inf    0
 zio_data_buf_98 102400 73099 0    70443 41308 38652  2656 8877     0   
 inf    0
 zio_link_cache 56 4359198    0  4359180  4159  4153     6 73     0   
 inf    0
 Totals           2611133762 5065 2597562150 9387208 7128911 2258297
 
 In use 26266313K, total allocated 34255628K; utilization 76.7%
 
 
 
 On 05/04/22 17:50, Chuck Silvers wrote:
 > The following reply was made to PR kern/55707; it has been noted by GNATS.
 >
 > From: "Chuck Silvers" <chs%netbsd.org@localhost>
 > To: gnats-bugs%gnats.NetBSD.org@localhost
 > Cc:
 > Subject: PR/55707 CVS commit: src/external/cddl/osnet/dist/uts/common/fs/zfs
 > Date: Wed, 4 May 2022 15:49:55 +0000
 >
 >   Module Name:	src
 >   Committed By:	chs
 >   Date:		Wed May  4 15:49:55 UTC 2022
 >   
 >   Modified Files:
 >   	src/external/cddl/osnet/dist/uts/common/fs/zfs: arc.c
 >   
 >   Log Message:
 >   fix ARC checks for available memory:
 >   there's an extra check that we inherited from FreeBSD that tries to
 >   detect KVA exhaustion on platforms with limited KVA, but the condition
 >   that decided whether to use the extra check was using a FreeBSDism
 >   that doesn't exist on NetBSD, resulting in this check being used on
 >   all platforms.  on amd64 systems with lots of memory, this extra check
 >   would result in the ARC thinking that it constantly needed to reclaim memory,
 >   resulting in all the xcall threads running all the time but not doing
 >   anything useful.  change this condition so that this extra check for
 >   KVA exhaustion is only used on 32-bit platforms.  fixes PR 55707.
 >   
 >   
 >   To generate a diff of this commit:
 >   cvs rdiff -u -r1.20 -r1.21 \
 >       src/external/cddl/osnet/dist/uts/common/fs/zfs/arc.c
 >   
 >   Please note that diffs are not public domain; they are subject to the
 >   copyright notices on the relevant files.
 >   
 


Home | Main Index | Thread Index | Old Index