pkgsrc-WIP-changes archive
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index][Old Index]
compiler-rt-netbsd: Update TODO.fuzzer
Module Name: pkgsrc-wip
Committed By: Kamil Rytarowski <n54%gmx.com@localhost>
Pushed By: kamil
Date: Thu May 3 05:17:03 2018 +0200
Changeset: 5aedbd71689e9adad49e878f3c0ca51b5c403f26
Modified Files:
compiler-rt-netbsd/TODO.fuzzer
Log Message:
compiler-rt-netbsd: Update TODO.fuzzer
Reflect reality.
Sponsored by <The NetBSD Foundation>
To see a diff of this commit:
https://wip.pkgsrc.org/cgi-bin/gitweb.cgi?p=pkgsrc-wip.git;a=commitdiff;h=5aedbd71689e9adad49e878f3c0ca51b5c403f26
Please note that diffs are not public domain; they are subject to the
copyright notices on the relevant files.
diffstat:
compiler-rt-netbsd/TODO.fuzzer | 125 +++++++++++++++--------------------------
1 file changed, 44 insertions(+), 81 deletions(-)
diffs:
diff --git a/compiler-rt-netbsd/TODO.fuzzer b/compiler-rt-netbsd/TODO.fuzzer
index f57066c719..94b7cf3d3c 100644
--- a/compiler-rt-netbsd/TODO.fuzzer
+++ b/compiler-rt-netbsd/TODO.fuzzer
@@ -13,90 +13,53 @@ Do we need llvm-cov for libFuzzer?
profiling. But I still think they are necessary for libFuzzer itself.
+$ make check-fuzzer
+********************
+Testing Time: 694.80s
+********************
+Failing Tests (21):
+ LLVMFuzzer :: cxxstring.test
+ LLVMFuzzer :: equivalence-signals.test
+ LLVMFuzzer :: equivalence.test
+ LLVMFuzzer :: fuzzer-leak.test
+ LLVMFuzzer :: fuzzer-oom.test
+ LLVMFuzzer :: fuzzer-timeout.test
+ LLVMFuzzer :: memcmp.test
+ LLVMFuzzer :: memcmp64.test
+ LLVMFuzzer :: merge-posix.test
+ LLVMFuzzer :: recommended-dictionary.test
+ LLVMFuzzer :: strcmp.test
+ LLVMFuzzer :: strncmp.test
+ LLVMFuzzer :: strstr.test
+ LLVMFuzzer :: trace-malloc-threaded.test
+ LLVMFuzzer :: trace-malloc-unbalanced.test
+ LLVMFuzzer :: value-profile-cmp.test
+ LLVMFuzzer :: value-profile-load.test
+ LLVMFuzzer :: value-profile-mem.test
+ LLVMFuzzer :: value-profile-set.test
+ LLVMFuzzer :: value-profile-strcmp.test
+ LLVMFuzzer :: value-profile-strncmp.test
+
+ Expected Passes : 87
+ Unsupported Tests : 6
+ Unexpected Failures: 21
libFuzzer Failed cases (make check-fuzzer):
-I. "pthread_tsd" Category
- All of these cases can be reproduced by commands like:
- % clang -fsanitize=address,fuzzer -special_flags source_file
- % ./a.out
- If there are multiple source files, they should be compiled and run separately. The results will be like:
- INFO: Seed: 2796805091
- INFO: Loaded 1 modules (10 inline 8-bit counters): 10 [0x763b70, 0x763b7a),
- INFO: Loaded 1 PC tables (10 PCs): 10 [0x543a70,0x543b10),
- assertion "pthread__tsd_destructors[key] != NULL" failed: file "/usr/src/lib/libpthread/pthread_tsd.c", line 176, function "pthread__add_specific"
- [1] Abort trap ./a.out
+I. kernel panic
+ fuzzer-oom.test kills the kernel (panic due to lack of memory)
+
+ workaround: kill it quickly or disable
+
+II. hangs
+ fuzzer-timeout.test
+ value-profile*
- ID. case_name, source_file, special_flags_if_exist".
- 1. bad-strcmp.test, BadStrcmpTest.cpp
- 2. cleanse.test, CleanseTest.cpp
- 3. disable-leaks.test, AccumulateAllocationsTest.cpp
- 4. exit-report.test, SimpleTest.cpp
- 5. fuzzer-custommutator.test, CustomMutatorTest.cpp, -Icompiler-rt-source/lib/fuzzer
- 6. fuzzer-customcrossoverandmutate.test, CustomCrossOverAndMutateTest.cpp, -Icompiler-rt-source/lib/fuzzer
- 7. equivalence.test, EquivalenceATest.cpp
- 8. cxxstring.test, CxxStringEqTest.cpp
- 9. caller-callee.test, CallerCalleeTest.cpp
- 10. fuzzer-dirs.test, SimpleTest.cpp
- 11. fuzzer-dict.test, SimpleDictionaryTest.cpp
- 12. exit_on_src_pos.test, SimpleTest.cpp
- 13. fuzzer-fdmask.test, SpamyTest.cpp
- 14. fuzzer-customcrossover.test, CustomCrossOverTest.cpp
- 15. fuzzer-finalstats.test, SimpleTest.cpp
- 16. max-number-of-runs.test, AccumulateAllocationsTest.cpp
- 17. memcmp64.test, Memcmp64BytesTest.cpp
- 18. fuzzer-flags.test, FlagsTest.cpp
- 19. fuzzer-runs.test, NthRunCrashTest.cpp
- 20. fuzzer-seed.test, NullDerefTest.cpp
- 21. fuzzer-segv.test, NullDerefTest.cpp
- 22. memcmp.test, MemcmpTest.cpp
- 23. fuzzer-timeout.test, TimeoutTest.cpp
- 24. fuzzer-printcovpcs.test, SimpleTest.cpp
- 25. fuzzer-ubsan.test, SignedIntOverflowTest.cpp
- 26. inline-8bit-counters.test, SimpleTest.cpp
- 27. fuzzer-leak.test, LeakTest.cpp:ThreadedLeakTest.cpp:LeakTimeoutTest.cpp
- 28. recommended-dictionary.test, RepeatedMemcmp.cpp
- 29. fuzzer-threaded.test, ThreadedTest.cpp
- 30. merge-control-file.test, FullCoverageSetTest.cpp
- 31. merge-posix.test, FullCoverageSetTest.cpp
- 32. merge-summary.test, FullCoverageSetTest.cpp
- 33. merge.test, FullCoverageSetTest.cpp
- 34. shrink.test, ShrinkControlFlowTest.cpp:ShrinkValueProfileTest.cpp
- 35. reduce_inputs.test, ShrinkControlFlowSimpleTest.cpp:ShrinkControlFlowTest.cpp
- 36. minimize_two_crashes.test, TwoDifferentBugsTest.cpp
- 37. overwrite-input.test, OverwriteInputTest.cpp
- 38. fuzzer-singleinputs.test, NullDerefTest.cpp:SimpleTest.cpp
- 39. print-func.test, PrintFuncTest.cpp
- 40. minimize_crash.test, NullDerefTest.cpp:SingleByteInputTest.cpp
- 41. simple-cmp.test, SimpleCmpTest.cpp
- 42. strcmp.test, StrcmpTest.cpp
- 43. merge-sigusr.test, SleepOneSecondTest.cpp
- 44. strncmp.test, StrncmpTest.test
- 45. swap-cmp.test, SwapCmpTest.cpp
- 46. repeated-bytes.test, RepeatedBytesTest.cpp
- 47. fuzzer-oom.test, OutOfMemoryTest.cpp:OutOfMemorySingleLargeMalloc.cpp:AccumulateAllocationsTest.cpp
- 48. value-profile-cmp3.test, AbsNegAndConstantTest.cpp
- 49. value-profile-cmp4.test, AbsNegAndConstant64Test.cpp
- 50. value-profile-cmp.test, SimpleCmpTest.cpp
- 51. value-profile-mem.test, SingleMemcmpTest.cpp
- 52. strstr.test, StrstrTest.cpp
- 53. sigusr.test, SleepOneSecondTest.cpp
- 54. value-profile-strcmp.test, SingleStrcmpTest.cpp
- 55. value-profile-strncmp.test, SingleStrncmpTest.cpp
- 56. trace-malloc-2.test, TraceMallocTest.cpp
- 57. trace-malloc-unbalanced.test, TraceMallocTest.cpp
- 58. value-profile-switch.test, SwitchTest.cpp:Switch2Test.cpp
- 59. trace-pc.test, SimpleTest.cpp
- 60. trace-malloc.test, TraceMallocTest.cpp
- 61. ulimit.test, SimpleTest.cpp
- 62. value-profile-div.test, DivTest.cpp
- 63. value-profile-load.test, LoadTest.cpp
- 64. trace-malloc-threaded.test, TraceMallocThreadedTest.cpp
- 65. value-profile-set.test, FourIndependentBranchesTest.cpp
- 66. equivalence-signals.test, EquivalenceATest.cpp
- 67. dump_coverage.test, NullDerefTest.cpp
- 68. coverage.test, NUllDerefTest.cpp
- 69. fuzzer.test, FullCoverageSetTest.cpp
-II. Complex One
+ workaround: kill with pkill(1) or kill(1)
+
+III. Complex One
70. afl-driver-extra-stats.test
Not sure yet.
+
+IV. Unknown
+ the rest
Home |
Main Index |
Thread Index |
Old Index