CVS commit: pkgsrc/net/ndpi

To: pkgsrc-changes%NetBSD.org@localhost
Subject: CVS commit: pkgsrc/net/ndpi
From: "Adam Ciarcinski" <adam%netbsd.org@localhost>
Date: Fri, 23 Aug 2024 17:54:06 +0000

Module Name:    pkgsrc
Committed By:   adam
Date:           Fri Aug 23 17:54:06 UTC 2024

Modified Files:
        pkgsrc/net/ndpi: Makefile PLIST distinfo
        pkgsrc/net/ndpi/patches: patch-src_lib_Makefile.in
Added Files:
        pkgsrc/net/ndpi/patches: patch-configure.ac

Log Message:
ndpi: updated to 4.10

4.10

Major Changes

Initial work towards First Packet Classification (FPC)

New Supported Protocols and Services

Add OpenWire support
FPC: add DNS correlation
ipaddr2list.py, ndpi2timeline.py: reformatted
Add Nano (XNO) protocol support
Added ClickHouse protocol
Add HLS support
Add infrastructure for explicit support of Fist Packet Classification
Add detection of Twitter bot
Added default port mappings to ndpiReader help -H
Add Ripe Atlas probe protocol.
Add ZUG consensus protocol dissector.
Added NDPI_PROBING_ATTEMPT risk
DTLS: add support for DTLS 1.3
Added dpi.compute_entropy configuration parameter
Add Call of Duty Mobile support
Add Ethernet Global Data support
Viber: add detection of voip calls and avoid false positives
Add support for Mastodon, Bluesky and (FB-)Threads
Fixes JA4 computation adding a better GREASE detect funzion
DTLS: add support for Alert message type (similar to TLS)
Add Adobe Connect support
Remove PPStream protocol and add iQIYI
Add BFCP protocol support
Add strlcpy implementation
Add KNXnet/IP protocol support
STUN: add support for ipv6 in some metadata
Implemented STUN peer_address, relayed_address, response_origin, other_address parsing Added code to ignore invalid STUN realm Extended JSON output with STUN information
Add Label Distribution Protocol support
Add The Elder Scrolls Online support
Add Shellscript risk detection.
Add PE32/PE32+ risk detection (detect transmitted windows executables).
Added support for STUN Mapped IP address
Added binary data transfer risk alert
Add LoL: Wild Rift detection
STUN: add dissection of XOR-PEER-ADDRESS with ipv6 address
Add FLUTE protocol dissector
Add PFCP protocol dissector
Add Path of Exile protocol dissector
Add NetEase Games detection support
Add Naraka Bladepoint detection support
Add BFD protocol dissector
Add DLEP protocol dissector
Add ANSI C12.22 protocol dissector
TLS: add configuration of JA* fingerprints
Add detection of Gaijin Entertainment games
Add new AppsFlyer domain
Add TencentGames protocol dissector
Add Gearman protocol dissector
Add Raft protocol dissector.
Add Radmin protocol dissector
Add STOMP protocol dissector
Add ElectronicArts detection support
Add Yojimbo (netcode) protocol dissector
Add a dedicated dissector for Zoom
Add Mumble detection support
Add KCP protocol dissector.
Add PIA (Private Internet Access) support
Add more adult content hostnames
Add Roughtime protocol dissector.
Add realtime protocol output to ndpiReader.
Add Google Chat support
ndpiReader: add breed stats on output used for CI
Add Ceph protocol dissector
Add HL7 protocol dissector
Add IEC62056 (DLMS/COSEM) protocol dissector
Add NoMachine NX protocol dissector
Add Apache Kafka protocol dissector
Add WebDAV detection support
Add JSON-RPC protocol dissector
Add OpenFlow protocol dissector
Add UFTP protocol dissector
Add HiSLIP protocol dissector
Add PROFINET/IO protocol dissector
Add Monero protocol classification.
Add Ether-S-Bus protocol dissector
Add IEEE C37.118 protocol dissector
Add ISO 9506-1 MMS protocol dissector
Add Beckhoff ADS protocol dissector
Add Schneider Electric’s UMAS detection support
Add Ether-S-I/O protocol dissector
Add Omron FINS protocol dissector
Rework S7Comm dissector; add S7Comm Plus support
Add OPC UA protocol dissector
Add RTPS protocol dissector
Add HART-IP protocol dissector
Add IEEE 1588-2008 (PTPv2) dissector
Added TeslaServices and improved TikTok host names.
Add ethereum protocol dissector.
Added generic Google Protobuf dissector.
Add CAN over Ethernet dissector.

Improvements

Enhanced PrimeVideo detection
Enhanced ookla tracing
Improved ICMP malformed packet risk description
Improve detection of Cloudflare WARP traffic
tunnelbear: improve detection over wireguard
Improve detection of Twitter/X
Zoom: fix detection of screen sharing
Improved detection of Android connectiity checks
Zoom: fix integer overflow
RTP/STUN: look for STUN packets after RTP/RTCP classification
Zoom: faster detection of P2P flows
Added NDPI_PROTOCOL_NTOP assert and removed percentage comparison
Add extra entropy checks and more precise(?) analysis.
STUN: improve extraction of Mapped-Address metadata
Added support for roaring bitmap v3
Add more TencentGames signatures
Added DGA exception for Dropbox
QUIC: add heuristic to detect unidirectional GQUIC flows
fuzzing: improve coverage
Improve detection of Cloudflare WARP traffic
fuzz: improve fuzzers using pl7m
wireshark: lua: minor improvements
Improved logic for checking invalid DNS queries
fuzz: improve fuzzing coverage
Improved Kafka dissector.
H323: improve detection and avoid false positives
Fix/improve fuzzing
eDonkey: improve/update classification
Domain Classification Improvements
STUN: improve extraction of Mapped-Address metadata
Improve LoL: Wild Rift detection
Improve TencentGames detection
STUN: improve heurstic to detect old classic-stun
ahocorasick: improve matching with subdomains
Improved alert on suspicious DNS traffic
Telegram: improve identification
Improved Telegram detection
Improved modbus dissection to discard false positives
Improved Polish gambling sites fetch script.
fuzz: improve fuzzing coverage
Improve normalization of flow->host_server_name
Improve ndpi_set_config error printing.
Improve MySQL detection
Improve handling of custom rules
Zoom: improve detection
Improved ndpi_get_host_domain
Bittorrent: improve detection of UTPv1
Improved uTorrent via utp (TCP-like streams over UDP).
fuzz: improve fuzzing coverage
fuzz: improve fuzzing coverage
Improved belgium gambling sites regex.
Improve CORBA detection
STUN: improve demultiplexing of DTLS packets
Improved TFTP.
fuzz: improve coverage and remove dead code
Improved Protobuf dissector.
Improved detection as non DGA for hostnames belnging to a CDN
Improved CryNetwork protocol dissector.

Tools

Make the CI faster
Add a script to download/update the domain suffix list
Add identification of Huawei generic and cloud traffic
ndpiReader: improve the check on max number of pkts processed per flow
Added default port mappings to ndpiReader help -H
ndpiReader: restore ndpiReader -x $DOMAIN_NAME functionality
ndpiReader: improve the check on max number of pkts processed per flow
ndpiReader: fix memory leak
Add realtime protocol output to ndpiReader.
ndpiReader: add breed stats on output used for CI
ndpiReader: avoid creating two detection modules when processing traffic/traces
ndpiReader: fix guessed_flow_protocols statistic

Misc

Improved tests coverage
Varisous performance improvements
Added stress test
Added new API calls - ndpi_load_domain_suffixes() - ndpi_get_host_domain_suffix()
Add some fast CRC16 algorithms implementation
Add a FAQ for the project
Ip address list: aggregate Mullvad and Tor lists too
IP lists: aggregate addresses wherever possible
Added malicious sites from the polish cert.
IPv6: add support for custom categories
IPv6: add support for IPv6 risk exceptions
IPv6: add support for custom rules
IPv6: add support for IPv6 risk tree
ipv6: add support for ipv6 addresses lists


To generate a diff of this commit:
cvs rdiff -u -r1.13 -r1.14 pkgsrc/net/ndpi/Makefile pkgsrc/net/ndpi/distinfo
cvs rdiff -u -r1.6 -r1.7 pkgsrc/net/ndpi/PLIST
cvs rdiff -u -r0 -r1.3 pkgsrc/net/ndpi/patches/patch-configure.ac
cvs rdiff -u -r1.7 -r1.8 pkgsrc/net/ndpi/patches/patch-src_lib_Makefile.in

Please note that diffs are not public domain; they are subject to the
copyright notices on the relevant files.

Modified files:

Index: pkgsrc/net/ndpi/Makefile
diff -u pkgsrc/net/ndpi/Makefile:1.13 pkgsrc/net/ndpi/Makefile:1.14
--- pkgsrc/net/ndpi/Makefile:1.13       Mon Nov 20 17:57:31 2023
+++ pkgsrc/net/ndpi/Makefile    Fri Aug 23 17:54:05 2024
@@ -1,6 +1,6 @@
-# $NetBSD: Makefile,v 1.13 2023/11/20 17:57:31 adam Exp $
+# $NetBSD: Makefile,v 1.14 2024/08/23 17:54:05 adam Exp $
 
-DISTNAME=      nDPI-4.8
+DISTNAME=      nDPI-4.10
 PKGNAME=       ${DISTNAME:tl}
 CATEGORIES=    net
 MASTER_SITES=  ${MASTER_SITE_GITHUB:=ntop/}
Index: pkgsrc/net/ndpi/distinfo
diff -u pkgsrc/net/ndpi/distinfo:1.13 pkgsrc/net/ndpi/distinfo:1.14
--- pkgsrc/net/ndpi/distinfo:1.13       Mon Nov 20 17:57:31 2023
+++ pkgsrc/net/ndpi/distinfo    Fri Aug 23 17:54:05 2024
@@ -1,8 +1,9 @@
-$NetBSD: distinfo,v 1.13 2023/11/20 17:57:31 adam Exp $
+$NetBSD: distinfo,v 1.14 2024/08/23 17:54:05 adam Exp $
 
-BLAKE2s (nDPI-4.8.tar.gz) = 80693cd17d13f8225b52a76e504093e59c118ec3388b68ec3b8a24866aa28565
-SHA512 (nDPI-4.8.tar.gz) = f76eb99a83262a6d148509c7ce457b9af35dce3657c8191405ba15999b25c323ee0bee2907b0a7e6ba6f12a63182fde839e0098a4e8e0f63999e600526f3036b
-Size (nDPI-4.8.tar.gz) = 39479237 bytes
+BLAKE2s (nDPI-4.10.tar.gz) = 9ec7897dd076b6a915212cc274e66e6765d61dfc076ac65541a3a0891455e486
+SHA512 (nDPI-4.10.tar.gz) = 311836477bafc9c7a4ef6cf18438870ec186db4407390883bcd8376bd709cd5c5700e8a3f028dbc3e49012e828ee5199ee86e76ad4d7b1595903818e96bf9cb8
+Size (nDPI-4.10.tar.gz) = 38583847 bytes
+SHA1 (patch-configure.ac) = 66433ce788c42455eee7d78d423b66007f10cdeb
 SHA1 (patch-src_include_ndpi__includes.h) = f6aa1dff14da61f93e6d330be7adfe1b85772f14
-SHA1 (patch-src_lib_Makefile.in) = 4bc3a07334f689306842538590cf9509969851e4
+SHA1 (patch-src_lib_Makefile.in) = a07b742ee5b5e75e7e0297ad49b3ba4faf4242aa
 SHA1 (patch-src_lib_third__party_include_gcrypt_common.h) = 257a2c9b08793f8bca564dc7c6229f1d5168b5e1

Index: pkgsrc/net/ndpi/PLIST
diff -u pkgsrc/net/ndpi/PLIST:1.6 pkgsrc/net/ndpi/PLIST:1.7
--- pkgsrc/net/ndpi/PLIST:1.6   Mon Mar 28 19:24:14 2022
+++ pkgsrc/net/ndpi/PLIST       Fri Aug 23 17:54:05 2024
@@ -1,4 +1,4 @@
-@comment $NetBSD: PLIST,v 1.6 2022/03/28 19:24:14 adam Exp $
+@comment $NetBSD: PLIST,v 1.7 2024/08/23 17:54:05 adam Exp $
 bin/ndpiReader
 include/ndpi/ndpi_api.h
 include/ndpi/ndpi_classify.h
@@ -10,10 +10,9 @@ include/ndpi/ndpi_includes_OpenBSD.h
 include/ndpi/ndpi_main.h
 include/ndpi/ndpi_patricia_typedefs.h
 include/ndpi/ndpi_protocol_ids.h
-include/ndpi/ndpi_protocols.h
+include/ndpi/ndpi_replace_printf.h
 include/ndpi/ndpi_typedefs.h
 include/ndpi/ndpi_unix.h
-include/ndpi/ndpi_utils.h
 include/ndpi/ndpi_win32.h
 lib/libndpi.a
 lib/libndpi.so

Index: pkgsrc/net/ndpi/patches/patch-src_lib_Makefile.in
diff -u pkgsrc/net/ndpi/patches/patch-src_lib_Makefile.in:1.7 pkgsrc/net/ndpi/patches/patch-src_lib_Makefile.in:1.8
--- pkgsrc/net/ndpi/patches/patch-src_lib_Makefile.in:1.7       Mon Nov 20 17:57:31 2023
+++ pkgsrc/net/ndpi/patches/patch-src_lib_Makefile.in   Fri Aug 23 17:54:06 2024
@@ -1,11 +1,11 @@
-$NetBSD: patch-src_lib_Makefile.in,v 1.7 2023/11/20 17:57:31 adam Exp $
+$NetBSD: patch-src_lib_Makefile.in,v 1.8 2024/08/23 17:54:06 adam Exp $
 
 Fix building on Darwin.
 
---- src/lib/Makefile.in.orig   2023-10-23 09:45:30.000000000 +0000
+--- src/lib/Makefile.in.orig   2024-08-05 07:46:22.000000000 +0000
 +++ src/lib/Makefile.in
-@@ -25,8 +25,15 @@ OBJECTS   = $(patsubst protocols/%.c, pr
- HEADERS   = $(wildcard ../include/*.h) $(wildcard ../include/*.h)
+@@ -33,8 +33,15 @@ OBJECTS   = $(patsubst protocols/%.c, pr
+ HEADERS   = $(wildcard ../include/*.h) $(wildcard *.h)
  NDPI_VERSION_MAJOR   = @NDPI_MAJOR@
  NDPI_LIB_STATIC      = libndpi.a
 +ifeq ($(OS),Darwin)
@@ -20,7 +20,7 @@ Fix building on Darwin.
  NDPI_LIBS            = $(NDPI_LIB_STATIC) $(NDPI_LIB_SHARED)
  USE_HOST_LIBGCRYPT   = @USE_HOST_LIBGCRYPT@
  
-@@ -41,8 +48,7 @@ endif
+@@ -46,8 +53,7 @@ endif
  BUILD_MINGW                    = @BUILD_MINGW@
  
  ifeq ($(OS),Darwin)
@@ -30,7 +30,7 @@ Fix building on Darwin.
  else
  ifneq ($(BUILD_MINGW),)
  NDPI_LIB_SHARED_BASE = libndpi
-@@ -63,7 +69,7 @@ $(NDPI_LIB_STATIC): $(OBJECTS)
+@@ -68,7 +74,7 @@ $(NDPI_LIB_STATIC): $(OBJECTS)
  $(NDPI_LIB_SHARED): $(OBJECTS)
        $(CC) -shared -fPIC $(CFLAGS) $(SONAME_FLAG) -o $@ $(LDFLAGS) $(OBJECTS) $(LIBS)
        ln -fs $(NDPI_LIB_SHARED) $(NDPI_LIB_SHARED_BASE)
@@ -38,12 +38,13 @@ Fix building on Darwin.
 +      ln -fs $(NDPI_LIB_SHARED) $(NDPI_LIB_SHARED_SHORT)
  
  %.o: %.c $(HEADERS) Makefile
-       $(CC) $(CPPFLAGS) $(CFLAGS) -c $< -o $@
-@@ -94,6 +100,6 @@ install: $(NDPI_LIBS)
+       $(CC) $(CPPFLAGS) $(CFLAGS) $(CFLAGS_$<) -c $< -o $@
+@@ -99,7 +105,7 @@ install: $(NDPI_LIBS)
        mkdir -p $(DESTDIR)$(PREFIX)$(libdir)
        cp $(NDPI_LIBS) $(DESTDIR)$(PREFIX)$(libdir)/
        cp -P $(NDPI_LIB_SHARED_BASE) $(DESTDIR)$(PREFIX)$(libdir)/
 -      cp -P $(NDPI_LIB_SHARED_BASE).$(NDPI_VERSION_MAJOR) $(DESTDIR)$(PREFIX)$(libdir)/
 +      cp -P $(NDPI_LIB_SHARED_SHORT) $(DESTDIR)$(PREFIX)$(libdir)/
        mkdir -p $(DESTDIR)$(PREFIX)$(includedir)
-       cp ../include/*.h $(DESTDIR)$(PREFIX)$(includedir)
+       #Avoid installing private header
+       find ../include/*.h ! -name ndpi_private.h -exec cp "{}" $(DESTDIR)$(PREFIX)$(includedir)/ \;

Added files:

Index: pkgsrc/net/ndpi/patches/patch-configure.ac
diff -u /dev/null pkgsrc/net/ndpi/patches/patch-configure.ac:1.3
--- /dev/null   Fri Aug 23 17:54:06 2024
+++ pkgsrc/net/ndpi/patches/patch-configure.ac  Fri Aug 23 17:54:06 2024
@@ -0,0 +1,15 @@
+$NetBSD: patch-configure.ac,v 1.3 2024/08/23 17:54:06 adam Exp $
+
+Portability fix.
+
+--- configure.ac.orig  2024-08-23 13:34:14.169704542 +0000
++++ configure.ac
+@@ -138,7 +138,7 @@ AC_COMPILE_IFELSE([AC_LANG_PROGRAM([[
+   ])
+ 
+ GCC_VERSION=`gcc --version | cut -d ' ' -f 3 | head -1|cut -d '.' -f 1`
+-if test "${GCC_VERSION}" == "version" ; then
++if test "${GCC_VERSION}" = "version" ; then
+   GCC_VERSION=`gcc --version | cut -d ' ' -f 4 | head -1|cut -d '.' -f 1`
+ fi
+

Prev by Date: CVS commit: pkgsrc/databases
Next by Date: CVS commit: pkgsrc/net/ntopng
Previous by Thread: CVS commit: pkgsrc/databases
Next by Thread: CVS commit: pkgsrc/net/ntopng
Indexes:

Home | Main Index | Thread Index | Old Index