CVS commit: pkgsrc/mail/rspamd

["Sebastian Wiedenroth" <wiedi%netbsd.org@localhost>]

Module Name:    pkgsrc
Committed By:   wiedi
Date:           Fri Jun  5 00:49:35 UTC 2015

Modified Files:
        pkgsrc/mail/rspamd: Makefile PLIST distinfo

Log Message:
Update rspamd to 0.9.5

0.9.5:
        * Avoid double free when extending HTTP message.
        * Fix double free if multiple classifiers are defined.
        * Fix misprint in spamassassin plugin.
        * Fix cpuid invocation on i386.
        * Fix ownership issues for zero-copy decode.
        * Allow __len metamethod on rspamd{text}.
        * Add base64 decoding lua utility.
        * Fix build on FreeBSD
        * Skip spaces at the beginning of mime messages.
        * DBL_ABUSE_REDIR should not have significant weight.
        * Allow to split by lua_regexp rspamd{text} objects.
        * Allow to specify custom stop pattern for lua_tcp.

0.9.4:
        * Fix critical bugs in tokenization algorithm
        * Write unit tests for tokenization
        * Add documentation for lua_tcp
        * Switch off legacy tokenization by default.
        * Fix critical bugs in words normalization
        * Add lua bindings to tokenizer.
        * Implement storing of HTTP headers inside task
        * Add lua API to accerss HTTP headers data
        * Implemented base64 encoding suitable for MIME
        * Use caseless hash and equal functions for HTTP request headers.
        * Improve debian architectures support (by @dottedmag)

0.9.3:
        * Revert incorrect regexp change that broke the default rules
        * Fix lua_tcp module

0.9.2:
        * Fix error on spawning unique workers.
        * Add preliminary version of generic LUA TCP requests API.
        * Use lua 5.1 if luajit is not available (Arm64, PowerPC, s390x etc)
        * Fix fuzzy mime strings with only type.
        * Improve thunderbird sanity checks.
        * Fix critical bug on matching regular expressions.
        * Make hiredis optional dependency.
        * Fix multiple bugs in daemon reloading

0.9.1:
        * Restore utf8 validation for regular expressions to avoid crashes
        * Fix symbols displaying in the interface
        * Add symbol groups to the interface
        * Fix maps ID parsing in the controller
        * Add multimap and regexp modules documentation
        * Backport fixes from libucl
        * Fix debian package (by @dottedmag)
        * Rework XXH32 invocations

0.9.0:
        * Add support of the fast and secure protocol level encryption:
                - curve25519 is used for key exchange;
                - chacha20/poly1305 cryptobox construction for bulk encryption;
                - zero latency overhead;
                - encrypting and balancing HTTP proxy worker
        * Rework expressions and create new expressions library:
                - aggressive optimizations based on the abstract syntax tree;
                - abstract expressions support (regular expressions, functions, lua modules
                  composites and so on)
                - New comparision and '+' operators support
                - New greedy algorithm to minimize execution time of expressions and
                  all symbols
                - Dynamic expressions benchmark and reoptimizations
        * Many improvements to the LUA API:
                - reworked logger module allowing to do pretty print of the most of lua
                  types (including tables and userdata classes)
                - reworked lua redis and lua HTTP to support more features
                - added opaque type for passing large text chunks without copying
                - new regexp module with many auxiliary functions (e.g. `re:split`)
        * LuaJIT is now the default requirement for rspamd allowing to speed up lua
          execution by a large margin (however, plain lua is still supported)
        * New plugins:
                - spamassassin rules plugin that allows to load and re-use the most of
                  SA rules natively
                - DMARC plugin that evaluates SPF and DKIM policies to the domain policies
                - many old plugins has been reworked to implement new features and improve
                  stability
        * New aho-corasic trie implementation from @mischasan that allows to load and
          use hundreds of thousands of patterns with no influence on load
        * Support of PCRE JIT and PCRE JIT fast path modes that significantly improves
          the performance of regular expressions if supported by PCRE
        * New URLs parser and extractor:
                - removed legacy code that was useless for url finding
                - reworked algorithms of URL parsing for more precise and accurate results
                - added top-level-domains tree from http://publicsuffix.org
                - improved emails parsing
                - removed many phishing false positives due to TLD tree check
        * New statistics infrastructure:
                - created a separate layer of statistic library
                - improved OSB-Bayes by re-weighting tokens according to the original
                  academic paper and `crm114` implementation, which reduced false positives
                  rate significantly
                - created learn cache to avoid double learning of statistics and providing
                  an efficient way to re-learn class for a message
                - created abstract layers for different statistics backends
                - implemented new tokenization algorithms with fast or secure (siphash)
                  hashes to generate statistics features
        * Reworked utf8 tokenization that previously corrupted all UTF8 words (minor
          incompatibility with old fuzzy hashes with utf-8 symbols)
        * SPF module has been completely rewritten to support complex cases of
          `include` and `redirect` within SPF records
        * DKIM module now supports multiple signatures
        * Controller passwords can now be stored encrypted by `PBKDF2-HMAC` in the
          configuration file
        * Many hand-written HTTP clients has been replaced with the common rspamd
          http module
        * New test framework:
                - import lua `telescope` test framework
                - add unit tests for many rspamd modules and routines
                - create a unit test for each possible bug found
                - use luajit ffi for testing C code
                - added preliminary support of functional testing by creating tasks from lua
        * Randomize hash seed to avoid certain hash tables vulnerabilities
        * Documentation improvements:
                - added documentation for the vast majority of rspamd modules
                - added documentation for rspamd protocol
                - added documentation for the most of rspamd LUA extensions
        * Fixed tonns of bugs and memory leaks
        * Added tonns of minor features

0.8.3:
        * Various critical fixes in distribution (by @dottedmag and @fatalbanana)
        * Fixed bugs in url detector to parse certain patterns
        * Add default host and helo for a client
        * Some sanity checks for tokenizer and classifier
        * Reiterate on systemd support
        * Fix missing symbol registration
        * Add support of spamc compatible output
        * Filter double-dots in rbl.lua validate_dns (by @fatalbanana)
        * Update ucl submodule due to critical bugfix

0.8.2:
        * Create fuzzy db if it does not exist
        * Fix: Centos init script: configtest() (by @AlexeySa)
        * Enable one_shot for RECEIVED_SPAMHAUS_XBL - Fixes #102 (by @fatalbanana)
        * Update Exim patch (by @fatalbanana)
        * Fix processing of unix sockets.
        * Allow applying settings to authenticated users (by @fatalbanana)
        * Make settings priorities work as documented (by @fatalbanana)
        * Fix race condition in symbols planner
        * Add DNSWL_BLOCKED symbol (by @fatalbanana)
        * Make Exim pass usernames to rspamd (by @fatalbanana)
        * Update RBL module (by @fatalbanana):
                - fix indentation;
                - collapse loops;
                - avoid calling for un-needed information;
                - allow disabling RBLs for authenticated users
        * once_received.lua: Fix indentation & add exclusion for authenticated users (by @fatalbanana)
        * hfilter.lua: Add exclusion for authenticated users (by @AlexeySa)
        * Updates to hfilter rules (by @AlexeySa)
        * Set empty <> user or addr for msgs without FROM (by @eneq123)
        * Fix: attempt to index field '?' (a nil value) (by @eneq123)
        * Fix: if not exist Date-header (by @AlexeySa)
        * Add task:get_content() method.
        * rbl.lua: Ignore private IP space (by @fatalbanana)
        * Allow to check radix maps from lua by rspamd{ip}
        * Make local exclusions configurable per-RBL (by @fatalbanana)
        * Add rspamd_config:radix_from_config() (by @fatalbanana)
        * Support emails dnsbl in rbl (by @fatalbanana)
        * Complete rework of url extraction logic
        * Allow customizations for unix sockets. (fixes #182)
        * Set lua path according to rspamd settings.
        * Import lua-functional for plugins stuff.
        * Completely rewrite multimap plugin in functional style.
        * Fix FORGED_MUA_THUNDERBIRD_MSGID (fixes #186)
        * Check IPv6 addresses at dnswl.org and Spamhaus whitelist (by @fatalbanana)
        * Add lowercase utility for utf8 strings.
        * Various fixes to build system
        * Updated debian configuration infrastructure (by @dottedmag)


To generate a diff of this commit:
cvs rdiff -u -r1.11 -r1.12 pkgsrc/mail/rspamd/Makefile
cvs rdiff -u -r1.2 -r1.3 pkgsrc/mail/rspamd/PLIST
cvs rdiff -u -r1.4 -r1.5 pkgsrc/mail/rspamd/distinfo

Please note that diffs are not public domain; they are subject to the
copyright notices on the relevant files.