Re: bin/57616: sed(1) is unable to process multibyte unicode characters properly

["Fege, Marc Daniel" <marc.fege%uni-bonn.de@localhost>]

Hello Michael,

thank's a lot for your quick reply.

> Wide char support ("NLS") from FreeBSD was integrated in 2021 and
> will be in NetBSD-10.

That's fantastic news. So it seems, that I'm a little late with my bug report, then, even though, 9.3 is the most recent stable release, and the issue is at least valid for 9.x the branch.

However: are there plans to backport that stuff to a possible NetBSD 9.4 or do we actually have to wait for possible 10 release?

> It's not actually about sed failing but what the underlying regexp
> library can do.

Due to the fact, that I'm just an ordinary user, not a developer in any way, I was unable to state details beyond surface level diagnostic. What I see as a user as frontend of all of that underlying stuff is just a program called sed(1). That's why I was referring to it in a certain use case.

Thank's alot!

Am Montag, den 11.09.2023 um 17:05 schrieb mlelstv%serpens.de@localhost (michael van elst):

The following reply was made to PR bin/57616; it has been noted by GNATS.

From: mlelstv%serpens.de@localhost (Michael van Elst)
To: gnats-bugs%netbsd.org@localhost
Cc:
Subject: Re: bin/57616: sed(1) is unable to process multibyte unicode characters properly
Date: Mon, 11 Sep 2023 15:03:24 -0000 (UTC)

marc.fege%uni-bonn.de@localhost writes:

>NetBSD rpi 9.3 NetBSD 9.3 (RPI) #0: Thu Aug  4 15:30:37 UTC 2022  mkrepro%mkrepro.NetBSD.org@localhost:/usr/src/sys/arch/evbarm/compile/RPI evbarm

>sed(1) has a problem processing multibyte unicode characters properly.

>     echo "abc???xyz" | sed 's/./& /g'
>I expect the following output format for further processing:
>     "a b c ? ? ? x y z "


It's not actually about sed failing but what the underlying regexp
library can do.

Wide char support ("NLS") from FreeBSD was integrated in 2021 and
will be in NetBSD-10.