Re: How to read in a (long) UTF-8 file, incrementally?

["Dmitry A. Kazakov" <mailbox@dmitry-kazakov.de>]

On 2021-11-02 18:42, Marius Amado-Alves wrote:

> So it should be possible to read a single UTF-8 character, right? Which might be 1, 2, 3, or 4 bytes long, so it must be read into a String, right? Or directly to Wide_Wide. Are there such functions?

You simply read a stream of Characters into a buffer. Never ever use 
Wide or Wide_Wide, they are useless. Inside the buffer you must have 4 
Characters ahead unless the file end is reached. Usually you read until 
some separator like line end.

Then you call this:

http://www.dmitry-kazakov.de/ada/strings_edit.htm#Strings_Edit.UTF8.Get

That will give you a code point and advance the cursor to the next UTF-8 
character.

However, normally, no text processing task needs that. Whatever you want 
to do, you can accomplish it using normal String operations and normal 
String-based data structures like maps and tables. You need not to care 
about any UTF-8 character boundaries ever.

-- 
Regards,
Dmitry A. Kazakov
http://www.dmitry-kazakov.de