birchwood-abbey.net Git - mit-scheme.git/commit

author	Chris Hanson <org/chris-hanson/cph>
	Tue, 3 Dec 2019 07:44:41 +0000 (23:44 -0800)
committer	Chris Hanson <org/chris-hanson/cph>
	Mon, 9 Dec 2019 09:49:28 +0000 (01:49 -0800)
commit	e376bc50cc0464783ca6eee480d091b1e5993bfb
tree	4067eca2f8d26194fbaba0ce9a9932f8e1342af3	tree \| snapshot
parent	6f599cc8227737d533b1cf44e9dbd05d20b3a864	commit \| diff

Pull Unicode segmentation support out of string and rewrite.

This is a nearly complete reimplementation, with a simpler and faster DFA,
providing a fold-like interface.

The describing rules are nearly identical to those in UAX #29, which makes them
much easier to write and understand. Also, there's a debugging feature that
shows how the DFA evolves for a given string.

src/runtime/make.scm		diff \| blob \| history
src/runtime/runtime.pkg		diff \| blob \| history
src/runtime/string.scm		diff \| blob \| history
src/runtime/ucd-grapheme.scm	[new file with mode: 0644]	blob
src/runtime/ucd-segmentation.scm	[new file with mode: 0644]	blob
src/runtime/ucd-word.scm	[new file with mode: 0644]	blob
tests/check.scm		diff \| blob \| history
tests/runtime/test-string.scm		diff \| blob \| history
tests/runtime/test-ucd-data/segmentation-support.scm	[new file with mode: 0644]	blob
tests/runtime/test-ucd-grapheme.scm	[new file with mode: 0644]	blob
tests/runtime/test-ucd-word.scm	[new file with mode: 0644]	blob

MIT/GNU Scheme, Pucked

RSS Atom