Skip to content

East_Asian_Width 3.1.1 ætiology #1482

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
eggrobin merged 1 commit into from
Jul 15, 2026
Merged

East_Asian_Width 3.1.1 ætiology #1482

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 6 additions & 3 deletions unicodetools/src/main/java/org/unicode/text/tools/Ætiologer.java
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -504,9 +504,8 @@ private static boolean AnalyseAction(
properties:
for (final var property : candidateProperties) {
// TODO(egg): Horribly load-bearing. We must read the latest files because we use
// the
// new @missing lines for files that predate @missing lines, and we do not do that
// automatically. See https://github.com/unicode-org/unicodetools/issues/1438.
// the new @missing lines for files that predate @missing lines, and we do not do
// that automatically. See https://github.com/unicode-org/unicodetools/issues/1438.
IndexUnicodeProperties.make().load(property);
final var newProperty = iup.getProperty(property);
final var oldProperty = previousIUP.getProperty(property);
Expand Down Expand Up @@ -597,6 +596,10 @@ private static void checkReasons(
Map<UcdProperty, Map<VersionInfo, UnicodeMap<List<String>>>> reasons) {
for (final var propertyReasons : reasons.entrySet()) {
final var property = propertyReasons.getKey();
// TODO(egg): Horribly load-bearing. We must read the latest files because we use the
// new @missing lines for files that predate @missing lines, and we do not do that
// automatically. See https://github.com/unicode-org/unicodetools/issues/1438.
IndexUnicodeProperties.make().load(property);
for (final var versionReasons : propertyReasons.getValue().entrySet()) {
final var newVersion = versionReasons.getKey();
final var newIUP = IndexUnicodeProperties.make(newVersion);
Expand Down
5 changes: 5 additions & 0 deletions unicodetools/src/main/resources/org/unicode/text/tools/reasons_auto.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -992,6 +992,11 @@ Canonical_Combining_Class ; 16.0 ; [ࢗ] ; 176-C17
# Documentation for changes to East_Asian_Width assignments
# ==========================================================

# East_Asian_Width assignment changes in Unicode Version 3.1.1
# L2/01-189
# null
East_Asian_Width ; 3.1.1 ; [®ŋ˄˟•․‾№⅓⅜⅝↸↹⇧✽] ; L2/01-189, 87-M20

# East_Asian_Width assignment changes in Unicode Version 6.2
# L2/12-160@Tue Apr 3 16:52:11 CDT 2012
# [131-C29] Consensus: Change the East Asian width property of characters 11A3..11A7, 11FA..11FF, D7B0..D7FB from "W" to "N", for Unicode 6.2. [L2/12-160]
Expand Down
7 changes: 7 additions & 0 deletions unicodetools/src/main/resources/org/unicode/text/tools/reasons_manual.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,3 +1,10 @@
# [87-M20] Motion: Update the East Asian data files changing the list in L2/01-189, 00AE to 273D to A, and all Jamo to W, post, and include in Unicode 3.1.1.
# L2/01-189 Updates to EastAsianWidth.
# First group (to ea=A). U+00AF not changed.
East_Asian_Width ; 3.1.1 ; [\u00AE\u014B\u02C4\u02DF\u2022\u2024\u203E\u2116\u2153\u215C\u215D\u21B8\u21B9\u21E7\u273D] ; L2/01-189, 87-M20

@robertbastian robertbastian Jul 15, 2026

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I find [®ŋ˄˟•․‾№⅓⅜⅝↸↹⇧✽] more readable than whatever these escapes are. with [®ŋ˄˟•․‾№⅓⅜⅝↸↹⇧✽] I can see that it's the same set across the files

@eggrobin eggrobin Jul 15, 2026

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is mostly a write-only input file, and these code points are from L2/01-189 (I copied them from there). The output file (reasons_auto) tries to be readable and uses [®ŋ˄˟•․‾№⅓⅜⅝↸↹⇧✽].

# Second group (to ea=W). U+00AF, U+FF78 not changed.
East_Asian_Width ; 3.1.1 ; [[\u2024\u2022\u203E\u02C4\u273D\u02DF\u2116\u21E7\u21B8\u21B9][\u2116][\u2116\u2116][\u014B\u2153\u215C\u215D\u2116\u00AE]] ; L2/01-189, 87-M20

# [106-C17] Consensus: Give unassigned codepoints the script property value "Zzzz". [L2/05-376]
Script ; 5.0 ; \p{U5.0:Zzzz} ; L2/05-376, 106-C17
# See discussion in L2/25-183, Section 2.1.
Expand Down
1 change: 0 additions & 1 deletion unicodetools/src/main/resources/org/unicode/text/tools/reasons_unknown.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -426,7 +426,6 @@ Canonical_Combining_Class ; 2.1.9 ; [ཱ༵༷֮⃡] ; # Yet unexplained
Canonical_Combining_Class ; 3.0 ; [ెํໍ] ; # Yet unexplained
Decomposition_Type ; 4.0 ; [⁇⁗ ⁱℽ-⅀ⅅ-ⅉ⨌⩴-⩶⫝̸ゟヿ㉑-㉟㊱-㊿侮-頻﷼｟｠] ; # Yet unexplained
East_Asian_Width ; 3.1 ; [〈〉〈〉〔〕〘〙㐁-䶴丁-龤각-힢-󰀀-󿿽􀀀-􏿽] ; # Yet unexplained
East_Asian_Width ; 3.1.1 ; [®ŋ˄˟•․‾№⅓⅜⅝↸↹⇧✽] ; # Yet unexplained
East_Asian_Width ; 3.2 ; [⅕〈〉Ⓚ-Ⓩ╴❶-❿　〈-》〔〕〘-〛] ; # Yet unexplained
East_Asian_Width ; 4.0 ; [𪛗-𯟿𯨞-𯿽𰀀-𿿽] ; # Yet unexplained
East_Asian_Width ; 5.2 ; [䶶-䶿鿌-鿿郞隷﩮﩯﫚-﫿] ; # Yet unexplained
Expand Down
Loading