Skip to main content

Browse the archive

https://github.com/JuliaLang/julia
19 April 2024, 06:28:37 UTC
Revision 62c423ba8630d7ae45eb82d5748daf77a6100cac authored by Steven G. Johnson on 06 January 2017, 13:02:27 UTC, committed by Tony Kelman on 06 January 2017, 13:02:27 UTC 
WIP: custom Unicode normalization for Julia identifiers (#19464)
 
* implement custom Julia Unicode normalization for confusable characters in identifiers

* whoops

* separated julia_charmap into its own file to make it easier to update

* normalize fullwidth -> halfwidth in identifiers, ala NFKC

* make \varepsilon complete to ε (u+03b5), fixes #14751

* docs for canonicalization

* normalize fullwidth characters during parsing (fixes #5903)

* typo

* tests

* be more cautious about normalizing chars when parsing, so as not to normalize string literals

* test fullwidth numeric literals and parens

* typo/clarification

* update to utf8proc-2.1

* checksum for utf8proc 2.1

* moved symbol-normalization test from test/core to test/parse

* Revert "be more cautious about normalizing chars when parsing, so as not to normalize string literals"

This reverts commit 81033fa0a0f11f9e42907e3348c64b95f070cac4.

* Revert "normalize fullwidth characters during parsing (fixes #5903)"

This reverts commit cf61972a68bc76b4f2fdbebc5a9fb3e5c9619338.

* remove more references to fullwidth normalization

* rm fullwidth identifier normalization
1 parent 5407a0d
History
Tip revision: 62c423ba8630d7ae45eb82d5748daf77a6100cac authored by Steven G. Johnson on 06 January 2017, 13:02:27 UTC
WIP: custom Unicode normalization for Julia identifiers (#19464)
Tip revision: 62c423b
File Mode Size
.github
base
contrib
deps
doc
etc
examples
src
test
ui
.gitignore -rw-r--r-- 213 bytes
.mailmap -rw-r--r-- 9.5 KB
.travis.yml -rw-r--r-- 5.5 KB
CONTRIBUTING.md -rw-r--r-- 19.4 KB
DISTRIBUTING.md -rw-r--r-- 8.2 KB
HISTORY.md -rw-r--r-- 73.8 KB
LICENSE.md -rw-r--r-- 5.3 KB
Make.inc -rw-r--r-- 33.3 KB
Makefile -rw-r--r-- 26.9 KB
NEWS.md -rw-r--r-- 41.5 KB
README.arm.md -rw-r--r-- 4.5 KB
README.md -rw-r--r-- 28.1 KB
README.windows.md -rw-r--r-- 17.5 KB
VERSION -rw-r--r-- 10 bytes
Windows.inc -rw-r--r-- 1.5 KB
appveyor.yml -rw-r--r-- 2.1 KB

README.md

back to top