[WIP] Merge Chinese Word Segmentation work #19166
seanbudd
wants to merge
125 commits into
master
from
try-chineseWordSegmentation-staging
Introduce cppjieba as a submodule for Chinese word segmentation
5cb5189d
Update what's new
fb4efef4
Add comments for building script of cppjieba and its dependency
ae58e9b9
Update projectDocs/dev/createDevEnvironment.md
06070c12
Update include/readme.md
2273a604
Remove changes in sconscript for localLIb
3d4d9f11
add building script for cppjieba
1fbf05f4
add JiebaSingleton wrapper and C API for NVDA segmentation
7de7464e
Merge branch 'master' into integrateCPPJieba
f4cab8af
Merge branch 'master' into integrateCPPJieba
d4c3a926
Update GitHub action workflow to fetch cppjieba's submodule
0d92c086
Update .gitignore for cppjieba
da662bed
Update building and setup script for cppjieba's dicts installation
38a12dcf
update copyright headers based on @seanbudd's suggestions
c60c2da8
Update include/readme.md
c853b640
Merge branch 'master' into integrateCPPJieba
53dd3bb5
Merge branch 'master' into integrateCPPJieba
eba63ab8
add `WordSegment` module
b0ac0819
update `textUtils/__init__.py`
9f62f04d
update `textInfos/offsets.py`
81f20404
update `displayModel.py`
da64cd88
![pre-commit-ci[bot]](https://avatars.githubusercontent.com/in/68672?v=4&s=60)
Pre-commit auto-fix
557f4043
update type annotations
f72d3488
Merge branch 'master' into integrateCPPJieba
19cad8a3
add wrapper for word manager
adc22fb9
update the word segmentation structure
4adac073
Merge branch 'integrateCPPJieba' into wordNavigationForChineseText
407d4b27
Pre-commit auto-fix
0d40f0a1
add copyright header
676fc42f
add type annotations
ddd48e86
update log
3c65868c
add trailing commas in multi-line constructs
d69e8b7c
make wordSegment module to make file structure clearer
8244a76e
add initialization logic to wordSeg module
3f54d62b
Pre-commit auto-fix
38b4bea4
use multithreading for cppjieba's initialization
eeb96aa7
add configuration for word navigation
3ba56f0a
Pre-commit auto-fix
356c11c0
make "Auto" the default option for word navigation
4a680ea5
update for pyright checks
97b6db7a
Merge branch 'master' into integrateCPPJieba
a643391d
add wrappers for user dict management
3e495d2c
Merge branch 'integrateCPPJieba' into wordNavigationForChineseText
a4edc9e2
resolve deprecation
3b2d8353
Pre-commit auto-fix
9e6a2e19
Merge branch 'master' into integrateCPPJieba
11827fb2
simplify the initialization of cppjieba
1869ed00
Merge branch 'integrateCPPJieba' into wordNavigationForChineseText
c1fb4b85
add `segmentedText` method
a1113d80
add word separator to optimize braille output for Chinese text
2d7c5968
Merge branch 'master' into integrateCPPJieba
fe118eec
update cppjieba to the latest commit
49cc1fe9
update .gitattributes for .hpp header files
a9281f62
simplify helper of `cppjieba`
2955ca8a
Merge branch 'integrateCPPJieba' into wordNavigationForChineseText
abeb1475
update `wordSegStrategy.py`
b848e1ba
update module importing order and type annotations
3bfbe59d
update changelog
53158b6b
update building script
30120f8a
revert installing script
00796fef
fix building script
09b18901
Merge branch 'master' into integrateCPPJieba
bec5dc5d
update helper of `coojieba`
b3e08ee8
Merge branch 'integrateCPPJieba' into wordNavigationForChineseText
f5087cc7
update `wordSegStrategy.py`
3a0badc7
Pre-commit auto-fix
cf3e1150
Merge branch 'master' into integrateCPPJieba
984b6eb2
Merge branch 'integrateCPPJieba' into wordNavigationForChineseText
2b1d4b33
handle punctuation spacing
97eb6dd4
Pre-commit auto-fix
bac32106
Merge branch 'master' into integrateCPPJieba
0f507d51
Revert "Update projectDocs/dev/createDevEnvironment.md"
c2cbb240
avoid using compilation time path
194a69ea
Update .gitattributes
2e730d6a
Revert "update module importing order and type annotations"
a8955a3b
Merge branch 'integrateCPPJieba' into wordNavigationForChineseText
7ee08d0f
update `wordSegStrategy.py`
90660ba3
revert copyright header of `configSpec.py`
9537999a
Update source/core.py
dc23346c
Merge branch 'try-chineseWordSegmentation-staging' into integrateCPPJ…
30e855f7
Merge branch 'master' into integrateCPPJieba
5562e70b
Merge branch 'integrateCPPJieba' into wordNavigationForChineseText
38ec7ffb
correct method naming
ccf07f9f
update UI text for Uniscribe
250e7007
make `cppjieba` only available when NVDA's language is set to Chinese
53b38706
Merge branch 'master' into integrateCPPJieba
fec70a9f
Merge branch 'integrateCPPJieba' into wordNavigationForChineseText
69617c49
update `wordSegSegmenter.py` to handle offsets at the end of the string
111a24d1
make initialization of word segmenters conditional on language
43bfe036
add unittest cases for `WordSegmenter`
2eec029e
Pre-commit auto-fix
f7694572
fixup
9479029f
extract punctuation from `wordSegStrategy.py` to `wordSegUtils.py`
9834b686
fix up
b69d466f
update changelog
6f586fd0
Merge branch 'wordNavigationForChineseText' into brailleOutputForChinese
9304a39a
correct and simplify the offset calculations
3b7bf5fa
update changelog
251811e4
Merge branch 'try-chineseWordSegmentation-staging' into integrateCPPJ…
b327e239
Merge branch 'integrateCppJieba' into try-chineseWordSegmentation-sta…
093a825f
Merge branch 'try-chineseWordSegmentation-staging' into wordNavigatio…
face4bd5
revert `Initialize Word Segmenters for Unused Languages:` checkbox an…
b40d7095
Pre-commit auto-fix
653e8087
fixup unittests
552b42bd
simplify the logic for 'Auto' option in Word Segmentation Standard se…
5e0e3fdb
Pre-commit auto-fix
c3a85623
fixup
0940a73f
Merge branch 'wordNavigationForChineseText' into brailleOutputForChinese
9ab3dba0
fixup
d1373b20
Pre-commit auto-fix
f98b1b19
Pre-commit auto-fix
80b04729
Merge branch 'master' into try-chineseWordSegmentation-staging
4a4b1aff
Merge branch 'try-chineseWordSegmentation-staging' into wordNavigatio…
085ba2fc
Pre-commit auto-fix
d55d077d
fixup
20830956
make word segmentation module reinitialized after settings are saved
d32549f3
Pre-commit auto-fix
b8ace769
Merge branch 'master' into try-chineseWordSegmentation-staging
c86b760b
Merge branch 'try-chineseWordSegmentation-staging' into wordNavigatio…
042b7788
fixup
d2714a36
remove duplicate importing lines
db90fff0
Merge pull request #18735 from CrazySteve0605/wordNavigationForChines…
b50a0d51
Merge branch 'try-chineseWordSegmentation-staging' into brailleOutput…
0d27c910
Pre-commit auto-fix
9cafffb0
Merge pull request #18865 from CrazySteve0605/brailleOutputForChinese
29d9f5ab
seanbudd
changed the title
Reviewers
Assignees
No one assigned
Labels
conceptApproved
merge-early
Milestone
No milestone
Login to write a write a comment.
Login via GitHub