microsoft/onnxruntime

Pull Requests Commits

fixed build and linting

fajin-corp committed 2 years ago

28906061

fixed bloked Q 4bit multithread bug

fajin-corp committed 2 years ago

6ab9e5d3

fixed one opNotLastAxis

fajin-corp committed 2 years ago

4f8c2e40

finished TransposeColumnWiseQuantizedPackUnaligned

fajin-corp committed 2 years ago

7fdcd8bc

updated TransposeColumnWiseQuantizedPackAligned

fajin-corp committed 2 years ago

3245026e

finished quantize pack unaligned

fajin-corp committed 2 years ago

ee356b00

refactored QuantizeColumnWisePackAligned

fajin-corp committed 2 years ago

d6b58c75

limit to 4 bits, and separate out pack aligned and unaligned

fajin-corp committed 2 years ago

8dc4d120

adding unaligned code

fajin-corp committed 2 years ago

0ee4de15

fix build error

fajin-corp committed 2 years ago

10589ade

added headers and py binding

fajin-corp committed 2 years ago

6cb36fe4

finished transpose

fajin-corp committed 2 years ago

d03db4c1

added aligning limit and updated quantizeColumnWise

fajin-corp committed 2 years ago

b70e37b6

fajin-corp committed 2 years ago

255fc53d

added quantizeColumnWise

fajin-corp committed 2 years ago

07f9af21

adding qdq quantize for matmulnbits

fajin-corp committed 2 years ago

500867fc

adding python interface

fajin-corp committed 2 years ago

aeaeee4d

Adding a sm80 q4 gemm kernel for small tiles (#20545)

chenfucn committed 2 years ago

Verified 6fb09055

Add "-allow-unsupported-compiler" flags to Windows CUDA flags (#21004)

Changming Sun committed 2 years ago

Verified feec8efa

Update MultiHeadAttention benchmark to test CPU (#20972)

tianleiwu committed 2 years ago

Verified a2b0a69d

Fix a few issues in "Zip-Nuget-Java-Nodejs Packaging Pipeline" (#21014)

Changming Sun committed 2 years ago

Verified 99f0fe3f

Define _DISABLE_CONSTEXPR_MUTEX_CONSTRUCTOR (#21005)

baijumeswani committed 2 years ago

Verified 94aa21c3

[CPU EP] Add blocked quantization to QuantizeLinear op kernel (#20977)

fajin-corp committed 2 years ago

Verified 9be30348

Upgrade ESRP signing task from v2 to v5 (#20995)

mszhanyi committed 2 years ago

Verified 17d5dc50

test: refactor flash_attn tests to use parameterized (#20913)

cloudhan committed 2 years ago

Verified 67c8befd

[CUDA] upgrade cutlass to 3.5.0 (#20940)

tianleiwu committed 2 years ago

Verified b3fc9b5a

[js/web] ESM: use the bundled target as default export (#20991)

fs-eire committed 2 years ago

Verified dd805ff7

Updating cudnn from 8 to 9 on exsiting cuda 12 docker image (#20925)

jchen351 committed 2 years ago

Verified 05032e5e

[WebNN EP] Support latest WebNN softmax op (#20827)

Honry committed 2 years ago

Verified 043ef5c9

Publish Build Symbols for DML nightly nuget package (#20988)

Changming Sun committed 2 years ago

Verified ae4a2e6b

Older