PR #136 Add layer wise mode to save memory

Add layer wise mode to save memory #136

n1ck-guo merged 24 commits into main from hengguo/layer-wise

add layer_wise mode

b601f8c5

clean

cb65782e

n1ck-guo requested a review from

wenhuach21 2 years ago

n1ck-guo requested a review from

WeiweiZhang1 2 years ago

fix

e802ab9a

wenhuach21 added draft

add layer-wise to

73c021fd

merge

3160fcb8

add block wise

200a001c

fix bug for layer-wise mode

78eb7e01

update

f3d32328

fix

df39c619

fix

c26639ed

fix bug for llama series forward

4cc96c84

add layer_wise load and save

45c8f83d

wenhuach21 commented on 2024-07-03

merge

8de62bd6

save scale and zp

c5f2d77d

wenhuach21 commented on 2024-07-10

change api and clean code

57320314

wenhuach21 commented on 2024-07-11

add ut

6f9a15c2

add ut

8c0a6458

[pre-commit.ci] auto fixes from pre-commit.com hooks

eefd416d

fix

4d5a03a4

Merge branch 'hengguo/layer-wise' of https://github.com/intel/auto-ro…

1152eb64

n1ck-guo requested a review from

yintong-lu 2 years ago

Merge branch 'main' into hengguo/layer-wise

b825eec7

n1ck-guo removed draft

WeiweiZhang1 approved these changes on 2024-07-12

modify ut

c1a9fe7b

Merge branch 'hengguo/layer-wise' of https://github.com/intel/auto-ro…

02b63d90

merge main

00e72c6e

n1ck-guo merged e2e33f03 into main 2 years ago

n1ck-guo deleted the hengguo/layer-wise branch 2 years ago

Reviewers

WeiweiZhang1

wenhuach21

yintong-lu

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

auto-round Add layer wise mode to save memory #136 Merged

Add layer wise mode to save memory #136

auto-round
Add layer wise mode to save memory
#136

Merged