PR #3197 Speedup and reduce binary size for TfIdfVectorizer

Speedup and reduce binary size for TfIdfVectorizer #3197

yuslepukhin merged 13 commits into master from yuslepukhin/speedup_tfidf

Speed up TfIdf history begins.

048949ba

Use ParallelFor() for each of the rows processing.

02f52720

Make it non-template, batch it.

3ea23146

Parallellize processing.

d45af680

Re-work. TODO: Tests failing.

a872cf59

Handle UniGrams only once.

043963aa

Batch all types.

c4774c4a

Check for short tail within the inner loop.

e86a9d8a

Merge branch 'master' into yuslepukhin/speedup_tfidf

5c97dcf8

yuslepukhin requested a review from

skottmckay 5 years ago

yuslepukhin requested a review from

pranavsharma 5 years ago

yuslepukhin requested a review 5 years ago

yuslepukhin requested a review from

hariharans29 5 years ago

yuslepukhin requested a review from

BowenBao 5 years ago

skottmckay commented on 2020-03-12

Rework recursive definition.

edcdf19c

skottmckay commented on 2020-03-12

Use forward decl for recursive class definition.

1084ba93

Make GCC happy.

2e88b9d2

yuslepukhin requested a review from

snnn 5 years ago

snnn commented on 2020-03-13

TryBatchParallelFor will do a good job computing the number of batches.

90911e4f

snnn approved these changes on 2020-03-13

yuslepukhin merged 2a6e5ce9 into master 5 years ago

yuslepukhin deleted the yuslepukhin/speedup_tfidf branch 5 years ago

Reviewers

snnn

skottmckay

pranavsharma

hariharans29

BowenBao

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

onnxruntime Speedup and reduce binary size for TfIdfVectorizer #3197 Merged

Speedup and reduce binary size for TfIdfVectorizer #3197

onnxruntime
Speedup and reduce binary size for TfIdfVectorizer
#3197

Merged