transformers
[`PixtralLarge`] Update Pixtral conversion script to support large format!
#34801
Merged
Overview
Commits
46
Changes
View On GitHub

[`PixtralLarge`] Update Pixtral conversion script to support large format! #34801

ArthurZucker merged 46 commits into main from pixtral-large-script
ArthurZucker
HuggingFaceDocBuilderDev
ArthurZucker
ArthurZucker commented on 2024-11-20
Rocketknight1 Rocketknight1 force pushed to f6d61d37 1 year ago
Rocketknight1 Rocketknight1 force pushed 1 year ago
update conversion script
4f763905
update for bias again
32b14431
remove pdv
1e6695e5
Rocketknight1 use my dir
5ac86ec8
Rocketknight1 Update how we initialize the tokenizer
2448e233
Rocketknight1 Convert in bfloat16
08ae1d81
Rocketknight1 Undo that one again
e4658f03
Rocketknight1 fix config dump
72a1460d
Rocketknight1 .to() was broken for BatchMixFeature
399731b6
Rocketknight1 quick debug breakpoint
22fa744d
Rocketknight1 put the breakpoint in the right place
e95af1b0
Rocketknight1 Add a config flag for the multimodal projector bias
9df78af6
Rocketknight1 Add a config flag for the multimodal projector bias
b7569099
Rocketknight1 Conversion script can load chat templates
069accfa
Rocketknight1 Indent config for comparison
90670a50
Rocketknight1 Stop clobbering the config
e124a931
Rocketknight1 Re-enable the config clobber
bbaa6f1e
Rocketknight1 Get rid of the config manual save - it has no effect!
7a7acbbc
Rocketknight1 Handle adapter bias correctly
65e33365
Rocketknight1 Default vision transformer activation to silu
4c98a65d
Rocketknight1 Remove legacy processing path
17bfbdd5
Rocketknight1 One commit with all the debug breakpoints before I delete them all, i…
2e50b89d
Rocketknight1 Update conversion
e2b6531f
Rocketknight1 Remove vLLM debugging instrumentation
2320c145
Rocketknight1 Drop xformers
624f3c2a
Rocketknight1 Remove debug enumerates
81bde8de
Rocketknight1 make fixup
aa0630ff
Rocketknight1 make fixup
63282bb6
Rocketknight1 Break copied from in pixtral
436104d6
Rocketknight1 Propagate multimodal_projector_bias change
3a87990a
Rocketknight1 Propagate multimodal_projector_bias change
97ebda3a
Rocketknight1 Remove debug device .to()
05294a18
Rocketknight1 Restore attention weights output
984a55ef
Rocketknight1 Fix Pixtral test
88849698
Rocketknight1 Drop image_seq_length
8074e95c
Rocketknight1 Drop image_seq_length
0d29bc3e
Rocketknight1 Put the legacy processing code back
99ea497c
Rocketknight1 Rocketknight1 force pushed to 99ea497c 1 year ago
Rocketknight1 Merge branch 'main' into pixtral-large-script
5fe8af60
Rocketknight1 Add the bias option to the llava_next_video config
5eb3f6c4
Rocketknight1 Add the bias option to the llava_next_video config
6f026c1c
Rocketknight1 Rocketknight1 marked this pull request as ready for review 1 year ago
Rocketknight1
Rocketknight1 Make certain args required in converter
e39d0ea8
Rocketknight1 Make certain args required in converter
9562cd97
Rocketknight1 Merge branch 'main' into pixtral-large-script
41454f74
Rocketknight1 typo
d48f25dd
Rocketknight1 make fixup
5f125b72
Rocketknight1
Rocketknight1 commented on 2025-01-08
Rocketknight1 Reverting some dtype changes since it seems to work without them
bf2dddaf
Rocketknight1
Rocketknight1 commented on 2025-01-08
Rocketknight1
ArthurZucker
ArthurZucker commented on 2025-01-08
Rocketknight1
Rocketknight1 approved these changes on 2025-01-08
ArthurZucker ArthurZucker merged 3f483bea into main 1 year ago
ArthurZucker ArthurZucker deleted the pixtral-large-script branch 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum