llama.cpp
server : vision support via libmtmd
#12898
Merged
Overview
Commits
79
Changes
View On GitHub
Commits
  • server : (experimental) vision support via libmtmd
    ngxson committed 1 year ago
  • mtmd : add more api around mtmd_image_tokens
    ngxson committed 1 year ago
  • mtmd : add more api around mtmd_image_tokens
    ngxson committed 1 year ago
  • mtmd : ability to calc image hash
    ngxson committed 1 year ago
  • shared_ptr for mtmd_image_tokens
    ngxson committed 1 year ago
  • move hash to user-define ID (fixed)
    ngxson committed 1 year ago
  • Merge branch 'xsn/mtmd_image_api' into xsn/server_mtmd
    ngxson committed 1 year ago
  • abstract out the batch management
    ngxson committed 1 year ago
  • Merge branch 'master' into xsn/server_mtmd
    ngxson committed 1 year ago
  • Merge branch 'master' into xsn/server_mtmd
    ngxson committed 1 year ago
  • small fix
    ngxson committed 1 year ago
  • refactor logic adding tokens to batch
    ngxson committed 1 year ago
  • implement hashing image
    ngxson committed 1 year ago
  • Merge branch 'master' into xsn/server_mtmd
    ngxson committed 1 year ago
  • use FNV hash, now hash bitmap instead of file data
    ngxson committed 1 year ago
  • allow decoding image embedding to be split into batches
    ngxson committed 1 year ago
  • rm whitespace
    ngxson committed 1 year ago
  • Merge branch 'master' into xsn/server_mtmd
    ngxson committed 1 year ago
  • disable some features when mtmd is on
    ngxson committed 1 year ago
  • fix --no-mmproj-offload
    ngxson committed 1 year ago
  • mtmd_context_params no timings
    ngxson committed 1 year ago
  • Merge branch 'master' into xsn/server_mtmd
    ngxson committed 1 year ago
  • refactor server_inp to server_tokens
    ngxson committed 1 year ago
  • fix the failing test case
    ngxson committed 1 year ago
  • init
    ngxson committed 1 year ago
  • wip
    ngxson committed 1 year ago
  • Merge branch 'master' into xsn/mtmd_c_api
    ngxson committed 1 year ago
  • working version
    ngxson committed 1 year ago
  • add mtmd::bitmaps
    ngxson committed 1 year ago
  • add test target
    ngxson committed 1 year ago
  • rm redundant define
    ngxson committed 1 year ago
  • test: mtmd_input_chunks_free
    ngxson committed 1 year ago
  • rm outdated comment
    ngxson committed 1 year ago
  • Merge branch 'master' into xsn/mtmd_c_api
    ngxson committed 1 year ago
  • fix merging issue
    ngxson committed 1 year ago
  • explicitly create mtmd::input_chunks
    ngxson committed 1 year ago
  • mtmd_input_chunk_copy
    ngxson committed 1 year ago
  • add clone()
    ngxson committed 1 year ago
  • Merge branch 'master' into xsn/server_mtmd
    ngxson committed 1 year ago
  • improve server_input struct
    ngxson committed 1 year ago
  • clip : fix confused naming ffn_up and ffn_down
    ngxson committed 1 year ago
  • rm ffn_i/o/g naming
    ngxson committed 1 year ago
  • rename n_embd, n_ff
    ngxson committed 1 year ago
  • small fix
    ngxson committed 1 year ago
  • Merge branch 'master' into xsn/clip_ffn_up_down_fix
    ngxson committed 1 year ago
  • no check n_ff
    ngxson committed 1 year ago
  • Merge branch 'xsn/clip_ffn_up_down_fix' into xsn/server_mtmd
    ngxson committed 1 year ago
  • fix detokenize
    ngxson committed 1 year ago
  • Merge branch 'master' into xsn/mtmd_c_api
    ngxson committed 1 year ago
  • add const to various places
    ngxson committed 1 year ago
  • add warning about breaking changes
    ngxson committed 1 year ago
  • Merge branch 'xsn/mtmd_c_api' into xsn/server_mtmd
    ngxson committed 1 year ago
  • add c api
    ngxson committed 1 year ago
  • helper: use mtmd_image_tokens_get_n_pos
    ngxson committed 1 year ago
  • Merge branch 'xsn/mtmd_c_api' into xsn/server_mtmd
    ngxson committed 1 year ago
  • Merge branch 'master' into xsn/server_mtmd
    ngxson committed 1 year ago
  • fix ctx_shift
    ngxson committed 1 year ago
  • fix name shadowing
    ngxson committed 1 year ago
  • Merge branch 'master' into xsn/server_mtmd
    ngxson committed 1 year ago
  • Merge branch 'master' into xsn/server_mtmd
    ngxson committed 1 year ago
  • more strict condition
    ngxson committed 1 year ago
  • support remote image_url
    ngxson committed 1 year ago
  • Merge branch 'master' into xsn/server_mtmd
    ngxson committed 1 year ago
  • remote image_url log
    ngxson committed 1 year ago
  • add CI test
    ngxson committed 1 year ago
  • do not log base64
    ngxson committed 1 year ago
  • add "has_multimodal" to /props
    ngxson committed 1 year ago
  • remove dangling image
    ngxson committed 1 year ago
  • speculative: use slot.cache_tokens.insert
    ngxson committed 1 year ago
  • Merge branch 'master' into xsn/server_mtmd
    ngxson committed 1 year ago
  • Apply suggestions from code review
    ngxson committed 1 year ago
  • rm can_be_detokenized
    ngxson committed 1 year ago
  • on prmpt processing done, assert cache_tokens.size
    ngxson committed 1 year ago
  • handle_completions_impl returns void
    ngxson committed 1 year ago
  • Merge branch 'master' into xsn/server_mtmd
    ngxson committed 1 year ago
  • adapt the new web ui
    ngxson committed 1 year ago
  • update docs and hot topics
    ngxson committed 1 year ago
  • rm assert
    ngxson committed 1 year ago
  • small fix (2)
    ngxson committed 1 year ago
FAQ Terms Privacy Refunds Impressum
Loading