https://fxtwitter.com/vllm_project/status/1911669255428542913OKHK 👀DeepSeek 决定不完全开源其推理引擎,通过与上游开源项目(vLLM)的合作,贡献一些可复用的模块和优化。 这种方式不仅能推动社区发展,同时也能保证 DeepSeek 专注于改进其模型,避免承载过多开源项目的维护负担。 https://github.com/deepseek-ai/open-infra-index/blob/main/OpenSourcing_DeepSeek_Inference_Engine/README.md
FxTwitter
vLLM (@vllm_project)
🙏 @deepseek_ai's highly performant inference engine is built on top of vLLM. Now they are open-sourcing the engine the right way: instead of a separate repo, they are bringing changes to the open source community so everyone can immediately benefit!
htt…
htt…