Home Sign Up Sign In
yuanbopang
V2EX  ›  Local LLM

请教 PRO 6000 96G 选择什么模型部署

  •   
  •   yuanbopang · Dec 8, 2025 · 1737 views
    This topic created in 231 days ago, the information mentioned may be changed or developed.

    96G 显存下，选择哪个模型以及哪种量化效果比较好

  • PRO 6000
  • 96G显存
  • 模型部署
    2 replies  •  2025-12-08 09:15:35 +08:00
    egen
        1
    egen  
       Dec 8, 2025
    agent：gpt-oss-120B
    其他：Qwen3 Next80B A3B FP8
    565656
        2
    565656  
       Dec 8, 2025
    gpt 120 跑起来都还剩 20G
    About   ·   Help   ·   Advertise   ·   Blog   ·   API   ·   FAQ   ·   Solana   ·   953 Online   Highest 6679   ·     Select Language
    创意工作者们的社区
    World is powered by solitude
    VERSION: 3.9.8.5 · 25ms · UTC 22:51 · PVG 06:51 · LAX 15:51 · JFK 18:51
    ♥ Do have faith in what you're doing.