{"id":5584,"date":"2025-02-27T16:09:58","date_gmt":"2025-02-27T08:09:58","guid":{"rendered":"https:\/\/benson80.eu.org\/?p=5584"},"modified":"2025-02-27T16:14:49","modified_gmt":"2025-02-27T08:14:49","slug":"ollama-%e6%a8%a1%e5%9e%8b%e9%83%a8%e7%bd%b2%e6%95%99%e7%a8%8b%ef%bc%9a%e9%80%9a%e8%bf%87%e6%89%b9%e5%a4%84%e7%90%86%e8%84%9a%e6%9c%ac%e5%ae%9e%e7%8e%b0%e8%87%aa%e5%8a%a8%e5%8c%96%e6%93%8d%e4%bd%9c","status":"publish","type":"post","link":"https:\/\/benson80.eu.org\/?p=5584","title":{"rendered":"Ollama \u6a21\u578b\u90e8\u7f72\u6559\u7a0b\uff1a\u901a\u8fc7\u6279\u5904\u7406\u811a\u672c\u5b9e\u73b0\u81ea\u52a8\u5316\u64cd\u4f5c"},"content":{"rendered":"\n

\u5728\u4eba\u5de5\u667a\u80fd\u5f00\u53d1\u548c\u90e8\u7f72\u8fc7\u7a0b\u4e2d\uff0c\u9ad8\u6548\u5730\u7ba1\u7406\u548c\u8fd0\u884c\u4e0d\u540c\u6a21\u578b\u662f\u63d0\u9ad8\u5de5\u4f5c\u6548\u7387\u7684\u5173\u952e\u73af\u8282\u3002Ollama \u4f5c\u4e3a\u4e00\u4e2a\u5f3a\u5927\u7684\u6a21\u578b\u7ba1\u7406\u5de5\u5177\uff0c\u7ed3\u5408 Windows \u6279\u5904\u7406\u6587\u4ef6\uff0c\u53ef\u4ee5\u5b9e\u73b0\u5feb\u901f\u3001\u81ea\u52a8\u5316\u7684\u6a21\u578b\u90e8\u7f72\u3002\u672c\u6559\u7a0b\u5c06\u8be6\u7ec6\u6307\u5bfc\u4f60\u5982\u4f55\u901a\u8fc7\u4e00\u4e2a\u7b80\u5355\u7684\u6279\u5904\u7406\u811a\u672c\uff0c\u521b\u5efa\u548c\u8fd0\u884c\u591a\u79cd AI \u6a21\u578b\u3002\u6559\u7a0b\u5047\u8bbe\u4f60\u5df2\u7ecf\u5b89\u88c5\u4e86 Ollama\uff0c\u5e76\u4e14\u4f60\u7684\u7cfb\u7edf\u652f\u6301\u8fd0\u884c\u6279\u5904\u7406\u6587\u4ef6\uff08Windows \u73af\u5883\uff09\u3002<\/p>\n\n\n\n

\u6559\u7a0b\uff1a\u4f7f\u7528\u6279\u5904\u7406\u6587\u4ef6\u521b\u5efa\u548c\u8fd0\u884c\u6a21\u578b<\/strong><\/h3>\n\n\n\n

1. \u51c6\u5907\u5de5\u4f5c<\/strong><\/h4>\n\n\n\n
    \n
  1. \u5b89\u88c5 Ollama<\/strong>
    \u5982\u679c\u4f60\u8fd8\u6ca1\u6709\u5b89\u88c5 Ollama\uff0c\u8bf7\u8bbf\u95ee Ollama \u5b98\u65b9\u7f51\u7ad9<\/a>\uff0c\u6309\u7167\u6307\u5357\u5b89\u88c5 Ollama\u3002<\/li>\n\n\n\n
  2. \u521b\u5efa\u6587\u4ef6\u5939\u548c\u6587\u4ef6<\/strong>\n
      \n
    • \u5728\u4f60\u7684\u786c\u76d8\u4e0a\u521b\u5efa\u4e00\u4e2a\u6587\u4ef6\u5939\uff0c\u4f8b\u5982 G:\\Ollama<\/code>\u3002<\/li>\n\n\n\n
    • \u5728 G:\\Ollama<\/code> \u6587\u4ef6\u5939\u4e2d\u521b\u5efa\u4e00\u4e2a\u5b50\u6587\u4ef6\u5939 models<\/code>\uff0c\u7528\u4e8e\u5b58\u653e\u6a21\u578b\u6587\u4ef6\u3002<\/li>\n\n\n\n
    • \u5728 G:\\Ollama<\/code> \u6587\u4ef6\u5939\u4e2d\u521b\u5efa Modelfile<\/code> \u6587\u4ef6\uff0c\u7528\u4e8e\u6307\u5b9a\u6a21\u578b\u7684\u6765\u6e90\u3002\u8fd9\u4e9b\u6587\u4ef6\u7684\u540d\u79f0\u548c\u5185\u5bb9\u5982\u4e0b\uff1a<\/li>\n<\/ul>\n<\/li>\n<\/ol>\n\n\n\n

      2. \u521b\u5efa Modelfile \u6587\u4ef6<\/strong><\/h4>\n\n\n\n

      \u6839\u636e\u4f60\u7684\u9700\u6c42\uff0c\u521b\u5efa\u4ee5\u4e0b\u6587\u4ef6\uff1a<\/p>\n\n\n\n

        \n
      • \u6a21\u578b\u6587\u4ef6-7b<\/strong>
        \u5185\u5bb9\uff1aFROM models\\DeepSeek-R1-Distill-Qwen-7B-Q4_K_M.gguf<\/code><\/li>\n\n\n\n
      • \u6a21\u578b\u6587\u4ef6-14b<\/strong>
        \u5185\u5bb9\uff1aFROM models\\DeepSeek-R1-Distill-Qwen-14B-Q4_K_M.gguf<\/code><\/li>\n\n\n\n
      • \u6a21\u578b\u6587\u4ef6-qwen<\/strong>
        \u5185\u5bb9\uff1aFROM models\\qwen2.5-7b-instruct-q4_k_m.gguf<\/code><\/li>\n\n\n\n
      • \u6a21\u578b\u6587\u4ef6-phi<\/strong>
        \u5185\u5bb9\uff1aFROM models\\phi-4-Q6_K.gguf<\/code><\/li>\n\n\n\n
      • \u6a21\u578b\u6587\u4ef6-gemma<\/strong>
        \u5185\u5bb9\uff1aFROM models\\gemma-2-27b-it-Q5_K_M.gguf<\/code><\/li>\n\n\n\n
      • \u6a21\u578b\u6587\u4ef6-llama<\/strong>
        \u5185\u5bb9\uff1aFROM models\\Llama-3.3-70B-Instruct-Q4_K_M.gguf<\/code><\/li>\n<\/ul>\n\n\n\n

        \u6ce8\u610f<\/strong>\uff1a\u786e\u4fdd .gguf<\/code> \u6a21\u578b\u6587\u4ef6\u5df2\u7ecf\u4e0b\u8f7d\u5e76\u653e\u7f6e\u5728 G:\\Ollama\\models<\/code> \u6587\u4ef6\u5939\u4e2d\u3002<\/p>\n\n\n\n

        3. \u521b\u5efa\u6279\u5904\u7406\u6587\u4ef6<\/strong><\/h4>\n\n\n\n

        \u5c06\u4ee5\u4e0b\u4ee3\u7801\u4fdd\u5b58\u4e3a\u4e00\u4e2a\u6279\u5904\u7406\u6587\u4ef6\uff0c\u4f8b\u5982 run_model.bat<\/code>\uff0c\u5e76\u5c06\u5176\u653e\u7f6e\u5728 G:\\Ollama<\/code> \u6587\u4ef6\u5939\u4e2d\uff1a<\/p>\n\n\n\n

        @echo off\nREM \u8bbe\u7f6e\u8def\u5f84<\/em>\nset MODEL_PATH=G:\\Ollama\nset MODEL_FOLDER=%MODEL_PATH%\\models\n\nREM \u663e\u793a\u83dc\u5355\uff0c\u4f9b\u7528\u6237\u9009\u62e9\u6a21\u578b<\/em>\necho ============================================================\necho \u8bf7\u9009\u62e9\u8981\u521b\u5efa\u548c\u8fd0\u884c\u7684\u6a21\u578b:\necho 1. DeepSeek-R1 7B \u6a21\u578b\necho 2. DeepSeek-R1 14B \u6a21\u578b\necho 3. Qwen 2.5 7B Instruct \u6a21\u578b\necho 4. Phi 4 \u6a21\u578b\necho 5. Gemma 2 27B Instruct \u6a21\u578b\necho 6. Llama 3.3 70B Instruct \u6a21\u578b\necho 7. \u9000\u51fa\necho ============================================================\nset \/p choice=\"\u8bf7\u8f93\u5165\u9009\u62e9 [1-7]\uff1a\"\n\nREM \u6839\u636e\u7528\u6237\u9009\u62e9\u6267\u884c\u4e0d\u540c\u7684\u64cd\u4f5c<\/em>\nif \"%choice%\"==\"1\" (\n    echo \u521b\u5efa\u5e76\u8fd0\u884c DeepSeek-R1 7B \u6a21\u578b...\n    ollama create deepseek-r1:7b -f \"%MODEL_PATH%\\Modelfile-7b\"\n    ollama run deepseek-r1:7b\n)\n\nif \"%choice%\"==\"2\" (\n    echo \u521b\u5efa\u5e76\u8fd0\u884c DeepSeek-R1 14B \u6a21\u578b...\n    ollama create deepseek-r1:14b -f \"%MODEL_PATH%\\Modelfile-14b\"\n    ollama run deepseek-r1:14b\n)\n\nif \"%choice%\"==\"3\" (\n    echo \u521b\u5efa\u5e76\u8fd0\u884c Qwen 2.5 7B Instruct \u6a21\u578b...\n    ollama create qwen2.5-7b-instruct -f \"%MODEL_PATH%\\Modelfile-qwen\"\n    ollama run qwen2.5-7b-instruct\n)\n\nif \"%choice%\"==\"4\" (\n    echo \u521b\u5efa\u5e76\u8fd0\u884c Phi 4 \u6a21\u578b...\n    ollama create phi-4 -f \"%MODEL_PATH%\\Modelfile-phi\"\n    ollama run phi-4\n)\n\nif \"%choice%\"==\"5\" (\n    echo \u521b\u5efa\u5e76\u8fd0\u884c Gemma 2 27B Instruct \u6a21\u578b...\n    ollama create gemma-2-27b-it -f \"%MODEL_PATH%\\Modelfile-gemma\"\n    ollama run gemma-2-27b-it\n)\n\nif \"%choice%\"==\"6\" (\n    echo \u521b\u5efa\u5e76\u8fd0\u884c Llama 3.3 70B Instruct \u6a21\u578b...\n    ollama create llama-3.3-70b-instruct -f \"%MODEL_PATH%\\Modelfile-llama\"\n    ollama run llama-3.3-70b-instruct\n)\n\nif \"%choice%\"==\"7\" (\n    echo \u9000\u51fa\u7a0b\u5e8f...\n    exit\n)\n\nREM \u5982\u679c\u8f93\u5165\u65e0\u6548\u9009\u62e9<\/em>\necho \u65e0\u6548\u9009\u62e9\uff0c\u8bf7\u91cd\u65b0\u8fd0\u884c\u811a\u672c\u3002\npause\nexit<\/code><\/pre>\n\n\n\n
        4. \u8fd0\u884c\u6279\u5904\u7406\u6587\u4ef6<\/strong><\/h4>\n\n\n\n
          \n
        1. \u6253\u5f00\u6587\u4ef6\u8d44\u6e90\u7ba1\u7406\u5668\uff0c\u5bfc\u822a\u5230 G:\\Ollama<\/code> \u6587\u4ef6\u5939\u3002<\/li>\n\n\n\n
        2. \u53cc\u51fb run_model.bat<\/code> \u6587\u4ef6\uff0c\u8fd0\u884c\u6279\u5904\u7406\u811a\u672c\u3002<\/li>\n\n\n\n
        3. \u5728\u5f39\u51fa\u7684\u547d\u4ee4\u63d0\u793a\u7b26\u7a97\u53e3\u4e2d\uff0c\u6839\u636e\u63d0\u793a\u9009\u62e9\u8981\u8fd0\u884c\u7684\u6a21\u578b\u7f16\u53f7\uff081-6\uff09\uff0c\u6216\u8005\u8f93\u5165 7<\/code> \u9000\u51fa\u3002<\/li>\n<\/ol>\n\n\n\n
          5. \u68c0\u67e5\u6a21\u578b\u8fd0\u884c<\/strong><\/h4>\n\n\n\n
            \n
          • \u6a21\u578b\u8fd0\u884c\u540e\uff0c\u4f60\u53ef\u4ee5\u5728 Ollama \u7684 Web \u754c\u9762\uff08\u901a\u5e38\u662f http:\/\/localhost:11434<\/code>\uff09\u4e2d\u67e5\u770b\u6a21\u578b\u7684\u8fd0\u884c\u72b6\u6001\u3002<\/li>\n\n\n\n
          • \u5982\u679c\u6a21\u578b\u8fd0\u884c\u6210\u529f\uff0c\u4f60\u53ef\u4ee5\u5728 Ollama \u7684\u754c\u9762\u4e2d\u4e0e\u6a21\u578b\u8fdb\u884c\u4ea4\u4e92\u3002<\/li>\n<\/ul>\n\n\n\n
            \u5e38\u89c1\u95ee\u9898<\/strong><\/h3>\n\n\n\n
              \n
            1. \u6a21\u578b\u6587\u4ef6\u672a\u627e\u5230<\/strong>
              \u786e\u4fdd .gguf<\/code> \u6587\u4ef6\u5df2\u7ecf\u6b63\u786e\u653e\u7f6e\u5728 G:\\Ollama\\models<\/code> \u6587\u4ef6\u5939\u4e2d\uff0c\u5e76\u4e14 Modelfile<\/code> \u6587\u4ef6\u4e2d\u7684\u8def\u5f84\u6b63\u786e\u3002<\/li>\n\n\n\n
            2. \u6743\u9650\u95ee\u9898<\/strong>
              \u5982\u679c\u8fd0\u884c\u65f6\u63d0\u793a\u6743\u9650\u4e0d\u8db3\uff0c\u8bf7\u4ee5\u7ba1\u7406\u5458\u8eab\u4efd\u8fd0\u884c\u6279\u5904\u7406\u6587\u4ef6\u3002<\/li>\n\n\n\n
            3. Ollama \u672a\u5b89\u88c5<\/strong>
              \u5982\u679c\u63d0\u793a ollama<\/code> \u547d\u4ee4\u672a\u627e\u5230\uff0c\u8bf7\u786e\u4fdd Ollama \u5df2\u6b63\u786e\u5b89\u88c5\uff0c\u5e76\u4e14\u5176\u53ef\u6267\u884c\u6587\u4ef6\u8def\u5f84\u5df2\u6dfb\u52a0\u5230\u7cfb\u7edf\u7684\u73af\u5883\u53d8\u91cf\u4e2d\u3002<\/li>\n<\/ol>\n\n\n\n
              \u901a\u8fc7\u4ee5\u4e0a\u6b65\u9aa4\uff0c\u4f60\u53ef\u4ee5\u8f7b\u677e\u5730\u4f7f\u7528\u6279\u5904\u7406\u6587\u4ef6\u521b\u5efa\u548c\u8fd0\u884c\u4e0d\u540c\u7684\u6a21\u578b\u3002<\/p>\n\n\n\n
              <\/p>\n","protected":false},"excerpt":{"rendered":"
              \u5728\u4eba\u5de5\u667a\u80fd\u5f00\u53d1\u548c\u90e8\u7f72\u8fc7\u7a0b\u4e2d\uff0c\u9ad8\u6548\u5730\u7ba1\u7406\u548c\u8fd0\u884c\u4e0d\u540c\u6a21 …<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[17],"tags":[],"class_list":["post-5584","post","type-post","status-publish","format-standard","hentry","category-17"],"_links":{"self":[{"href":"https:\/\/benson80.eu.org\/index.php?rest_route=\/wp\/v2\/posts\/5584","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/benson80.eu.org\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/benson80.eu.org\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/benson80.eu.org\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/benson80.eu.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=5584"}],"version-history":[{"count":9,"href":"https:\/\/benson80.eu.org\/index.php?rest_route=\/wp\/v2\/posts\/5584\/revisions"}],"predecessor-version":[{"id":5593,"href":"https:\/\/benson80.eu.org\/index.php?rest_route=\/wp\/v2\/posts\/5584\/revisions\/5593"}],"wp:attachment":[{"href":"https:\/\/benson80.eu.org\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=5584"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/benson80.eu.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=5584"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/benson80.eu.org\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=5584"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}