{"id":536,"date":"2025-01-12T06:00:20","date_gmt":"2025-01-12T01:00:20","guid":{"rendered":"https:\/\/brainlessideas.com\/?p=536"},"modified":"2025-01-12T06:04:24","modified_gmt":"2025-01-12T01:04:24","slug":"how-to-run-a-local-llm-in-linux","status":"publish","type":"post","link":"https:\/\/brainlessideas.com\/index.php\/2025\/01\/12\/how-to-run-a-local-llm-in-linux\/","title":{"rendered":"How to Run a Local LLM in Linux"},"content":{"rendered":"<p>I am using LMDE6 and a Nvidia RTX 5000 16gb to run various Local LLM A.I. models.\u00a0 I have been following this guide with good success:<em><a href=\"https:\/\/www.jeremymorgan.com\/blog\/generative-ai\/local-llm-ubuntu\/\"> How to Run a Local LLM with Ubuntu\u00a0<\/a><\/em><\/p>\n<p>Other links:<\/p>\n<p><a href=\"https:\/\/ollama.com\/library\/phi4\">https:\/\/ollama.com\/library\/phi4<\/a><br \/><a href=\"https:\/\/www.baeldung.com\/linux\/genai-ollama-installation\">https:\/\/www.baeldung.com\/linux\/genai-ollama-installation<\/a><br \/><a href=\"https:\/\/community.aws\/content\/2eojjD2E7TBgPFJmB2FGAtrSSBh\/the-rise-of-the-llm-os-from-aios-to-memgpt-and-beyond?lang=en\">https:\/\/community.aws\/content\/2eojjD2E7TBgPFJmB2FGAtrSSBh\/the-rise-of-the-llm-os-from-aios-to-memgpt-and-beyond?lang=en<\/a><\/p>\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>I am using LMDE6 and a Nvidia RTX 5000 16gb to run various Local LLM A.I. models. I have been following this guide with good success: How to Run a Local LLM with Ubuntu <\/p>\n<p>Other links:<\/p>\n<p>https:\/\/ollama.com\/library\/phi4https:\/\/www.baeldung.com\/linux\/genai-ollama-installationhttps:\/\/community.aws\/content\/2eojjD2E7TBgPFJmB2FGAtrSSBh\/the-rise-of-the-llm-os-from-aios-to-memgpt-and-beyond?lang=en<\/p><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"om_disable_all_campaigns":false,"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[7,10,1],"tags":[],"class_list":["post-536","post","type-post","status-publish","format-standard","hentry","category-lab","category-linuxses","category-uncategorized","odd"],"_links":{"self":[{"href":"https:\/\/brainlessideas.com\/index.php\/wp-json\/wp\/v2\/posts\/536","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/brainlessideas.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/brainlessideas.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/brainlessideas.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/brainlessideas.com\/index.php\/wp-json\/wp\/v2\/comments?post=536"}],"version-history":[{"count":3,"href":"https:\/\/brainlessideas.com\/index.php\/wp-json\/wp\/v2\/posts\/536\/revisions"}],"predecessor-version":[{"id":540,"href":"https:\/\/brainlessideas.com\/index.php\/wp-json\/wp\/v2\/posts\/536\/revisions\/540"}],"wp:attachment":[{"href":"https:\/\/brainlessideas.com\/index.php\/wp-json\/wp\/v2\/media?parent=536"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/brainlessideas.com\/index.php\/wp-json\/wp\/v2\/categories?post=536"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/brainlessideas.com\/index.php\/wp-json\/wp\/v2\/tags?post=536"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}