{"id":463629,"date":"2024-09-27T10:16:27","date_gmt":"2024-09-27T10:16:27","guid":{"rendered":"https:\/\/Blockchain.News\/news\/ollama-enables-local-running-of-llama-3-2-on-amd-gpus"},"modified":"2024-09-27T10:16:27","modified_gmt":"2024-09-27T10:16:27","slug":"ollama-enables-local-running-of-llama-3-2-on-amd-gpus","status":"publish","type":"post","link":"https:\/\/e-bitco.in\/index.php\/2024\/09\/27\/ollama-enables-local-running-of-llama-3-2-on-amd-gpus\/","title":{"rendered":"Ollama Enables Local Running of Llama 3.2 on AMD GPUs"},"content":{"rendered":"<figure class=\"figure mt-2\">\n<p> <a href=\"https:\/\/blockchain.news\/Profile\/Iris-Coleman\">Iris Coleman<\/a> <span class=\"publication-date ml-2\"> Sep 27, 2024 10:16<\/span> <\/p>\n<p class=\"lead\">Ollama makes it easier to run Meta&#8217;s Llama 3.2 model locally on AMD GPUs, offering support for both Linux and Windows systems.<\/p>\n<p> <a href=\"https:\/\/blockchainstock.blob.core.windows.net:443\/features\/3E8D3233CE09E673893622B02B2C2DF2DC7583C582B66CB073E37C036B12C27F.jpg\"> <img decoding=\"async\" class=\"rounded\" src=\"https:\/\/blockchainstock.blob.core.windows.net:443\/features\/3E8D3233CE09E673893622B02B2C2DF2DC7583C582B66CB073E37C036B12C27F.jpg\" alt=\"Ollama Enables Local Running of Llama 3.2 on AMD GPUs\"> <\/a> <\/figure>\n<p>Running large language models (LLMs) locally on AMD systems has become more accessible, thanks to Ollama. This guide will focus on the latest Llama 3.2 model, published by Meta on September 25, 2024. Meta&#8217;s Llama 3.2 goes small and multimodal with 1B, 3B, 11B, and 90B models. Here\u2019s how you can run these models on various AMD hardware configurations and a step-by-step installation guide for Ollama on both Linux and Windows Operating Systems on Radeon GPUs.<\/p>\n<h2>Supported AMD GPUs<\/h2>\n<p>Ollama supports a range of AMD GPUs, enabling their product on both newer and older models. The list of supported GPUs by Ollama is available <a rel=\"nofollow\" href=\"https:\/\/github.com\/ollama\/ollama\/blob\/main\/docs\/gpu.md#amd-radeon\">here<\/a>.<\/p>\n<h2>Installation and Setup Guide for Ollama<\/h2>\n<h2>Linux<\/h2>\n<ul>\n<li>System Requirements:\n<ul>\n<li>Ubuntu 22.04.4<\/li>\n<li>AMD GPUs with the latest AMD ROCm\u2122 software installed<\/li>\n<\/ul>\n<\/li>\n<li>Install ROCm 6.1.3 following the provided instructions<\/li>\n<li>Install Ollama via a single command<\/li>\n<\/ul>\n<ul>\n<li>Download and run the Llama 3.2 model:\n<ul>\n<li>ollama run llama3.2<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<h2>Windows<\/h2>\n<ul>\n<li>System Requirements:\n<ul>\n<li>Windows 10 or higher<\/li>\n<li>Supported AMD GPUs with the driver installed<\/li>\n<\/ul>\n<\/li>\n<li>For Windows installation, download and install Ollama from <a rel=\"nofollow\" href=\"https:\/\/ollama.com\/download\">here<\/a>. Once installed, open PowerShell and run:\n<ul>\n<li>ollama run llama3.2<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p>You can find the list of all available models from Ollama <a rel=\"nofollow\" href=\"https:\/\/ollama.com\/library\">here<\/a>.<\/p>\n<h2>Conclusion<\/h2>\n<p>The extensive support for AMD GPUs by Ollama demonstrates the growing accessibility of running LLMs locally. From consumer-grade AMD Radeon\u2122 RX graphics cards to high-end AMD Instinct\u2122 accelerators, users have a wide range of options to run models like Llama 3.2 on their own hardware. This flexible approach to enabling innovative LLMs across the broad AI portfolio allows for greater experimentation, privacy, and customization in AI applications across various sectors.<\/p>\n<p><span><i>Image source: Shutterstock<\/i><\/span> <!-- Divider --> <!-- Author info END --> <!-- Divider --> <a href=\"https:\/\/blockchain.news\/\">Source<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Iris Coleman Sep 27, 2024 10:16 Ollama makes it easier to run Meta&#8217;s Llama 3.2 model locally on AMD GPUs, offering support for both Linux and Windows systems. Running large language models (LLMs) locally on AMD systems has become more accessible, thanks to Ollama. This guide will focus on the latest Llama 3.2 model, published [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":463630,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[12],"tags":[13902,21638,16487,25,21637],"class_list":{"0":"post-463629","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-blockchain","8":"tag-amd","9":"tag-llama-3-2","10":"tag-llm","11":"tag-news","12":"tag-ollama"},"_links":{"self":[{"href":"https:\/\/e-bitco.in\/index.php\/wp-json\/wp\/v2\/posts\/463629","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/e-bitco.in\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/e-bitco.in\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/e-bitco.in\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/e-bitco.in\/index.php\/wp-json\/wp\/v2\/comments?post=463629"}],"version-history":[{"count":0,"href":"https:\/\/e-bitco.in\/index.php\/wp-json\/wp\/v2\/posts\/463629\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/e-bitco.in\/index.php\/wp-json\/wp\/v2\/media\/463630"}],"wp:attachment":[{"href":"https:\/\/e-bitco.in\/index.php\/wp-json\/wp\/v2\/media?parent=463629"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/e-bitco.in\/index.php\/wp-json\/wp\/v2\/categories?post=463629"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/e-bitco.in\/index.php\/wp-json\/wp\/v2\/tags?post=463629"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}