在Ubuntu Linux安装brew 使用brew安装llama.cpp 运行文心Ernie大模型

经常用Mac的都知道brew，是Mac下的包管理软件。其实这个包管理软件也可以安装在Linux系统，进而可以用brew管理和安装linux软件包。

安装brew

直接安装

直接用下面命令安装即可，注意需要用管理员权限

/bin/bash -c "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/HEAD/install.sh)" 

配置环境变量

安装完成，提示配置环境变量：

 echo >> /root/.bashrc echo 'eval "$(/home/linuxbrew/.linuxbrew/bin/brew shellenv)"' >> /root/.bashrc eval "$(/home/linuxbrew/.linuxbrew/bin/brew shellenv)"

因为是直接在root账户下安装的，所以环境变量也都设置的root账户下。

同时它还提醒安装gcc，照办：

brew install gcc

配置一下清华加速镜像

export HOMEBREW_BREW_GIT_REMOTE="https://mirrors.ustc.edu.cn/brew.git" export HOMEBREW_CORE_GIT_REMOTE="https://mirrors.ustc.edu.cn/homebrew-core.git" export HOMEBREW_BOTTLE_DOMAIN="https://mirrors.ustc.edu.cn/homebrew-bottles" 

安装完成，测试一下，安装llama.cpp

安装llama.cpp

先用brew search查看一下 llama相关的软件包

brew search llama ==> Formulae gollama llama.cpp ollama lla llm

直接brew安装llama.cpp

brew install llama.cpp

配置llama.cpp加速镜像

如果速度慢，就加上Huggingface的加速镜像

export HF_ENDPOINT=https://hf-mirror.com

用llama.cpp启动文心ERNIE模型

就用这个文心ERNIE明星模型ERNIE-4.5-21B-A3B-Thinking ，当然是GGUF格式的：ERNIE-4.5-21B-A3B-Thinking-Q4_K_M-GGUF

llama-cli --hf-repo enacimie/ERNIE-4.5-21B-A3B-Thinking-Q4_K_M-GGUF --hf-file ernie-4.5-21b-a3b-thinking-q4_k_m.gguf -p "The meaning to life and the universe is" 

如果下载模型速度慢，就加上Huggingface的加速镜像

export HF_ENDPOINT=https://hf-mirror.com

启动了，但是因为只用了异构计算架构的cpu，么有用到dcu，所以速度非常慢，有多慢呢，简直比13年前的cpu慢

<|im_start|>user The meaning to life and the universe is <|im_start|>assistant We are going to explore the meaning of life and the universe in the context of human existence. The Meaning of Life: Philosophical Perspectives: - Existentialism: Emphasizes individual freedom and responsibility. The meaning of life is what each person chooses to create. - Eudaimonism: Focuses on flourishing (eudaimonia) through virtues and realizing one's potential. - Religious/Spiritual Views: Many religions propose that life's meaning comes from serving a higher power or fulfilling a divine plan. The Meaning of the Universe: Cosmological View: - The universe is vast and indifferent to human concerns. - Big Bang Theory: The universe began 13.8 billion years ago and has been expanding ever since. - Steady State Theory: The universe is eternally constant, but this has been largely discredited. - Multiverse Theory: Our universe is one of many, with each having different physical laws. Connecting Life and

总结

这次主要是实践在Linux系统安装brew，并通过brew来安装llama.cpp，进而启动文心大模型。

总体实践成功过！