334 lines
8.2 KiB
Markdown
334 lines
8.2 KiB
Markdown
### 一、视频教程
|
||
[小智$ai$服务端本地部署完整教程，支持$DeepSeek$接入](https://www.bilibili.com/video/BV1GvQWYZEd2/)
|
||
|
||
|
||
|
||
https://xiaozhi.me/
|
||
|
||
登录的话，需要用到手机号，验证码找吴缤
|
||
|
||
|
||
|
||
### 二、安装$Anaconda3$
|
||
|
||
下载地址
|
||
|
||
> https://www.anaconda.com/download
|
||
|
||
安装与配置
|
||
|
||
> https://blog.csdn.net/2302_76672693/article/details/144267428
|
||
|
||
将下面的四个目录添加到环境变量中
|
||
|
||
```
|
||
D:\anaconda3\Library\mingw-w64\bin
|
||
D:\anaconda3\Library\bin
|
||
D:\anaconda3\Library\usr\bin
|
||
D:\anaconda3\Scripts
|
||
```
|
||
|
||
确认是否安装成功
|
||
|
||
```
|
||
WIN+R，输入cmd打开控制台，输入conda -V
|
||
```
|
||
|
||
|
||
|
||
使用$Anaconda$ 的黑窗口进行配置
|
||
|
||
```
|
||
C:\ProgramData\Microsoft\Windows\Start Menu\Programs\Anaconda (anaconda3)\Anaconda Prompt.lnk
|
||
```
|
||
|
||
|
||
|
||
|
||
|
||
设置$Anaconda$镜像
|
||
|
||
```cmd
|
||
conda config --remove-key channels
|
||
conda config --add channels https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/free/
|
||
conda config --add channels https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main/
|
||
conda config --add channels https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud/conda-forge/
|
||
conda config --add channels https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud/msys2/
|
||
conda config --show channels
|
||
```
|
||
|
||
**创建环境**
|
||
|
||
```
|
||
conda create --name python310 python=3.10
|
||
```
|
||
|
||
**激活环境**
|
||
|
||
```
|
||
conda activate python310
|
||
```
|
||
|
||
**查看当前环境**
|
||
|
||
```
|
||
conda env list
|
||
```
|
||
|
||
**退出虚拟环境**
|
||
|
||
```
|
||
conda deactivate
|
||
```
|
||
|
||
**查看已安装了哪些包**
|
||
|
||
```
|
||
pip list
|
||
```
|
||
|
||
### 三、部署步骤
|
||
|
||
```shell
|
||
# 如果以前配置过，那么先移除掉，如果以前没有配置过，略过本步骤
|
||
conda remove -n xiaozhi-esp32-server --all -y
|
||
|
||
# 创建虚拟环境
|
||
conda create -n xiaozhi-esp32-server python=3.10 -y
|
||
conda activate xiaozhi-esp32-server
|
||
|
||
# 音频的编码解码库
|
||
conda install libopus -y
|
||
conda install ffmpeg -y
|
||
|
||
# 安装音频处理工具，录制，转码，剪辑等
|
||
https://github.com/ShiftMediaProject/opus/releases
|
||
|
||
黄海下载的是：libopus_v1.4_msvc17.zip
|
||
|
||
然后依据下面的文档指示，对环境代码进行配置：
|
||
```
|
||
|
||
> [解决Exception: Could not find Opus library. Make sure it is installed.](https://blog.csdn.net/Rysxt_/article/details/146361114)
|
||
|
||
``` python
|
||
if lib_location is None:
|
||
lib_location = r'D:\anaconda3\envs\xiaozhi-esp32-server\Lib\site-packages\libopus_v1.4_msvc17\bin\x64\opus.dll'
|
||
```
|
||
|
||
进入到你的项目根目录，再进入main/xiaozhi-server
|
||
|
||
```powershell
|
||
d:
|
||
cd D:\dsWork\QingLong\XiaoZhi\xiaozhi-esp32-server\main\xiaozhi-server
|
||
pip config set global.index-url https://mirrors.aliyun.com/pypi/simple/
|
||
pip install -r requirements.txt
|
||
```
|
||
|
||
**下载语音识别模型文件**
|
||
|
||
> 下载地址：https://pan.baidu.com/share/init?surl=QlgM58FHhYv1tFnUT_A8Sg&pwd=qvna
|
||
|
||
将model.pt 放到
|
||
|
||
```
|
||
D:\dsWork\QingLong\XiaoZhi\xiaozhi-esp32-server\main\xiaozhi-server\models\SenseVoiceSmall
|
||
```
|
||
|
||
**配置项目**
|
||
如果你的xiaozhi-server目录没有data，你需要创建data目录。如果你的data下面没有.config.yaml文件，你可以把源码目录下的config.yaml文件复制一份，重命名为.config.yaml
|
||
|
||
**注册**
|
||
|
||
```cmd
|
||
#我的电脑：
|
||
D:\dsWork\QingLong\XiaoZhi\xiaozhi-esp32-server\main\manager-web
|
||
|
||
#在地址栏输入 cmd 回车，然后输入：
|
||
npm install
|
||
npm run serve
|
||
```
|
||
|
||
|
||
|
||
http://10.10.21.20:8001/#/home
|
||
huanghai
|
||
DsideaL@123
|
||
|
||
|
||
|
||
### 四、修改固件
|
||
|
||
[编译esp32固件](https://github.com/TOM88812/xiaozhi-esp32-server/blob/main/docs/firmware-build.md)
|
||
|
||
|
||
|
||
下载安装
|
||
|
||
esp-idf-tools-setup-offline-5.3.2.exe
|
||
|
||
|
||
|
||
安装驱动
|
||
|
||
CH343SER.EXE
|
||
|
||
|
||
|
||
**实验材料**
|
||
处理器型号 $ESP32-S3-N16R8$
|
||
|
||
|
||
|
||
屏幕 $0.91$英寸，$SSD$ $1306$，分辨率：$128*32$
|
||
|
||
|
||
|
||
**步骤1**
|
||
双击桌面上的ESP-IDF 5.3 PowerShell 快捷方式
|
||
|
||
**步骤2**
|
||
|
||
**修改配置文件**
|
||
|
||
```
|
||
D:\dsWork\QingLong\XiaoZhi\xiaozhi-esp32\main\Kconfig.projbuild
|
||
```
|
||
```yaml
|
||
# 设置OTA地址
|
||
config OTA_VERSION_URL
|
||
string "OTA Version URL"
|
||
default "http://10.10.21.20:8002/xiaozhi/ota/"
|
||
help
|
||
The application will access this URL to check for updates.
|
||
|
||
# 配置本地服务器的服务地址
|
||
config WEBSOCKET_URL
|
||
depends on CONNECTION_TYPE_WEBSOCKET
|
||
string "Websocket URL"
|
||
default "ws://192.168.1.20:8000/xiaozhi/v1/"
|
||
help
|
||
Communication with the server through websocket after wake up.
|
||
|
||
# 修改默认连接方式
|
||
choice CONNECTION_TYPE
|
||
prompt "Connection Type"
|
||
default CONNECTION_TYPE_WEBSOCKET
|
||
help
|
||
网络数据传输协议
|
||
config CONNECTION_TYPE_MQTT_UDP
|
||
bool "MQTT + UDP"
|
||
config CONNECTION_TYPE_WEBSOCKET
|
||
bool "Websocket"
|
||
endchoice
|
||
|
||
# 设置默认的开发板类型
|
||
choice BOARD_TYPE
|
||
prompt "Board Type"
|
||
default BOARD_TYPE_BREAD_COMPACT_WIFI
|
||
help
|
||
Board type. 开发板类型
|
||
config BOARD_TYPE_BREAD_COMPACT_WIFI
|
||
bool "面包板新版接线（WiFi）"
|
||
config BOARD_TYPE_BREAD_COMPACT_WIFI_LCD
|
||
bool "面包板新版接线（WiFi）+ LCD"
|
||
config BOARD_TYPE_BREAD_COMPACT_ML307
|
||
bool "面包板新版接线（ML307 AT）"
|
||
config BOARD_TYPE_BREAD_COMPACT_ESP32
|
||
bool "面包板（WiFi） ESP32 DevKit"
|
||
config BOARD_TYPE_BREAD_COMPACT_ESP32_LCD
|
||
bool "面包板（WiFi+ LCD） ESP32 DevKit"
|
||
|
||
# 设置默认屏幕
|
||
choice DISPLAY_OLED_TYPE
|
||
depends on BOARD_TYPE_BREAD_COMPACT_WIFI || BOARD_TYPE_BREAD_COMPACT_ML307 || BOARD_TYPE_BREAD_COMPACT_ESP32
|
||
prompt "OLED Type"
|
||
default OLED_SSD1306_128X32
|
||
help
|
||
OLED 屏幕类型选择
|
||
config OLED_SSD1306_128X32
|
||
bool "SSD1306, 分辨率128*32"
|
||
config OLED_SSD1306_128X64
|
||
bool "SSD1306, 分辨率128*64"
|
||
config OLED_SH1106_128X64
|
||
bool "SH1106, 分辨率128*64"
|
||
endchoice
|
||
```
|
||
|
||
**设定目标板**
|
||
```
|
||
d:
|
||
cd D:\dsWork\QingLong\XiaoZhi\xiaozhi-esp32
|
||
idf.py set-target esp32s3
|
||
```
|
||
|
||
**进入配置界面**
|
||
```
|
||
idf.py menuconfig
|
||
```
|
||
|
||
配置一下
|
||
|
||
进入$Xiaozhi$ $Assistant$选项
|
||
|
||
|
||
|
||
|
||
|
||
$Board$ $Type$:
|
||
|
||
config BOARD_TYPE_BREAD_COMPACT_WIFI
|
||
bool "面包板新版接线（WiFi）"
|
||
|
||
|
||
|
||
$DISPLAY\_OLED\_TYPE$:
|
||
|
||
$OLED\_SSD1306\_128X32$
|
||
|
||
|
||
|
||
按ESC退回主界面，再点S进行保存。
|
||
|
||
|
||
|
||
**编译固件**
|
||
|
||
```
|
||
idf.py build
|
||
```
|
||
|
||
|
||
|
||
**打包$bin$固件**
|
||
|
||
```
|
||
cd scripts
|
||
python release.py
|
||
```
|
||
|
||
|
||
|
||
**打包后的产物**
|
||
|
||
```
|
||
D:\dsWork\QingLong\XiaoZhi\xiaozhi-esp32\build\merged-binary.bin
|
||
```
|
||
|
||
|
||
|
||
### 六、相关教程
|
||
|
||
1. [固件开源地址](https://github.com/78/xiaozhi-esp32)
|
||
|
||
2. [服务端开源地址](https://github.com/xinnan-tech/xiaozhi-esp32-server)
|
||
|
||
3. [Windows搭建 ESP IDF 5.3.2开发环境以及编译小智](https://icnynnzcwou8.feishu.cn/wiki/JEYDwTTALi5s2zkGlFGcDiRknXf)
|
||
|
||
|
||
4. [小智 AI 聊天机器人百科全书](
|
||
https://ccnphfhqs21z.feishu.cn/wiki/F5krwD16viZoF0kKkvDcrZNYnhb)
|
||
|
||
5. [购买店铺链接](https://docs.qq.com/sheet/DWmRhbnVHSnRWc2xz?tab=vajqu5)
|
||
|
||
6. [开源小智Server视频教程](https://space.bilibili.com/2042143558/lists/4859662?type=season) |