1. 统一为使用基于pydantic的.env环境变量管理配置

2. 全项目基于loguru进行日志管理
This commit is contained in:
Doiiars
2025-11-05 14:56:49 +08:00
parent 1d2e23d8c1
commit 537d682861
50 changed files with 1404 additions and 1731 deletions
+27 -5
View File
@@ -191,7 +191,9 @@ Weibo_PublicOpinion_AnalysisSystem/
- **Database**: MySQL (optional, you can choose our cloud database service)
- **Memory**: 2GB+ recommended
### 1. Create Conda Environment
### 1. Create Environment
#### If Using Conda
```bash
# Create conda environment
@@ -199,11 +201,21 @@ conda create -n your_conda_name python=3.11
conda activate your_conda_name
```
#### If Using uv
```bash
# Create uv environment
uv venv --python 3.11 # Create Python 3.11 environment
```
### 2. Install Dependencies
```bash
# Basic dependency installation
pip install -r requirements.txt
# uv version command (faster installation)
uv pip install -r requirements.txt
# If you do not want to use the local sentiment analysis model (which has low computational requirements and defaults to the CPU version), you can comment out the 'Machine Learning' section in this file before executing the command.
```
@@ -218,9 +230,9 @@ playwright install chromium
#### 4.1 Configure API Keys
Copy the `config.py.example` file to `config.py`
Copy the `.env.example` file in the project root directory to `.env`
Edit the `config.py` file and fill in your API keys (you can also choose your own models and search proxies; see the config file for details):
Edit the `.env` file and fill in your API keys (you can also choose your own models and search proxies; see the `.env.example` file in the project root directory or the `config.py` file for details):
```python
# MySQL Database Configuration
@@ -246,7 +258,8 @@ INSIGHT_ENGINE_MODEL_NAME = "kimi-k2-0711-preview"
**Option 1: Use Local Database**
You can refer to `MindSpider\config.py.example` for the configuration template, copy this file and rename it to `config.py`.
> ~~The MindSpider crawler system and the public opinion system are independent of each other, so you need to configure `MindSpider\config.py`. Copy the `config.py.example` file in the `MindSpider` folder and rename it to `config.py`.~~
> Configuration has been changed to be based on environment variables. Please copy the `.env.example` file in the project root directory to `.env` and fill in all configurations in it.
```bash
# Local MySQL database initialization
@@ -279,6 +292,15 @@ conda activate your_conda_name
python app.py
```
uv version startup command:
```bash
# In project root directory, activate uv environment
.venv\Scripts\activate
# Start main application
python app.py
```
> Note 1: After a run is terminated, the Streamlit app might not shut down correctly and may still be occupying the port. If this occurs, find the process that is holding the port and kill it.
> Note 2: Data scraping needs to be performed as a separate operation. Please refer to the instructions in section 5.3.
@@ -327,7 +349,7 @@ python main.py --broad-topic --date 2024-01-20
python main.py --deep-sentiment --platforms xhs dy wb
```
## ⚙️ Advanced Configuration
## ⚙️ Advanced Configuration (Deprecated: Configuration has been unified to the `.env` file in the project root directory, and other sub-agents automatically inherit the root directory configuration)
### Modify Key Parameters