Commit Graph

521 Commits

Author SHA1 Message Date
Doiiars 4ee5fa962d Merge pull request #114 from luojiyin1987/improve-dockerfile-build
Improve Dockerfile build configuration and layer caching
2025-11-05 16:58:13 +08:00
Doiiars 0334a741bb Merge pull request #137 from DoiiarX/fix-config.py
修复由于.gitignore文件导致的config.py没有更新问题
2025-11-05 16:54:17 +08:00
Doiiars aed92dff94 修复由于.gitignore文件导致的config.py没有更新问题 2025-11-05 16:53:22 +08:00
Doiiars 39c800d8e2 Merge pull request #128 from DoiiarX/github-issue-helper
添加github报错快捷按钮
2025-11-05 15:52:50 +08:00
Doiiars d0d36b1120 添加github报错快捷按钮 2025-11-05 15:51:53 +08:00
Doiiars 9b055c6b4e Merge pull request #127 from DoiiarX/fix-typo
修复文档问题
2025-11-05 15:28:14 +08:00
Doiiars efebdbd873 修复文档问题 2025-11-05 15:26:52 +08:00
Doiiars 655a8ca83a Merge pull request #125 from DoiiarX/env-file-and-loguru
统一为使用基于pydantic的.env环境变量管理配置、全项目基于loguru进行日志管理、前端添加数据库类型选项
2025-11-05 15:16:47 +08:00
Doiiars 537d682861 1. 统一为使用基于pydantic的.env环境变量管理配置
2. 全项目基于loguru进行日志管理
2025-11-05 14:56:49 +08:00
Doiiars 1d2e23d8c1 Merge pull request #123 from DoiiarX/fix-import-error-and-stop-word
修复数据库初始化问题、删除过时的数据库格式方法、修复空停用词错误。
2025-11-05 14:45:07 +08:00
Doiiars 22ed16e00e 修复数据库初始化问题、删除过时的数据库格式方法、修复空停用词错误。 2025-11-05 14:42:33 +08:00
666ghj a8249c468c Update README files to include a link to a complete system run example video for "Wuhan University Public Opinion". 2025-11-05 11:45:27 +08:00
luojiyin ae738e8acb Add --proto-redir flag to enforce HTTPS on redirects
Fix Sonar warning by adding --proto-redir '=https' to ensure all
redirects in the curl chain remain on HTTPS, not just the initial request.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-11-05 11:41:04 +08:00
Doiiars f0772bfe6e Merge pull request #116 from DoiiarX/fix-news-id
修复news-id冲突问题
2025-11-05 11:37:37 +08:00
luojiyin 5d90e7ff45 Add security flags to curl command in Dockerfile
Add --proto '=https' and --tlsv1.2 flags to prevent insecure HTTP
redirects when downloading uv installer.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-11-05 11:35:35 +08:00
Doiiars b774e5d1ed 修复news-id冲突问题 2025-11-05 11:35:18 +08:00
luojiyin 4dfb70ecfb Improve Dockerfile build configuration and layer caching
- Add SHELL pipefail to catch pipeline errors during build
   - Consolidate environment variables (PATH, PLAYWRIGHT_BROWSERS_PATH)
   - Fix DEBIAN_FRONTEND to inline usage (avoid runtime pollution)
   - Separate Playwright installation for better layer caching
   - Create dedicated /ms-playwright directory for browser binaries
   - Improve comments for better maintainability

   These changes enhance build robustness and optimize Docker layer
   caching without affecting runtime behavior.
2025-11-05 11:26:05 +08:00
ghmark675 883a405ce8 Merge pull request #73 from DoiiarX/fix-mindspider
Fix mindspider
2025-11-05 08:26:38 +08:00
666ghj 4b48156e58 Implement comprehensive front-end settings UI. 2025-11-05 00:24:35 +08:00
666ghj 96be3c1bd5 Remove the intermediary introduction. 2025-11-04 22:17:51 +08:00
666ghj d835c3a064 Merge branch 'main' of https://github.com/666ghj/Weibo_PublicOpinion_AnalysisSystem 2025-11-04 21:22:41 +08:00
666ghj 6abc798350 Update README. 2025-11-04 21:19:38 +08:00
BaiFu bcdbf6f129 Update README.md. 2025-11-04 21:12:40 +08:00
ghmark675 810f97f84f chore(git): ignore final_reports 2025-11-04 14:54:47 +08:00
ghmark675 08efc3b8d9 Merge pull request #85 from 666ghj/chore/ignore_demo_files
Chore/ignore demo files
2025-11-04 11:59:08 +08:00
ghmark675 c9dd7d5e19 chore(git): ignore logs and reports 2025-11-04 11:56:46 +08:00
ghmark675 170447a54f refactor(logs): rename log files 2025-11-04 11:55:48 +08:00
Doiiars 643300cf57 Merge remote-tracking branch 'origin/fix-mindspider' into fix-mindspider
# Conflicts:
#	MindSpider/DeepSentimentCrawling/MediaCrawler/schema/tables.sql
#	MindSpider/config.py
2025-11-04 11:03:53 +08:00
Doiiars f4fe4141d4 1. 同步MediaCrawler为最新版本
2. 修复数据库not null错误
3. 支持PG数据库
4. 规范环境变量及配置使用
5. 规范为uv安装
6. 使用loggru
2025-11-04 11:03:06 +08:00
ghmark675 a4ab8a5cea Merge pull request #80 from flash131307/fix/typo-and-duplicate-dependency
fix: correct typo and remove duplicate dependency
2025-11-04 09:44:11 +08:00
Yuhao MA 11d8bda4c8 fix: correct typo and remove duplicate dependency
- Fix typo: MindeSpider -> MindSpider in README.md
- Remove duplicate loguru entry in requirements.txt
2025-11-03 16:01:26 -05:00
lintsinghua 66af69d958 Fix agent temporal perception error by adding current real-world time to LLM prompt. 2025-11-04 01:51:24 +08:00
666ghj e1c201afc9 Increase LLM timeout for report agent to improve fault tolerance. 2025-11-04 00:08:07 +08:00
Doiiars 4104ee4e80 1. 同步MediaCrawler为最新版本
2. 修复数据库not null错误
3. 支持PG数据库
4. 规范环境变量及配置使用
5. 规范为uv安装
6. 使用loggru
2025-11-03 23:23:12 +08:00
ghmark675 62fac9ee2e hotfix(timeout): increase llm call timeout to 1800s 2025-11-03 22:39:20 +08:00
Doiiars 96c7d2d3b7 1. 同步MediaCrawler为最新版本
2. 修复数据库not null错误
3. 支持PG数据库
4. 规范环境变量及配置使用
5. 规范为uv安装
6. 使用loggru
2025-11-03 22:38:34 +08:00
BaiFu 5d8a56605b Update README.md. 2025-11-03 18:28:39 +08:00
666ghj 1adbe297b3 Clarified the instructions for copying the config template in both English and Chinese README files. 2025-11-03 16:48:55 +08:00
666ghj 4a49a97d42 Merge branch 'main' of https://github.com/666ghj/Weibo_PublicOpinion_AnalysisSystem 2025-11-03 16:36:32 +08:00
666ghj 087f32f606 Update requirements.txt to clarify optional machine learning dependencies and provide installation notes for CPU and GPU versions of torch. 2025-11-03 16:36:18 +08:00
ghmark675 5b125ea91a hotfix(database): fix source_keyword not in table bilibili_video
Fix: #51
2025-11-03 13:58:53 +08:00
ghmark675 dba7fa9902 docs(README): Update configuration instructions
Instruct users to copy config.py.example to config.py for local setup.
2025-11-03 13:48:27 +08:00
ghmark675 6fd897d82a chore(config): stop track MindSpider config.py
change it to config.py.example
2025-11-03 13:48:27 +08:00
ghmark675 46b2f00a6e docs(README-EN): Update configuration instructions
Instruct users to copy config.py.example to config.py for local setup.
2025-11-03 13:48:27 +08:00
ghmark675 bda4343c48 chore: stop track config.py 2025-11-03 13:48:27 +08:00
Doiiars 0aaf81ba06 修复fetch_news无法正常获取的问题 2025-11-03 12:29:11 +08:00
Doiiars 3ad807778c 修复fetch_news无法正常获取的问题 2025-11-03 11:26:51 +08:00
BaiFu 7726be4526 Update README with important deployment announcement.
Added important announcement about online deployment experience on Monday (11.3) to the README.
2025-11-02 00:52:08 +08:00
666ghj e109f2caae Add MindSpider running screenshot. 2025-11-01 01:13:59 +08:00
666ghj 14a164a260 Completed requirements.txt, fixed the Dockerfile, and updated the README. Significantly refactored the sentiment analyzer to be more robust against missing machine learning dependencies and controllable via a toggle. 2025-10-31 01:30:20 +08:00