Files
python/requirements.txt

57 lines
3.4 KiB
Plaintext
Raw Permalink Blame History

This file contains ambiguous Unicode characters
This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.
aiofiles==24.1.0
aiohttp==3.12.15
beautifulsoup4==4.13.5
contractions==0.1.73
itemadapter==0.12.1
lxml>=5.0.0,<7.0.0
nltk==3.9.1
numpy==2.3.2
pyecharts==2.0.8
pymongo==4.14.1
pymysql==1.1.2
pyspark==4.0.0
pytest==8.4.1
redis==6.4.0
requests==2.32.5
selenium==4.35.0
setuptools==78.1.1
six==1.17.0
spacy==3.8.7
twisted==25.5.0
w3lib==2.3.1
# ─────────────────────────────────────────────────────────────────────────────
# 项目自有代码新发现但原 requirements.txt 缺失(按实际 import 补齐)
# ─────────────────────────────────────────────────────────────────────────────
scrapy>=2.11.0 # 45 处 importpython爬虫/ 下 12+ 个 Scrapy 项目
flask>=3.0.0 # 9 处:flask 框架下的多个示例
fastapi>=0.110.0 # Fastapi/fastapi_1.py
pydantic>=2.5.0 # Fastapi/fastapi_1.py
flask-sqlalchemy>=3.1.0 # flask数据库迁移.py
flask-migrate>=4.0.0 # flask数据库迁移.py
alembic>=1.13.0 # flask数据库迁移/migrations/
sqlalchemy>=2.0.0 # flask数据库迁移/migrations/versions/
flask-wtf>=1.2.0 # flask-wtf.py
wtforms>=3.1.0 # flask-wtf.py
crawl4ai>=0.3.0 # python爬虫/crawl4ai/ 下 4 个示例
# ─────────────────────────────────────────────────────────────────────────────
# vendored scrapy-redis-0.9.1 子目录
# 该目录是 2019 年的老源码(含 cPickle 等 Py2 兼容代码),建议改用 pip 装
# 如保留 vendored,下方 6 个仍是其运行/测试依赖(保持原行不动)
# ─────────────────────────────────────────────────────────────────────────────
# scrapy-redis>=0.7.0 # 替换 vendored 时安装
# ─────────────────────────────────────────────────────────────────────────────
# agent/jaspersoft 子模块需要(按需取消注释安装)
# 当前子模块 concept.py 标准库即可跑;以下为接 LLM / RAG 时才需要
# ─────────────────────────────────────────────────────────────────────────────
# python-dotenv>=1.0.1 # 推荐配合子模块 config.py 使用(也可不用,子模块内置简易 .env 解析)
# openai>=1.30.0 # Step 03+ 接 OpenAI LLM
# anthropic>=0.30.0 # Step 03+ 接 Anthropic Claude
# chromadb>=0.5.0 # Step 05 RAG 向量库
# sentence-transformers>=2.7.0 # Step 05 embedding
# tiktoken>=0.7.0 # Step 04 token 估算(exercise_answer 中用到的可选库)
# pytest>=8.0.0 # 子模块练习自测