# gnemoug/distribute\_crawler — RepoVerse

使用scrapy,redis, mongodb,graphite实现的一个分布式网络爬虫,底层存储mongodb集群,分布式使用redis实现,爬虫状态显示使用graphite实现

URL: https://repoverse.app/cards/9493725

[Repository source](https://github.com/gnemoug/distribute_crawler)

## Card snapshot

- Edition: Genesis
- Rarity: common
- Finish: Base
- Attack: 3437
- Defense: 7300
- GitHub stars: 3233
- GitHub forks: 1555
- Language: Python
- Category: Python Ecosystem
- Snapshot date: 2026-10-22

These repository statistics and game attributes belong to this dated card snapshot. They are not a current assessment of software quality.

This page describes the repository card, without a holder or individual copy record.

- [Rules](https://repoverse.app/rules.md)
- [Explore](https://repoverse.app/explore)