Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit History

Commits on Sep 22, 2021

• pipeline 支持close方法

  Boris-code

  committed
  493ff7b

  Copy full SHA for 493ff7b

Commits on Sep 14, 2021

• 修改监控统计图

  Boris-code

  committed
  4b9306c

  Copy full SHA for 4b9306c

Commits on Aug 29, 2021

• 修复 item 获取 table_name的bug, request 支持获取代理及ua

  Boris-code

  committed
  a5de93d

  Copy full SHA for a5de93d

• 去重配置暴露到setting

  Boris-code

  committed
  469c1a1

  Copy full SHA for 469c1a1

Commits on Aug 23, 2021

• 调整入库超过最大次数 报警位置

  Boris-code

  committed
  6ce2bf6

  Copy full SHA for 6ce2bf6

• air_spider 入库失败不提示重试，支持报警

  Boris-code

  committed
  09e2888

  Copy full SHA for 09e2888

Commits on Aug 18, 2021

• fix bug

  Boris-code

  committed
  ec38a3c

  Copy full SHA for ec38a3c

Commits on Aug 17, 2021

• 多批item入库时，一批入库失败不影响其他批

  Boris-code

  committed
  6e7f487

  Copy full SHA for 6e7f487

• 数据入库失败 记录到redis

  Boris-code

  committed
  0429cd5

  Copy full SHA for 0429cd5

• 数据入库失败 自动重试

  Boris-code

  committed
  1b00eb3

  Copy full SHA for 1b00eb3

Commits on Aug 4, 2021

• 解决jion报错问题

  Boris-code

  committed
  32721c6

  Copy full SHA for 32721c6

• 集成打点监控

  Boris-code

  committed
  f5f17f9

  Copy full SHA for f5f17f9

Commits on May 28, 2021

• 修改邮箱

  Boris-code

  committed
  1ef34e2

  Copy full SHA for 1ef34e2

Commits on May 23, 2021

• 爬虫支持重复启动

  Boris-code

  committed
  3108880

  Copy full SHA for 3108880

Commits on May 13, 2021

• 线程可重复启动

  Boris-code

  committed
  b423722

  Copy full SHA for b423722

Commits on Mar 30, 2021

• AirSpider 支持itemz自动入库

  

  Boris

  committed
  a410275

  Copy full SHA for a410275

Commits on Mar 23, 2021

• 修复去重问题

  

  Boris

  committed
  dbb1c63

  Copy full SHA for dbb1c63

• pre_to_db在parser线程中调用

  

  Boris

  committed
  c7efaf9

  Copy full SHA for c7efaf9

• 修正 Item 中的per_to_db函数为pre_to_db

  

  Boris

  committed
  1a9b629

  Copy full SHA for 1a9b629

Commits on Mar 18, 2021

• 完善文档, update_items改为非必须实现接口

  

  Boris

  committed
  e017bdd

  Copy full SHA for e017bdd

Commits on Mar 17, 2021

• 删除无用的配置

  

  Boris

  committed
  601f3fc

  Copy full SHA for 601f3fc

• 支持pipline

  

  Boris

  committed
  8a01432

  Copy full SHA for 8a01432

• 简化代码

  

  Boris

  committed
  52191e9

  Copy full SHA for 52191e9

Commits on Mar 10, 2021

• 修复表名提取错误的bug

  

  Boris

  committed
  89dffb7

  Copy full SHA for 89dffb7

Commits on Feb 9, 2021

• export_data 懒加载数据库

  

  Boris

  committed
  a41bb72

  Copy full SHA for a41bb72

Commits on Feb 8, 2021

• 支持AirSpider Spider BatchSpider 爬虫模板, 重命名table_folder 为 redis_key, 重命名SingleSpider为AirSpider

  

  Boris

  committed
  3519dd4

  Copy full SHA for 3519dd4

• boris-spider重命名为feapder

  

  Boris

  committed
  b65f081

  Copy full SHA for b65f081

Loading