Commit Graph

15 Commits

Author SHA1 Message Date
Greg Edwards
20ca0cc3a2 Ramp up battle video retrieval for the last day. 2014-05-20 10:34:54 -04:00
Greg Edwards
d00c1a3ac2 Fixed dropped negative causing crawler to keep trying failed videos endlessly. 2014-05-19 03:21:29 -04:00
Greg Edwards
8e88e831eb Fixed Gen5 battle video crawling???? (but for how long?) 2014-05-19 00:14:07 -04:00
Greg Edwards
5ec6e92bf8 Implemented a battle video crawler for GenV. 2014-05-18 01:34:22 -04:00
Greg Edwards
c5d308ac7c Reduce crawler idle time after completing an empty search. 2014-05-17 12:47:12 -04:00
Greg Edwards
b997e6a5a1 Fix wrong search remember check 2014-05-17 02:59:20 -04:00
Greg Edwards
9cbdddf33e Adjusted idle times. 2014-05-17 02:56:15 -04:00
Greg Edwards
a7cf3e9d37 Added ability to crawl more videos through species and metagame search. 2014-05-17 02:56:04 -04:00
Greg Edwards
3bdecd2fd5 Poll the latest 30 battle videos every 30 minutes.
Increases maximum throughput to 30 videos per minute.
2014-05-16 21:57:01 -04:00
Greg Edwards
640312f762 Made video path configurable. 2014-05-16 20:23:12 -04:00
Greg Edwards
15bbba55db Store videos in the database even if present on disk. 2014-05-16 20:11:53 -04:00
Greg Edwards
bc0e14beb2 Added Decrypt method which auto calculates the pad offset. 2014-05-16 19:49:22 -04:00
Greg Edwards
7b51a4ab17 Check if a video exists on disk and skips it. 2014-05-16 19:44:45 -04:00
Greg Edwards
24111b2c05 Added support for searches other than 30 in length. 2014-05-16 19:44:44 -04:00
Greg Edwards
0bc71b53c8 Initial implementation of Battle Video crawler 2014-05-16 19:16:42 -04:00