Commit Graph

161 Commits

Author SHA1 Message Date
tritoch
10aed51df3 Merge pull request #102 from leematos/lm-remove-urllib
Remove urllib requirement and replace with requests
2017-07-06 09:37:13 -05:00
tooomm
146db4f741 Travis: run on ubuntu trusty container-based images (#101)
Use trusty (Ubuntu 14.04) for travis. Don't version lock requirements. This should not affect non-travis users because the bug in requests has been fixed to my knowledge.
2017-07-06 09:26:33 -05:00
Lee Matos
8900c1f8af Remove urllib requirement and replace with requests 2017-07-05 22:43:19 -04:00
Lee Matos
1dd538d5a1 First pass refactoring scrapers into separate modules (#98)
Splits off the respective scrapers into submodules (mtgs_scraper.py, scryfall_scraper.py, mythic_scraper.py, wizards_scraper.py)
2017-07-05 20:44:45 -05:00
tooomm
2af17727a4 enable pip cache & non-optimizing cmake for travis (#92)
pip cache & non-optimizing compiling for travis speedups
2017-07-05 00:12:24 -05:00
tritoch
fc916a58f4 Merge pull request #89 from Cockatrice/tooomm-card_fix
not only fix type, but also types
2017-07-03 06:39:27 -05:00
tritoch
d99d2f7c91 Merge pull request #84 from tritoch/post-mtgjson-wipe
After MTGJSON adds the sets, we don't want them anymore
2017-07-03 06:39:12 -05:00
tooomm
9862add338 not only fix type, but also types 2017-07-03 01:31:13 +02:00
tritoch
80c09b1e88 After MTGJSON adds the sets, we don't want them anymore. Goodbye spoiler season! 2017-07-02 11:07:16 -05:00
Lee Matos
91cc9559e5 refactor loading json (#77)
* refactor loading json
2017-07-02 10:57:23 -05:00
Cheldra
626fa6be9d Fixing a bunch of ability costs and a typeline (#79)
* Fixing a bunch of ability costs and a typeline

* Visage of Bolas and Cinder Barrens fix
2017-07-02 10:56:53 -05:00
tritoch
324fcb6bbb Merge pull request #76 from Cockatrice/tooomm-remove_split_card
remove split card definition from script start
2017-07-02 10:53:41 -05:00
tooomm
7bde6d0ea8 sifter wurm: correct rarity (#82) 2017-07-02 15:07:16 +02:00
tooomm
f320660a22 remove split card 2017-07-01 01:32:12 +02:00
tritoch
5c5699d776 Regular set masterpieces should have regular set image 2017-06-30 12:59:35 -05:00
tritoch
cebc4ffd45 Update cards_delete 2017-06-30 11:40:41 -05:00
tritoch
86bfa1f0de Crumbling Necropolis not in HOU 2017-06-30 11:25:21 -05:00
tritoch
d6853982e9 Merge pull request #73 from tritoch/scryfall-fixes-write-allsets-toggle-errorlog
Write AllSets.json

Don't scrape scryfall if we disable comparison

Toggle for Dumping Error log
2017-06-30 11:04:48 -05:00
tritoch
fe50a05225 Card corrections
Marauding Boneslasher namefix
Graven Abomination & Wall of Forgotten Pharaohs P/T fix
2017-06-30 11:00:41 -05:00
tritoch
4e43b90156 Write AllSets.json
Don't scrape scryfall if we disable comparison

Toggle for Dumping Error log
2017-06-30 09:42:36 -05:00
tritoch
d8d31f4aab Scrape mana symbols from WOTC card gallery (#68) 2017-06-30 09:05:43 -05:00
tooomm
35f5891253 remove no longer needed pic corrections (#58) 2017-06-29 07:17:02 -05:00
tritoch
07d5a8a57a Nicol Bolas, the Deceiver Loyalty
Loyalty now known http://media.wizards.com/2017/images/daily/en_iSHCrCgmya.png
2017-06-28 20:15:48 -05:00
tritoch
876d3a800f Merge pull request #71 from tritoch/split-aftermath-image-match
Better split/aftermath image matching
2017-06-28 20:04:32 -05:00
tritoch
82186fdf2e Better split/aftermath image matching 2017-06-28 19:43:59 -05:00
tritoch
9f896e1a0a Forget me not 2017-06-28 16:09:42 -05:00
tritoch
6b440d6565 Merge pull request #69 from Cockatrice/tooomm-fix_hollowone2
card fix: hollow one
2017-06-28 15:41:02 -05:00
tritoch
5b0ef041ab Merge pull request #70 from tritoch/x-manacost
X manacost, split card improvements, error for nonland with blank manacost
2017-06-28 15:40:32 -05:00
tritoch
e40a7063b8 Handle X in card costs.
Slightly improved split card handling.

Error for Blank mana cost on nonland. If a nonland card with no mana cost (`0` is a mana cost) is printed, adding it to card_corrections will prevent it from appearing in the error log.
2017-06-28 12:27:09 -05:00
tritoch
3caffc6420 Document Travis Settings [skip ci] 2017-06-28 08:19:25 -05:00
tooomm
4043729cc2 fix hollow one 2017-06-28 10:18:49 +02:00
tooomm
d14320b07d readme: add output file explanations (#62) [skip ci]
* [ci skip] add output file explanations

* [ci skip] change presentation

* Naming & Links [skip ci]
2017-06-27 23:45:27 -05:00
tritoch
88501f8ce2 Add sleep to print entire log 2017-06-27 23:32:37 -05:00
tooomm
883af49ac8 delete double card (#65)
Remove erroneous card `Endless `
2017-06-27 14:19:13 -05:00
tritoch
813ded7802 Pre flight (#64)
* Pre-flight - verify input files before running main script.

* Pre-flight - verify input files before running main script.
2017-06-27 13:03:35 -05:00
tritoch
ea7c9228be Merge pull request #63 from tritoch/full-spoil-prep
Full Spoil preparations
2017-06-27 13:03:15 -05:00
tritoch
c32b280391 Pass set name to fullspoil for automatic URL creation 2017-06-27 12:45:42 -05:00
tritoch
fe96df161d Full Spoil preparations
Handle both WOTC gallery formats
2017-06-27 12:07:02 -05:00
tritoch
869ba84a19 Remove card exemption (#57)
* Remove card exemption

Mistakenly added thinking it was not a valid card.
2017-06-26 08:44:38 -05:00
tooomm
ef744d82ed readme update (#59) [skip ci]
* [ci skip] readme update

- outdated requirements are now always linked to up-to-date file
- added spoiler files to output list
- rephrases

* small tweak
2017-06-26 08:12:30 -05:00
skwerlman
0f77039fe7 fix list markdown for requirements (#60)
* fix list markdown for requirements

also fix unmatched bracket

* List additional requirements
2017-06-26 08:09:17 -05:00
tritoch
780a7c7715 WotC Image Gallery Regex Fix (#56)
WOTC changed the format for their card gallery, this will find the images with the new format.
2017-06-23 16:14:47 -05:00
tritoch
ec7270c524 Log Cleanup
* Scryfall debug log off by default

* Scryfall logging disabled by default.

Manual corrections print on one line.
2017-06-23 09:20:40 -05:00
tooomm
ee61c68cba [ci skip] add comment, no delete from mps 2017-06-23 14:12:39 +02:00
tritoch
1ad19e2d30 Log fix (#49)
* Don't show error log if none.
2017-06-22 23:53:58 -05:00
tritoch
c5ca8dd879 Fix Uncage the Menagerie manaCost
http://mythicspoiler.com/hou/cards/uncagethemenagerie.jpg
2017-06-22 14:24:09 -05:00
tritoch
be0d113435 Ignore blank images from MTGS (#48) 2017-06-22 12:55:44 -05:00
tritoch
248e09219e More aftermath improvements. (#47)
"layout" now is "aftermath".

"colors" and "colorIdentity" will check both sides of card.
2017-06-22 12:54:59 -05:00
tritoch
3efba33849 Remove Thoughtseize from main HOU set 2017-06-22 12:54:42 -05:00
tritoch
55fe07b63b Prevent Print Error from Halt
If a unicode error happens in a debug print, program halted.
2017-06-22 12:19:20 -05:00