Commit Graph

179 Commits

Author SHA1 Message Date
Zach H
b1693f3c30 Merge pull request #119 from tritoch/exit-on-xsd-fail
Exit with failure on XSD invalid
2017-07-11 00:16:37 -04:00
tritoch
a58e8fac01 Exit with failure on XSD invalid 2017-07-10 22:59:27 -05:00
tooomm
a3a3fc74e3 update date/time format (#114)
Remove invalid and redundant datetime tags
2017-07-10 21:21:07 -05:00
tritoch
2457a5bd34 Merge pull request #115 from Cockatrice/tooomm-print_log 2017-07-10 20:46:25 -05:00
tooomm
88c93c013d adjust print in log
grammar
2017-07-10 15:09:13 +02:00
tritoch
529a4da3d9 Remove cards from MTGS RSS that aren't in gallery (#112) 2017-07-07 16:32:02 -05:00
tritoch
f74bd35c8d Eliminate 'split_cards' array. Use 'names' key to determine split cards. (#111) 2017-07-07 16:27:50 -05:00
tritoch
39f6243846 Prettify set xml files (#110) 2017-07-07 16:27:36 -05:00
tritoch
846a41d2e2 Error on type not in valid type list (#108) 2017-07-07 16:27:22 -05:00
tritoch
4d62dcf946 Fix costs in text (#107)
* Replace anything found in `{}` with uppercase, single character versions

* Remove debug print
2017-07-07 16:27:00 -05:00
tritoch
c13a719944 Remove open parenthesis deletion
Fixes #81
2017-07-06 23:18:17 -05:00
tritoch
9004f6d285 formatting 2017-07-06 22:35:53 -05:00
tritoch
04e6a1892f Verify spoiler.xml against Cockatrice's XSD file (#105)
Verifies spoiler.xml against Cockatrice's XSD file

verify_xml currently takes an xml file and XSD as a string

Prints a pass/fail above XML dump

* Re-order xml writing to pass XSD

* Improved XSD verification

Now prints error

Now handles malformed XML or XSD
2017-07-06 21:37:11 -05:00
tritoch
3ee6aa3842 Merge pull request #106 from tritoch/build-date
Build date in XML
2017-07-06 21:36:16 -05:00
tritoch
dc9b9b7a48 Refactor set_info, download_images to scraper sub
Refactor set_info to align with mtgjson keys.

Move download_images to wizards_scraper
2017-07-06 19:46:26 -05:00
tritoch
599aaee733 Less gitter notifications from Travis
Fixes #93
2017-07-06 17:56:56 -05:00
tritoch
c40355f0fb Build date in XML 2017-07-06 17:49:36 -05:00
tritoch
5b987d28cf Change input files to YAML (#99)
Input files to yaml

Deduplicate file verification, move it out to module.

Remove commentjson requirement
2017-07-06 14:25:10 -05:00
tritoch
10aed51df3 Merge pull request #102 from leematos/lm-remove-urllib
Remove urllib requirement and replace with requests
2017-07-06 09:37:13 -05:00
tooomm
146db4f741 Travis: run on ubuntu trusty container-based images (#101)
Use trusty (Ubuntu 14.04) for travis. Don't version lock requirements. This should not affect non-travis users because the bug in requests has been fixed to my knowledge.
2017-07-06 09:26:33 -05:00
Lee Matos
8900c1f8af Remove urllib requirement and replace with requests 2017-07-05 22:43:19 -04:00
Lee Matos
1dd538d5a1 First pass refactoring scrapers into separate modules (#98)
Splits off the respective scrapers into submodules (mtgs_scraper.py, scryfall_scraper.py, mythic_scraper.py, wizards_scraper.py)
2017-07-05 20:44:45 -05:00
tooomm
2af17727a4 enable pip cache & non-optimizing cmake for travis (#92)
pip cache & non-optimizing compiling for travis speedups
2017-07-05 00:12:24 -05:00
tritoch
fc916a58f4 Merge pull request #89 from Cockatrice/tooomm-card_fix
not only fix type, but also types
2017-07-03 06:39:27 -05:00
tritoch
d99d2f7c91 Merge pull request #84 from tritoch/post-mtgjson-wipe
After MTGJSON adds the sets, we don't want them anymore
2017-07-03 06:39:12 -05:00
tooomm
9862add338 not only fix type, but also types 2017-07-03 01:31:13 +02:00
tritoch
80c09b1e88 After MTGJSON adds the sets, we don't want them anymore. Goodbye spoiler season! 2017-07-02 11:07:16 -05:00
Lee Matos
91cc9559e5 refactor loading json (#77)
* refactor loading json
2017-07-02 10:57:23 -05:00
Cheldra
626fa6be9d Fixing a bunch of ability costs and a typeline (#79)
* Fixing a bunch of ability costs and a typeline

* Visage of Bolas and Cinder Barrens fix
2017-07-02 10:56:53 -05:00
tritoch
324fcb6bbb Merge pull request #76 from Cockatrice/tooomm-remove_split_card
remove split card definition from script start
2017-07-02 10:53:41 -05:00
tooomm
7bde6d0ea8 sifter wurm: correct rarity (#82) 2017-07-02 15:07:16 +02:00
tooomm
f320660a22 remove split card 2017-07-01 01:32:12 +02:00
tritoch
5c5699d776 Regular set masterpieces should have regular set image 2017-06-30 12:59:35 -05:00
tritoch
cebc4ffd45 Update cards_delete 2017-06-30 11:40:41 -05:00
tritoch
86bfa1f0de Crumbling Necropolis not in HOU 2017-06-30 11:25:21 -05:00
tritoch
d6853982e9 Merge pull request #73 from tritoch/scryfall-fixes-write-allsets-toggle-errorlog
Write AllSets.json

Don't scrape scryfall if we disable comparison

Toggle for Dumping Error log
2017-06-30 11:04:48 -05:00
tritoch
fe50a05225 Card corrections
Marauding Boneslasher namefix
Graven Abomination & Wall of Forgotten Pharaohs P/T fix
2017-06-30 11:00:41 -05:00
tritoch
4e43b90156 Write AllSets.json
Don't scrape scryfall if we disable comparison

Toggle for Dumping Error log
2017-06-30 09:42:36 -05:00
tritoch
d8d31f4aab Scrape mana symbols from WOTC card gallery (#68) 2017-06-30 09:05:43 -05:00
tooomm
35f5891253 remove no longer needed pic corrections (#58) 2017-06-29 07:17:02 -05:00
tritoch
07d5a8a57a Nicol Bolas, the Deceiver Loyalty
Loyalty now known http://media.wizards.com/2017/images/daily/en_iSHCrCgmya.png
2017-06-28 20:15:48 -05:00
tritoch
876d3a800f Merge pull request #71 from tritoch/split-aftermath-image-match
Better split/aftermath image matching
2017-06-28 20:04:32 -05:00
tritoch
82186fdf2e Better split/aftermath image matching 2017-06-28 19:43:59 -05:00
tritoch
9f896e1a0a Forget me not 2017-06-28 16:09:42 -05:00
tritoch
6b440d6565 Merge pull request #69 from Cockatrice/tooomm-fix_hollowone2
card fix: hollow one
2017-06-28 15:41:02 -05:00
tritoch
5b0ef041ab Merge pull request #70 from tritoch/x-manacost
X manacost, split card improvements, error for nonland with blank manacost
2017-06-28 15:40:32 -05:00
tritoch
e40a7063b8 Handle X in card costs.
Slightly improved split card handling.

Error for Blank mana cost on nonland. If a nonland card with no mana cost (`0` is a mana cost) is printed, adding it to card_corrections will prevent it from appearing in the error log.
2017-06-28 12:27:09 -05:00
tritoch
3caffc6420 Document Travis Settings [skip ci] 2017-06-28 08:19:25 -05:00
tooomm
4043729cc2 fix hollow one 2017-06-28 10:18:49 +02:00
tooomm
d14320b07d readme: add output file explanations (#62) [skip ci]
* [ci skip] add output file explanations

* [ci skip] change presentation

* Naming & Links [skip ci]
2017-06-27 23:45:27 -05:00