Hacker News .hnnew | past | comments | ask | show | jobs | submit | asamil's commentslogin

This was a little project I did when Marvel's API first came out. I scraped all the data and put it in a database that allowed better searching/browsing. I probably need to periodically scrape the API again to pull in changes and additions as they add them. Hopefully Marvel will update the data and make it more complete.


How in the world is this repo compatible with their TOS - http://developer.marvel.com/terms ?


That explains it!

I really do like the presentation and the whole site. I just couldn't resist the comic book guy opportunity.


I had to pull the data out of Marvel's API which returns JSON. Then the data was stored in Orchestrate.io as the database. The JSON data is included in the repo so other people don't have to scrape Marvel's API.


Did you get special permission to do this? It is against the generic terms:

http://developer.marvel.com/terms

Use of our Content. You may not change or edit the Content (e.g., modify, augment). You agree to follow Marvel's attribution and linking rules, as set forth here: http://developer.marvel.com/documentation/attribution. You also agree to delete any Content upon Marvel's request (or if Marvel disables the Marvel API (or upon termination, see below)). You agree to configure your Apps to request only Content that is needed by such App. You may not (except with Marvel's prior written approval): (i) use any Content, or the Marvel API or Tools for any commercial purpose; or (ii) redistribute the Content or Tools except within your Apps.

Storage. You may not indefinitely cache Content and further agree to follow the content retention rules, as set forth here: http://developer.marvel.com/documentation/attribution.*


Generally, you don't "scrape" an API.. the point is that you use the API. That way the information is always up to date.

You can do all of this and still stay within the terms of service.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: