lp:fa-submission-scraper

Created by Mark Grandi and last modified
Get this branch:
bzr branch lp:fa-submission-scraper
Only Mark Grandi can upload to this branch. If you are Mark Grandi please log in for upload directions.

Related bugs

Related blueprints

Branch information

Owner:
Mark Grandi
Project:
FA Submission Scraper
Status:
Development

Recent revisions

27. By Mark Grandi

this is almost done! at least the non-gui part of it is. Still have to make sure it gets everything for all of the submission types, like content urls for stories and whatnot. and i need to make it so it seralizes the collection to json and then starts downloading all of the submissions after that (in case you have to stop, etc)

26. By Mark Grandi

again more testing

25. By Mark Grandi

again more testing

24. By Mark Grandi

more testing on bug

23. By Mark Grandi

minor change to see if i can fix a bug in bzr explorer

22. By Mark Grandi

added a addKeyword method to submission.py and then made it so we get the remaining variables for a submission, theme, species and keywords.

21. By Mark Grandi

Moved firefoxaddonstest.py and ubuntuforumtest.py to a seperate folder to declutter /src

20. By Mark Grandi

made it so we can get the date. gotta restart cause windows console can't fucking print unicode characters fuckkkkkkkkkk

19. By Mark Grandi

added lists and classmethods to category.py which help me decide what type a category is.

Also made fa_submission_scraper.py to use the revised category.py methods to determine what type a category is and made it so we can get visual art content urls. still need to do the others however! and the rest of the submission variables

18. By Mark Grandi

created category.py, did more work, able to get the category and the img src, if it is a image!

Branch metadata

Branch format:
Branch format 7
Repository format:
Bazaar repository format 2a (needs bzr 1.16 or later)
This branch contains Public information 
Everyone can see this information.

Subscribers