ArchiveBox/archiver
Aaron Fischer 69c007ce85 Optionally import only new links
When importing a huge list of links periodically (from a big dump of
links from a bookmark service for example) with a lot of broken links,
this links will always be rechecked. To skip this, the environment
variable ONLY_NEW can be used to only import new links and skip the rest
altogether. This partially fixes #95.
2018-10-19 21:34:57 +02:00
..
templates make ts naming consistent 2018-06-17 18:35:09 -04:00
tests move examples to tests 2018-06-10 21:50:09 -04:00
__init__.py re-arrange and cleanup directory structure 2018-06-10 20:52:15 -04:00
archive.py Optionally import only new links 2018-10-19 21:34:57 +02:00
archive_methods.py Fix archive_dot_org submit_url 2018-10-15 13:09:31 +02:00
config.py Optionally import only new links 2018-10-19 21:34:57 +02:00
index.py create robots.txt in output dir 2018-09-12 19:26:00 -04:00
links.py Optionally import only new links 2018-10-19 21:34:57 +02:00
parse.py Enable importing files from wallabag 2018-10-08 18:45:51 +02:00
peekable.py re-arrange and cleanup directory structure 2018-06-10 20:52:15 -04:00
requirements.txt move requirements down a level 2018-10-12 23:48:15 -04:00
util.py fix archive_url broken on first run 2018-06-17 18:32:52 -04:00