134 commits

Author	SHA1	Message	Date
Nick Sweeting	89175ccb22	check SQLite3 version and enabled extensions on startup	2022-06-08 18:24:17 -07:00
Nick Sweeting	c245d36e44	add PUID and PGID as config options in archivebox	2022-06-08 17:42:52 -07:00
Nick Sweeting	5e4ddbbf25	fix mercury bin parsing back	2022-05-09 21:58:17 -07:00
Nick Sweeting	e96c1bcf13	bump mercury parser to git head version	2022-05-09 21:48:41 -07:00
Nick Sweeting	d05510f844	fix version string parsing on macOS in some cases where LANG C is not supported	2022-05-09 21:21:08 -07:00
Nick Sweeting	8ebf3e2f93	add config option PREVIEW_ORIGINALS to hide original iframes in snapshot detail pages	2022-05-09 19:31:41 -07:00
Nick Sweeting	6e66863871	add max 5s writing delay for concurrent writers and flush WAL slower	2022-05-09 18:36:40 -07:00
Nick Sweeting	57df65f28f	use yt-dlp for media archiving instead of youtube-dl	2022-04-21 07:11:35 -07:00
Nick Sweeting	eb81d41f84	bump Dockerfile base image version and install yt-dlp	2022-04-21 07:11:35 -07:00
Pellaeon Lin	5e9d05483e	Fix bin_version: set LANG=C when calling executables to avoid parsing ... localized output.	2022-02-24 17:01:00 +08:00
Nick Sweeting	666ab20df5	Update archivebox/config.py	2022-01-10 20:42:09 -05:00
hannah98	fc3d2bb4dc	rename TAG_SEPARATORS to TAG_SEPARATOR_PATTERN	2022-01-06 14:14:41 +00:00
hannah98	049f88def9	Added TAG_SEPARATORS option to supply a regex of characters to use when splitting tags	2021-12-30 20:19:48 +00:00
Mika Tuupola	f14a861605	Change logfile open to write mode only	2021-12-19 23:17:33 +02:00
Nick Sweeting	5a2c78e14b	add proper support for URL_WHITELIST instead of using negation regexes	2021-07-06 23:42:00 -04:00
Nick Sweeting	c2d1a57581	fix umask dir permissions	2021-06-01 00:50:18 -04:00
Nick Sweeting	8230f88d80	change default OUTPUT_PERMISSIONS to disallow execution except on dirs	2021-05-31 19:31:51 -04:00
Nick Sweeting	1112526543	add option ENFORCE_ATOMIC_WRITES to allow disabling forced FSYNC writes on network drives	2021-05-31 19:31:51 -04:00
Nick Sweeting	79e19ecd47	shield pwd import for windows	2021-04-24 03:51:38 -04:00
Nick Sweeting	208f866fc4	fix user detection on freebsd always returning root	2021-04-24 02:52:09 -04:00
Nick Sweeting	9563e74f7c	enforce minimum django version	2021-04-23 15:02:26 -04:00
Nick Sweeting	54cab113f3	allow static_index.json in dir root from old static exports	2021-04-12 17:06:32 -04:00
Nick Sweeting	6a6ef63775	enforce utf8 on more file reads	2021-04-10 07:22:32 -04:00
Nick Sweeting	193df5c8d3	add video subtitles and description to full-text index	2021-04-10 07:22:20 -04:00
Nick Sweeting	1e3c1e3c83	also write autogenerated subtitles	2021-04-10 06:56:19 -04:00
Nick Sweeting	c5a9b77f4f	update user agents to mimic latest chrome	2021-04-10 05:45:02 -04:00
Nick Sweeting	a9986f1f05	add timezone support, tons of CSS and layout improvements, more detailed snapshot admin form info, ability to sort by recently updated, better grid view styling, better table layouts, better dark mode support	2021-04-10 04:21:36 -04:00
Nick Sweeting	06c58ac42a	fix unreachable config backup clear	2021-04-09 12:15:47 -04:00
Nick Sweeting	32764347ce	add new SEARCH_BACKEND_TIMEOUT config option defaulted to 90sec	2021-04-09 00:27:12 -04:00
Nick Sweeting	2e57df917e	handle BaseExceptions properly	2021-04-08 06:08:17 -04:00
Nick Sweeting	2c07d8f1f3	fix lgtm alerts	2021-04-06 13:47:26 -04:00
Nick Sweeting	e92db03f5f	fallback to using bin_path to find archivebox binary if sys.argv is empty	2021-04-06 02:45:57 -04:00
Nick Sweeting	e4823cc5d7	add back CUSTOM_TEMPLATES_DIR config option	2021-04-06 00:57:20 -04:00
Nick Sweeting	5a9f27204a	dont use chrome when its not available on windows systems	2021-04-05 23:33:08 -04:00
Nick Sweeting	bbebc33b7a	better autodetection of node modules dependencies	2021-04-05 21:14:06 -04:00
Nick Sweeting	ef76f7c490	require running setup in existing data dir	2021-04-05 19:59:33 -04:00
Nick Sweeting	3449bac5bc	add new setup command to autoinstall dependencies	2021-04-05 19:51:57 -04:00
Nick Sweeting	0e39a2098d	split migrations and data dir check	2021-04-01 14:00:07 -04:00
Nick Sweeting	7e7c134ec0	use exc	2021-03-27 05:32:07 -04:00
Nick Sweeting	bd6d9c165b	enforce utf8 on literally all file operations because windows sucks	2021-03-27 01:16:29 -04:00
Nick Sweeting	185d2f9f9b	check for JSON1 extesnion in Sqlite on startup	2021-03-27 00:27:58 -04:00
Nick Sweeting	62089fdb22	close sqlite3 connections if unused	2021-02-28 22:53:34 -05:00
Nick Sweeting	e3b69c450c	move db checks under check_db if statement	2021-02-18 02:37:33 -05:00
Nick Sweeting	c877d67e0c	check if pragma is already wal before setting	2021-02-18 02:31:42 -05:00
Nick Sweeting	7b7aa239fd	autocreate db cache table when needed and reenable WAL mode	2021-02-17 18:26:04 -05:00
Nick Sweeting	6f0eec92eb	fix lint errors	2021-02-16 16:26:48 -05:00
Nick Sweeting	8cde6bc676	add gist.github.com to git domains	2021-02-16 07:36:09 -05:00
Nick Sweeting	46a7b972ee	disable WAL and cache table for now	2021-02-16 06:13:50 -05:00
Nick Sweeting	fb8e6cabcb	fix error log location	2021-02-16 04:15:09 -05:00
Nick Sweeting	19f7c907e0	exec archivebox from docker entrypoint script to avoid nesting pid under bash	2021-02-16 01:22:36 -05:00