Package: xsget
xsgetConsole tools to download online novel and convert to text file.InstallationStable version From PyPI usingpipx:pipx install xsget playwrightplaywright installStable version From PyPI usingpip:python3 -m pip install xsget playwrightplaywright installLatest development version from GitHub:python3 -m pip install -e git+https://github.com/kianmeng/xsget.gitplaywright installxsgetxsget -husage: xsget [-l CSS_PATH] [-p URL_PARAM] [-g [FILENAME] | -c [FILENAME]] [-r][-t] [-b] [-bs SESSION] [-bd DELAY] [-q] [-d] [-h] [-V]URLxsget is a console app that crawl and download online novel.website: https://github.com/kianmeng/xsgetchangelog: https://github.com/kianmeng/xsget/blob/master/CHANGELOG.md"issues: https://github.com/kianmeng/xsget/issues"positional arguments:URL   set url of the index page to crawloptional arguments:-l CSS_PATH, --link-css-path CSS_PATHset css path of the link to a chapter (default: 'a')-p URL_PARAM, -url-param-as-filename URL_PARAMuse url param key as filename (default: '')-g [FILENAME], --generate-config-file [FILENAME]generate config file from options (default: 'xsget.toml')-c [FILENAME], --config-file [FILENAME]load config from file (default: 'xsget.toml')-r, --refreshrefresh the index page-t, --testshow extracted urls without crawling-b, --browsercrawl by actual browser (default: 'False')-bs SESSION, --browser-session SESSIONset the number of browser session (default: 2)-bd DELAY, --browser-delay DELAYset the second to wait for page to load in browser (default: 0)-q, --quietsuppress all logging-d, --debugshow debugging log and stacktrace-h, --helpshow this help message and exit-V, --versionshow program's version number and exitexamples:xsget http://localhostxsget http://localhost/page[1-100].htmlxsget -g -l "a" -p "id" http://localhostxstxtxstxt -husage: xstxt [-pt CSS_PATH] [-pb CSS_PATH] [-la LANGUAGE] [-ps SEPARATOR][-rh REGEX REGEX] [-rt REGEX REGEX] [-bt TITLE] [-ba AUTHOR][-ic INDENT_CHARS] [-fw] [-oi] [-ow] [-i GLOB_PATTERN][-e GLOB_PATTERN] [-l TOTAL_FILES] [-w WIDTH] [-o FILENAME][-od OUTPUT_DIR] [-y] [-p] [-g [FILENAME] | -c [FILENAME]] [-m][-q] [-d] [-h] [-V]xstxt is a console app that extract content from HTML to text file.website: https://github.com/kianmeng/xsgetchangelog: https://github.com/kianmeng/xsget/blob/master/CHANGELOG.md"issues: https://github.com/kianmeng/xsget/issues"optional arguments:-pt CSS_PATH, --title-css-path CSS_PATHset css path of chapter title (default: 'title')-pb CSS_PATH, --body-css-path CSS_PATHset css path of chapter body (default: 'body')-la LANGUAGE, --language LANGUAGElanguage of the ebook (default: 'zh')-ps SEPARATOR, --paragraph-separator SEPARATORset paragraph separator (default: '\n\n')-rh REGEX REGEX, --html-replace REGEX REGEXset regex to replace word or pharase in html file-rt REGEX REGEX, --txt-replace REGEX REGEXset regex to replace word or pharase in txt file-bt TITLE, --book-title TITLEset title of the novel (default: '不详')-ba AUTHOR, --book-author AUTHORset author of the novel (default: '不详')-ic INDENT_CHARS, --indent-chars INDENT_CHARSset indent characters for a paragraph (default: '')-fw, --fullwidthconvert ASCII character to from halfwidth to fullwidth (default: 'False')-oi, --output-individual-fileconvert each html file into own txt file-ow, --overwriteoverwrite output file-i GLOB_PATTERN, --input GLOB_PATTERNset glob pattern of html files to process (default: '['./*.html']')-e GLOB_PATTERN, --exclude GLOB_PATTERNset glob pattern of html files to exclude (default: '[]')-l TOTAL_FILES, --limit TOTAL_FILESset number of html files to process (default: '3')-w WIDTH, --width WIDTHset the line width for wrapping (default: 0, 0 to disable)-o FILENAME, --output FILENAMEset output txt file name (default: 'book.txt')-od OUTPUT_DIR, --output-dir OUTPUT_DIRset output directory (default: 'output')-y, --yesyes to prompt-p, --purgeremove extracted files specified by --output-folder option (default: 'False')-g [FILENAME], --generate-config-file [FILENAME]generate config file from options (default: 'xstxt.toml')-c [FILENAME], --config-file [FILENAME]load config from file (default: 'xstxt.toml')-m, --monitormonitor config file changes and re-run when needed-q, --quietsuppress all logging-d, --debugshow debugging log and stacktrace-h, --helpshow this help message and exit-V, --versionshow program's version number and exitexamples:xstxt --input *.htmlxstxt --output-individual-file --input *.htmlxstxt --config --monitorCopyright and LicenseCopyright (C) 2021,2022,2023,2024 Kian-Meng AngThis program is free software: you can redistribute it and/or modify it under
the terms of the GNU Affero General Public License as published by the Free
Software Foundation, either version 3 of the License, or (at your option) any
later version.This program is distributed in the hope that it will be useful, but WITHOUT ANY
WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A
PARTICULAR PURPOSE. See the GNU Affero General Public License for more details.You should have received a copy of the GNU Affero General Public License along
with this program. If not, seehttps://www.gnu.org/licenses/.