base on Download all your kindle books script. # Kindle_download_helper Download all your kindle books script.  ## **2024.01 亚马逊关了中国商店首页，你可以访问这个链接下载书 https://www.amazon.cn/hz/mycd/myx#/home/content/booksAll/dateDsc/** ## 2023.06.26 如果你没有 kindle 实体设备可以用以下命令，下载后的 epub 在 EPUB 文件夹内。 遇到 `AttributeError: 'NoneType' object has no attribute 'url'` 问题可用参考这个 https://github.com/yihong0618/Kindle_download_helper/issues/155#issuecomment-1928677849 ```console pip3 install -r requirements.txt python no_kindle.py -e ${email} -p ${password} # 如果你想下载推送的书 python no_kindle.py -e ${email} -p ${password} --pdoc # !!!!!! 亚马逊下架了中国区 web 商城，这个不好用了。 # 你可以生成所有你电子书的购买记录，笔记记录来分析展示 python no_kindle.py -e ${email} -p ${password} --memory # 支持导出全部标记书签及阅读信息（Clipping 信息）#153 python no_kindle.py -e ${email} -p ${password} --bookmark ``` ## 安装 Kindle_download_helper ### GUI 程序下载 到 [Release](https://github.com/yihong0618/Kindle_download_helper/releases) 页面查看最新版本，获取对应系统的二进制文件下载解压即可。 ### Help - 若打开二进制遇到问题，请参考 [#25](https://github.com/yihong0618/Kindle_download_helper/issues/25) - kindle 无法下载问题，触发了亚马逊风控见 [#69](https://github.com/yihong0618/Kindle_download_helper/issues/69) - Mac 新手指南 by @chongiscool，见 [#76](https://github.com/yihong0618/Kindle_download_helper/issues/76) ### Cli 安装使用 1. python3 2. requirements ```python python3 --version # 查看 python 版本 ``` ```python pip3 install kindle_download # 使用 pip 安装 ``` ```bash git clone https://github.com/yihong0618/Kindle_download_helper.git && cd Kindle_download_helper ``` ```python pip3 install -r requirements.txt ``` ```python python kindle.py -h # 查看使用参数 usage: kindle.py [-h] [--cookie COOKIE | --cookie-file COOKIE_FILE] [--cn] [--jp] [--de] [--uk] [--resume-from INDEX] [--cut-length CUT_LENGTH] [-o OUTDIR] [-od OUTDEDRMDIR] [-s SESSION_FILE] [--pdoc] [--resolve_duplicate_names] [--readme] [--dedrm] [--list] [--device_sn DEVICE_SN] [--mode MODE] [csrf_token] positional arguments: csrf_token amazon or amazon cn csrf token optional arguments: -h, --help show this help message and exit --cookie COOKIE amazon or amazon cn cookie --cookie-file COOKIE_FILE load cookie local file --cn if your account is an amazon.cn account --jp if your account is an amazon.co.jp account --de if your account is an amazon.de account --uk if your account is an amazon.co.uk account --resume-from INDEX resume from the index if download failed --cut-length CUT_LENGTH truncate the file name -o OUTDIR, --outdir OUTDIR download output dir -od OUTDEDRMDIR, --outdedrmdir OUTDEDRMDIR download output dedrm dir -s SESSION_FILE, --session-file SESSION_FILE The reusable session dump file --pdoc to download personal documents or ebook --resolve_duplicate_names Resolve duplicate names files to download --readme If you want to generate kindle readme stats --dedrm If you want to `dedrm` directly --list just list books/pdoc, not to download --device_sn DEVICE_SN Download file for device with this serial number --mode MODE Mode of download, all : download all files at once, sel: download selected files ``` ### 下载 kindle 书籍 尝试[自动获取 cookie](#%E8%87%AA%E5%8A%A8%E8%8E%B7%E5%8F%96-cookie)、csrfToken 进行下载 ```python python3 kindle.py --dedrm --cn ## --dedrm 移除 DRM ``` (推荐) [手动输入 cookie](#%E8%8E%B7%E5%8F%96-cookie)、csrfToken 进行下载 ```python python3 kindle.py ${csrfToken} --cookie ${cookie} --dedrm --cn #下载国区 Kindle 书籍并移除 DRM python3 kindle.py ${csrfToken} --cookie ${cookie} --dedrm #下载美区 Kindle 书籍 ``` 默认下载所有文件，可以输入如下命令行来手动选择需要下载的书籍 ```python python3 kindle.py --mode sel # "python3 kindle.py --pdoc --mode sel" for personal document ``` 等程序获取到书籍列表后，程序会要求输入要下载的书籍序号： ``` string Input the index of books you want to download, split by space (q to quit, l to list books). ``` 此时，在命令行中输入字母"q"，然后回车则会退出下载；输入字母"l"，再回车则会重新输出所有书籍列表。 如要下载书籍，查看该书籍对应的 Index，然后在命令行输入（假设想下载第7，10，20本书）： ``` string 7 10 20 ``` 用空格隔开，最后回车即可。输入还支持range，比如输入 ``` string 4 5 10:12 15 ``` 此时程序会下载第4，5，10，11，12，15本书籍。 ### 获取 cookie 若默认情况下提示 cookie 无效，你也可以手动输入 cookie。 在上述 [全部书籍](https://www.amazon.cn/hz/mycd/myx#/home/content/booksAll/dateDsc/) 列表页面，按 `F12` 或右键点击——检查，进入网络面板 (Network)，在 Name 栏找到任意一个 `ajax` 请求，右键复制 Request Headers 里的 `Cookie` 即可。同时也能在 Payload 里找到 `csrfToken`。 然后，执行 ```python python3 kindle.py --cn --cookie ${cookie} ``` 你也可以把 cookie 保存为文本文件，执行 `python3 kindle.py --cookie-file ${cookie_file}` 下载书籍。 ### 获取 CSRF Token 若执行过程中提示获取 CSRF token 失败，你可以手动输入 CSRF Token。 `CSRF Token` 可以在页面源码中找到。在 [全部书籍](https://www.amazon.cn/hz/mycd/myx#/home/content/booksAll/dateDsc/) 列表页面右键点击，选择查看网页源码，再利用文本匹配工具 (Ctrl + F) 查找 `csrfToken`，将等号右边引号中的值复制出来，加到命令行参数中。 ```python # CSRF Token python3 kindle.py --cn ${csrfToken} # Both cookie and CSRF Token python3 kindle.py --cn --cookie ${cookie} ${csrfToken} ``` ## 自动获取 cookie 如果你的运行环境是本机，项目可以使用 [browser-cookie3](https://github.com/borisbabic/browser_cookie3) 库自动从浏览器中获取 cookie。 ### 使用 `amazon.cn` 1. 登陆 amazon.cn 2. 访问 <https://www.amazon.cn/hz/mycd/myx#/home/content/booksAll/dateDsc/> 3. 右键查看源码，搜索 `csrfToken` 复制后面的 value 4. 执行 `python3 kindle.py --cn` 5. 如果下载推送文件 `python3 kindle.py --cn --pdoc` 5. 如果想直接 dedrm 解密 (不保证好用) `python3 kindle.py --cn --pdoc --dedrm` ### how to `amazon.com` 1. login amazon.com 2. visit <https://www.amazon.com/hz/mycd/myx#/home/content/booksAll/dateDsc/> 3. right click this page source then find `csrfToken` value copy 4. run: `python3 kindle.py` 5. if is doc file `python3 kindle.py --pdoc` ### how to `amazon.de` 1. login amazon.de 2. visit <https://www.amazon.de/hz/mycd/myx#/home/content/booksAll/dateDsc/> 3. right click this page source then find `csrfToken` value copy 4. run: `python3 kindle.py --de` 5. if is doc file `python3 kindle.py --de --pdoc` ### how to `amazon.co.uk` 1. login amazon.co.uk 2. visit <https://www.amazon.co.uk/hz/mycd/myx#/home/content/booksAll/dateDsc/> 3. right click this page source then find `csrfToken` value copy 4. run: `python3 kindle.py --uk` 5. if is doc file `python3 kindle.py --uk --pdoc` ### `amazon.jp` を使用する 1. amazon.co.jp にログインする。 2. ホームページ <https://www.amazon.co.jp/hz/mycd/myx#/home/content/booksAll/dateDsc/>）にアクセスする。 3. ソースコード上で右クリックし、`csrfToken`を検索して、それ以降の値をコピーします。 4. `python3 kindle.py --jp` を実行する。 5. プッシュファイルをダウンロードする場合 `python3 kindle.py --jp --pdoc` ## 注意 - cookie 和 csrf token 会过期，重新刷新下 amazon 的页面就行 - 程序会自动在命令执行的目录下创建 `DOWNLOADS` 目录，书会下载在 `DOWNLOADS` 里 - 支持 mobi 类型的文件直接 dedrm `--dedrm` 生成的文件在 `DEDRMS` 里 - 如果你用 [DeDRM_tools](https://github.com/apprenticeharper/DeDRM_tools) 解密 key 存在 key.txt 里 - 或者直接拖进 Calibre 里 please google it. - 如果过程中失败了可以使用 e.g. `--resume-from ${num}` - 如果出现名字太长的报错可以增加：`--cut-length 70` 来截断文件名 - 支持推送文件下载 `--pdoc` - 如果有很多同名 pdoc 或 book 可以使用 `--resolve_duplicate_names` 解决同名冲突 - error log 记录在 .error_books.log 中 - 支持生成最近读完书的 README `--readme` 生成的文件在 `my_kindle_stats.md` 中 - 支持 mobi 类型的文件直接 dedrm `--dedrm` 生成的文件在 `DEDRMS` 里 - 脚本 `dedrm.py` 用于单独解密已下载的电子书文件，默认同时输出 azw 和 epub 两种格式 ``` # 其中后 3 个参数，仅在必要时指定，用法 python3 dedrm.py 1源目录 2目标目录 3密钥 4输出格式 # 例如对 ebook 中的文件解密，并只生成 epub 格式的 dedrm 文件 $ python3 dedrm.py ebook DeDRMed key.txt中的密钥串 epub ``` ## Note - The cookie and csrf token will expire, just refresh the amazon page again. - The program will automatically create `DOWNLOADS` directory under the command execution directory, the book will be downloaded in `DOWNLOADS` directory. - If you use [DeDRM_tools](https://github.com/apprenticeharper/DeDRM_tools) to decrypt the key, it will be stored in key.txt - or just drag it into Calibre. Please google it. - If the process fails you can use e.g. `--resume-from ${num}` - If the name is too long, you can add: `-cut-length 70` to truncate the file name - Support push file download `--pdoc` - If there are many pdocs or books with the same name, you can use `--resolve_duplicate_names` to resolve conflicts with the same name. - error log is logged in .error_books.log - Support for generating READMEs of recently finished books `--readme` generated files are in `my_kindle_stats.md`  ## 贡献 1. Any issues PR welcome 2. `black kindle.py kindle_gui.py` ## 感谢 - @[Kindle](https://zh.m.wikipedia.org/zh/Kindle) - @[DeDRM_tools](https://github.com/apprenticeharper/DeDRM_tools) - @[frostming](https://github.com/frostming) GUI and a lot of work - @[bladewang](https://github.com/bladewang) PDOC download - @[athrowaway2021](https://github.com/athrowaway2021/comix) No need to have a real kindle ## 赞赏 - 谢谢就够了 ## Enjoy ", Assign "at most 3 tags" to the expected json: {"id":"4859","tags":[]} "only from the tags list I provide: [{"id":77,"name":"3d"},{"id":89,"name":"agent"},{"id":17,"name":"ai"},{"id":54,"name":"algorithm"},{"id":24,"name":"api"},{"id":44,"name":"authentication"},{"id":3,"name":"aws"},{"id":27,"name":"backend"},{"id":60,"name":"benchmark"},{"id":72,"name":"best-practices"},{"id":39,"name":"bitcoin"},{"id":37,"name":"blockchain"},{"id":1,"name":"blog"},{"id":45,"name":"bundler"},{"id":58,"name":"cache"},{"id":21,"name":"chat"},{"id":49,"name":"cicd"},{"id":4,"name":"cli"},{"id":64,"name":"cloud-native"},{"id":48,"name":"cms"},{"id":61,"name":"compiler"},{"id":68,"name":"containerization"},{"id":92,"name":"crm"},{"id":34,"name":"data"},{"id":47,"name":"database"},{"id":8,"name":"declarative-gui "},{"id":9,"name":"deploy-tool"},{"id":53,"name":"desktop-app"},{"id":6,"name":"dev-exp-lib"},{"id":59,"name":"dev-tool"},{"id":13,"name":"ecommerce"},{"id":26,"name":"editor"},{"id":66,"name":"emulator"},{"id":62,"name":"filesystem"},{"id":80,"name":"finance"},{"id":15,"name":"firmware"},{"id":73,"name":"for-fun"},{"id":2,"name":"framework"},{"id":11,"name":"frontend"},{"id":22,"name":"game"},{"id":81,"name":"game-engine "},{"id":23,"name":"graphql"},{"id":84,"name":"gui"},{"id":91,"name":"http"},{"id":5,"name":"http-client"},{"id":51,"name":"iac"},{"id":30,"name":"ide"},{"id":78,"name":"iot"},{"id":40,"name":"json"},{"id":83,"name":"julian"},{"id":38,"name":"k8s"},{"id":31,"name":"language"},{"id":10,"name":"learning-resource"},{"id":33,"name":"lib"},{"id":41,"name":"linter"},{"id":28,"name":"lms"},{"id":16,"name":"logging"},{"id":76,"name":"low-code"},{"id":90,"name":"message-queue"},{"id":42,"name":"mobile-app"},{"id":18,"name":"monitoring"},{"id":36,"name":"networking"},{"id":7,"name":"node-version"},{"id":55,"name":"nosql"},{"id":57,"name":"observability"},{"id":46,"name":"orm"},{"id":52,"name":"os"},{"id":14,"name":"parser"},{"id":74,"name":"react"},{"id":82,"name":"real-time"},{"id":56,"name":"robot"},{"id":65,"name":"runtime"},{"id":32,"name":"sdk"},{"id":71,"name":"search"},{"id":63,"name":"secrets"},{"id":25,"name":"security"},{"id":85,"name":"server"},{"id":86,"name":"serverless"},{"id":70,"name":"storage"},{"id":75,"name":"system-design"},{"id":79,"name":"terminal"},{"id":29,"name":"testing"},{"id":12,"name":"ui"},{"id":50,"name":"ux"},{"id":88,"name":"video"},{"id":20,"name":"web-app"},{"id":35,"name":"web-server"},{"id":43,"name":"webassembly"},{"id":69,"name":"workflow"},{"id":87,"name":"yaml"}]" returns me the "expected json"