Wuxiaworld 2 eBook program

Hello Wuxiaworld,

So recently I got an e-reader and came across the problem of getting the chapters I wanted to read onto my Kindle.
After a few months I realized that almost all eBooks available on the web are outdated.

That's why I wrote a Python script that downloads chapters from wuxiaworld.com and generates an .epub file so I could read it offline on my e-reader.

Because of a request from a friend I modified my initial script to make it more user friendly and I decited to share with the community.

You can find the Python script on my GitHub page: https://github.com/MrHaCkEr/Wuxiaworld-2-eBook
Or you can download the standalone executable: https://github.com/MrHaCkEr/Wuxiaworld-2-eBook/releases.

The script is still somewhat work in progress but it is defenitly usable. For instructions on how to use it visit the GitHub page.

The script doesn't have a GUI and feel free to leave feedback 
«1

Comments

  • I did try using this but kindle only supports .mobi and not epub? I tried converting it but don't work giving error  then tried opening it in epub reader and error as well most likely its making corrupted files
  • SooDo said:
    I did try using this but kindle only supports .mobi and not epub? I tried converting it but don't work giving error  then tried opening it in epub reader and error as well most likely its making corrupted files
    Thanks for telling me I found the issue and fixed it. It should work now if you find any issues feel free to tell me :)
  • checked it. works fine if used through CMD, executable is corrupting files it makes. would be possible to add a number of chapter currently being read near name of chapter? it gets confusing without it.
  • Hello, i have no idea why you have "DOES NOT WORK!!!!" in your last release. Even the very first version works for me. Thank you very much by the way, i used it on many novels. I hope you will continue to upgrade it with new novels, I plan to read Overgeard next.
  • I don't know exactly why I wrote this, but if I recall correctly I there was a problem with comments being added to the eBook.
    I don't recommend downloading the executables anyway, since they are not updated recently so you would miss out new features and an improved eBook layout :)
  • I made a alternate version of your script,
    you dont have to input books and chapter just use the selectors

    Features

    • Download and save you favorite Novels from wuxiaworld.com into a .epub file
    • Automatically adds some metadata like author, title and cover
    • Customizable style(ebook) by editing the default ressources/common.css(injection of others fonts not customised yet)
    • Automatic update of the novel database if database file last modification >= 12h
    https://github.com/LordKBX/wuxiaworld_export_ebook
  • edited August 2018
    not sure if it works because I have error saying that Windows cant find file Python

    ps: dont mind this... its just me who is retarded sorted it out xd
  • Script Updated with the choice a text font(with a selector in the interface)


    You can add your own Fonts in the sub-folder ressources/fonts/
    ex:

  • New version:
    New Cover generator(remove dependencies Pillow, add PyQt4) + small errors corrections
    https://github.com/LordKBX/wuxiaworld_export_ebook
  • edited August 2018
    New Update, bugs generating false informations in database where corrected
    https://github.com/LordKBX/wuxiaworld_export_ebook
  • New Update, this one would tell you if your script is up to date at initialization
  • New Update, main interface completely remade for preventing freeze
  • New Update,
    1. Include option disabling database updates et script version check(use start_without_update.bat)
    2. Cleaning, Debug and Optimization
  • New version:
    1. Added file start.sh for Linux and MacOS
    2. New readme with instructions for MacOS 
    https://github.com/LordKBX/wuxiaworld_export_ebook
  • Hey, thanks for the awesome script. 
    In the Readme file it is written that to start the script you need to use the command "python3 wuxiaworld_export_ebook.py" but it only works for me if I use "python3 wuxiaworld_export_ebook.pyw", the file is called " wuxiaworld_export_ebook.pyw" too, so maybe you could update the readme file? Or is is still up to date and I am doing something wrong?
    I am using ubuntu 18.04 if it helps.
  • edited October 2018
    I had forgotten this detail.
    Now the readme is up to date
  • New Update:
    Remove the annoying bug that load the announce section rater than the chapter content
    https://github.com/LordKBX/wuxiaworld_export_ebook
  • Hello! Thank you for the awesome script~ Appreciate your hard work!

    Just FYI though the last fix on git did not fix the issue with the announcement as there is a hidden div in the html that also does not have an ID but is a fr-view. I was able to get it to run by just hard coding the array element 2 for the third fr-view block but I think the right fix is to concat all the fr-views to prevent future breakage.

    Thanks!
  • Avast is saing that this app has a ransome virus ?
  • edited May 2019
    Ok, now everything seems fine. false positive i guess. But problem is that app doesn't work. I tried to run both - noob pack and normal . It's imposible to install pyqt4. 
    Any walkaround ?

    Edit

    Ok i found this : 
    https://sourceforge.net/projects/pyqt/files/PyQt4/PyQt-4.11.4/

    I installed that and everything is running,

    Thanks for app !
  • LordKBX said:
    Could You add option to save output file to other places ? Even output.txt in with we could change it
  • maybe in future version, i do not have a lot of time for this the 2 last months
  • LordKBX said:
    maybe in future version, i do not have a lot of time for this the 2 last months
    I'm not sure if it's possible with this code but i found 
    storage_dir = os.path.realpath(__file__)

    if os.name == 'nt':

     storage_dir = os.path.expanduser("~") + os.sep + "wuxiaworld_export_ebook"

    I tried to change it : 
            #storage_dir = os.path.realpath(__file__)
            
            storage_dir = 'D:/Downloads'
    #if os.name == 'nt':
    # storage_dir = os.path.expanduser("~") + os.sep + "wuxiaworld_export_ebook"

    But it doesn't work . I used to make programs in java and c# but with python i have no experience ;/
    Could you point what i'm doing wrong ?

    Error "  File "wuxiaworld_export_ebook.pyw", line 695
        storage_dir = 'D:/Downloads'
                                   ^
    TabError: inconsistent use of tabs and spaces in indentation"
  • I gave up, i managed to change it and get database running but it still saves files in "wrong" directory.
    App is truly great. If i could add one more thing it would be "Download ALL" :)
  • download all ? all the novels ? not impossible but a little complicated
    michael205 said:
    Error "  File "wuxiaworld_export_ebook.pyw", line 695
        storage_dir = 'D:/Downloads'
    remplace with storage_dir = 'D:' + os.sep + 'Downloads'
  • edited May 2019
    By download all i mean all books of one Sage . 
    That should be easy. One loop and done :)

    "replace with storage_dir = 'D:'   os.sep   'Downloads'"
    I tried that but it before and it didn't change anything. 
    it worked the same as D:/Downloads
    It made new folders but all generated files were in os.patch...

    But it's ok, i use Calibre that's why it's convenient to have all of downloaded books in one directory (i use auto-adding to library)
    It's adds one step for me :P
  • edited May 2019
    Hey, I just wanted to say, great program. Also, thanks a lot for continuing to improve it!

    Are there certain novels that this doesn't import? For instance, I can't seem to find "Martial World" and "Warlock of the Magnus World". I'm not sure if this is by design, or not.

    There was as comment previously where you updated the readme file from "wuxiaworld_export_ebook.py" to "wuxiaworld_export_ebook.pyw". I just wanted to let you know, that on the Github site, under "Usage", it still has the old "wuxiaworld_export_ebook.py".
  • edited June 2019
    When i try to download Martial God Asura instead of book it copies novel notifications
    "Hey guys, I come with exciting news! After a well-deserved break .... "
    https://www.wuxiaworld.com/novel/martial-god-asura/mga-chapter-3051
Sign In or Register to comment.