PDA

View Full Version : Grabbing a series from onemanga into the HD


Zezinho
01-08-2009, 12:55 AM
Hi there :)

Well, these holidays I came across a problem, that looked stupid, but I think some of you might also suffer from. I was going somewhere without an internet connection, and was halfway through some series.

I know that the obvious choice should have been to go on IRC and try to download the rest of the chapters, but honestly, I dislike that. So I ended up writing a simple java program (around 150 lines) that grabs the manga from OneManga into my hard drive :).

http://balance.no.sapo.pt/OneManga.rar

how to use it:

first, get java ( http://java.sun.com ).

then extract it anywhere into your HD and type:

java OneManga URL_OF_THE_START_CHAPTER

so, for example, if I wanted to get 20th century Boys from chapter 72 onwards, I'd do

java OneManga http://www.onemanga.com/20th_Century_Boys/72/01/

this will make the program download all files from this chapter and place it into a 72 folder, then chapter 73, then 74, until the end. To stop it halfway just press ctrl+c.

PS: This isn't meant as a replacement to the viewer. Actually, this isn't meant as anything else other than a bandaid :). You can simply use it if you have limited internet access and want to view manga later, or just use your favorite manga viewer.

Any questions, ask in this thread :) (even though I doubt anyone will even install it, due to lack of userfriendliness heh. Sharing it just in case someone finds it useful :) ).

EDIT 30/01/2009

ok, new version :)

new features:

-mangahut supported!
The usage is exactly the same! Point the program to the page you want to start from and let him work.
example: java OneManga http://mangahut.com/manga/Ah!%20My%20Goddess/097/pg1

this will download Ah! My Goddess from chapter 97 up.
NOTE: Notice the spaces shown as "%20" instead of " ". THIS IS IMPORTANT, DON'T TOUCH IT. Don't rename the folder it creates on your hard drive either (in this case it'll be called "Ah!%20My%20Goddess") at least until the program is 100% done with a series.
NOTE 2: Some series on MangaHut appear as "unsorted". I have no idea what series they are nor the reason why they appear like that (for example, 3x3 eyes starts to be unsorted from chapter 18 up). Theses series won't download and I can't see an easy way around it. When they appear like that the new pages lose all information about previous / following chapters and obviously the program can't guess them :).

I did the best I could to support MangaHut, and I'm sorry I can't make it work 100% of the time - but since this is a bandaid and not a full featured manga-leecher I guess it is acceptable :).

-added option to download only X number of chapters (via input argument)
for example, to download 5 chapters from H2O, you'd type:

java OneManga http://www.onemanga.com/H2O/1/00-cover/ 5

if you want it to keep going till the end of the series, just leave the space blank

PS: Since some people are using it, I guess I should give credit where credit is due. Some of the code for the file downloading (the grabbing of individual files) is based on the FileDownload class by Marco Schmidt ( http://schmidt.devlib.org/java/file-download.html ). It was modified, altered, etc, but I guess it isn't fair to say it is all mine

dyfa
01-09-2009, 12:01 AM
can you tell me where to type:
java OneManga URL_OF_THE_START_CHAPTER ?:confused:

could you explain me step-by-step?hehe..
like what kind of java,etc..
sorry,i'm a noob here..:P

kiri
01-09-2009, 12:53 AM
Wow. Nice program you did there :)

Eger-kun
01-09-2009, 01:45 AM
Say what D:

now I read faster mangas on this one when the internet is a bother :bow: thanks mate for this

Zezinho
01-09-2009, 11:00 AM
can you tell me where to type:
java OneManga URL_OF_THE_START_CHAPTER ?:confused:

could you explain me step-by-step?hehe..
like what kind of java,etc..
sorry,i'm a noob here..:P

ok, the java I'm quite sure the normal VM install will do, so, http://java.sun.com/javase/downloads/?intcmp=1281 and download the first one ( Java SE Runtime Environment )

after it installed, restart if you're asked to, and goto Start -> Run and type "cmd" (without the ""). That should open a DOS console.

navigate to the directory you extracted it to and execute as explained above. To navigate you do "cd .." to go down a directory and "cd NAME" to go into one.

maybe I could make it a bit more usefriendly, that's something to think about hehe

Honestly, if you're not into computers, maybe it's best if you steer clear of it, it kind of "requires" a bit (very little, but some) of knowhow to get to work ;).

Say what D:

now I read faster mangas on this one when the internet is a bother :bow: thanks mate for this

glad at least one person found it useful! You just made my day ;)

michaelcdf
01-10-2009, 08:45 AM
Hello,
Thank you for the software.
You have another supporter :)
One question, is it possible to save have the programm created a folder with the name of the manga before the chapter number.
So for example.
I want to download http://www.onemanga.com/Grappler_Baki/1/01/
I have created a folder called d:\manga where i launch the program.
Your program create folders named d;\manga\01 d:\manga\02
Would it be possible to have folder created like this87 d:\manga\Grappler_baki\01 and so on ?

Thanks again

Demex
01-10-2009, 10:09 PM
Works well, but you are right about it not being very user friendly. =P

And I have to agree with michaelcdf it would be nice if it put them all into a folder based on the name instead of just having a folder /322/. If your lazy like me just prompt the user for the manga name, make a folder called that, and then put the folders into that folder.

Nice program might come in handy one day. :)

Zezinho
01-11-2009, 01:30 AM
no need to ask, the name info is in the URL ;)

I'll get back at you when it's done.

glad you guys like it

Zezinho
01-11-2009, 01:58 AM
ok, v2.0, now supporting folder names!

http://balance.no.sapo.pt/OneManga.rar :)

any questions and suggestions are always accepted and appreciated! ;)

Ethriost
01-11-2009, 02:25 AM
The miracle of programming never cease to amaze me :bow:

For the next step, a user-friendly interface would be nice. Keep up the good work! :)

michaelcdf
01-11-2009, 07:12 AM
Hi Zezinho
Thanks again for your software and specialy for the fast update.
Since You are open to suggestion please let me make some.
1)

First le me tell you how i work with your software.
I have created a small batch file saying:


java OneManga http://www.onemanga.com/Zatch_Bell/1/00/

java OneManga http://www.onemanga.com/One piece1/00/

And so on.
After each update i have to change manually the batch file to go to the next update i want to have
so the batch file is becoming


java OneManga http://www.onemanga.com/Zatch_Bell/150/00/

java OneManga http://www.onemanga.com/One piece/200/00/

Would it be possible to have the program remember the last file it took or to have an text file created with the last output of your program ?

2)
Onemanga is the principale source for my online reading. but unfotunatly they don t have everything i have to go to other site as well, like www.mangahut.com, the site works the same way as onemanga (i think)
Would it be possible to have other site as well ?

3)Sometimes du to a big lag or losing the internet connection the software or hangs or output a error message.
Would it be possible to have a kind of retry after XXx seconds ?

4)Have a graphical interface (that would maybe be for version 5 :) ?

5) after the graphical interface implementation having the software download the list of manga and that you can just selrected the manga you want up to date (working with point 1 to remember what manga you last download)

6) good work, you rock
7) I already love the program like it is. I understand it is taking time to developp it, but as you suggested yourself here are a list of small and bigger suggestion.

Thanks.

Zezinho
01-11-2009, 06:30 PM
Hi Zezinho
Thanks again for your software and specialy for the fast update.
Since You are open to suggestion please let me make some.

ty :)

1)

First le me tell you how i work with your software.
I have created a small batch file saying:


java OneManga http://www.onemanga.com/Zatch_Bell/1/00/

java OneManga http://www.onemanga.com/One piece1/00/

And so on.
After each update i have to change manually the batch file to go to the next update i want to have
so the batch file is becoming


java OneManga http://www.onemanga.com/Zatch_Bell/150/00/

java OneManga http://www.onemanga.com/One piece/200/00/

Would it be possible to have the program remember the last file it took or to have an text file created with the last output of your program ?


java has a built in function for that, if you want the output saved to a .txt file, for example, java OneManga http://www.onemanga.com/Zatch_Bell/150/00/ > Zatch_Bell.txt


2)
Onemanga is the principale source for my online reading. but unfotunatly they don t have everything i have to go to other site as well, like www.mangahut.com, the site works the same way as onemanga (i think)
Would it be possible to have other site as well ?

will consider it


3)Sometimes du to a big lag or losing the internet connection the software or hangs or output a error message.
Would it be possible to have a kind of retry after XXx seconds ?

this shouldn't be hard (at least when he prints the error message). When it hangs, not so sure because I can't see where it would.


4)Have a graphical interface (that would maybe be for version 5 :) ?

5) after the graphical interface implementation having the software download the list of manga and that you can just selrected the manga you want up to date (working with point 1 to remember what manga you last download)


This isn't hard either. But since I'm leeching off OneManga's bandwidth, I kind of don't want to make it an easy-to-use-and-leech-with application. They pay for the site and to host the manga, and they need their add revenues... It's something I kind of have a conflict against, after all, this is meant as a band aid and not a full-featured program.


7) I already love the program like it is. I understand it is taking time to developp it, but as you suggested yourself here are a list of small and bigger suggestion.


Thanks for them, will try to make some of them work :).

Zezinho
01-11-2009, 06:43 PM
I actually answered this before but it didn't work, no idea why O_o

will make a short version.

1- To get the output into a txt file, for example, try running it as "java OneManga URL > output.txt" (the name of the file can be whichever you want, in this case all that the cmd window shows right now would be written into a txt file named output.txt).

2- Will consider it, won't promise anything ;)

3- When it gives you an error message, yes, it should be possible, when he hangs, not so much, sorry :\. If you come across that error message, and are using the > file.txt method, can you please post it here? I could add an exception for when that specific error happens.

4- That wouldn't be hard at all (especially in java). But I don't know if I'll do it. In the end, OneManga pays for the bandwidth, and this program leeches it (no nice way to say it). It's meant as a bandaid, as I said, not as a full-featured-leech-all-you-want client. I can make a very cool bandaid, but in the end OM relies on add revenue to pay for your manga needs, it shouldn't have a way to leech it like that ;).

7- Thanks for the time you took to get them out, I'll get back at you when I have something new.

michaelcdf
01-12-2009, 08:23 AM
Yes it worked before but apparently our message are screened first by the forum administrator.
1)Ok i will try, but I am a lazy guy is there a way to have only the lastest line in the text file instead of the all result ?

2)thanks

3)next time i will copy past the error i had

4) I didn t think about that at first. You are right I don t want that onemanga close because they loose money because of us.
But another point is but taking the manga on the harddisk we are using less bandwidth the next time i read the same manga :)
Ok maybe not a decisive point, and if it is against onemanga policy let me know.

5) that s it for today ;)
I come back to you soon :)

tagno25
01-29-2009, 06:30 AM
is it possible to have it download only one chapter and not all of them after it?

aryo
01-29-2009, 02:18 PM
Hey man, nice work.. Now I can download a couple chapters at work (since my internet is way faster there) and read it at home.

I second tagno25's suggestion, maybe add a flag (or just take the next arg) to specify how many chapters to download.

Zezinho
01-30-2009, 08:22 AM
ok, new version :)

http://balance.no.sapo.pt/OneManga.rar

new features:

-mangahut supported!
The usage is exactly the same! Point the program to the page you want to start from and let him work.
example: java OneManga http://mangahut.com/manga/Ah!%20My%20Goddess/097/pg1

this will download Ah! My Goddess from chapter 97 up.
NOTE: Notice the spaces shown as "%20" instead of " ". THIS IS IMPORTANT, DON'T TOUCH IT. Don't rename the folder it creates on your hard drive either (in this case it'll be called "Ah!%20My%20Goddess") at least until the program is 100% done with a series.
NOTE 2: Some series on MangaHut appear as "unsorted". I have no idea what series they are nor the reason why they appear like that (for example, 3x3 eyes starts to be unsorted from chapter 18 up). Theses series won't download and I can't see an easy way around it. When they appear like that the new pages lose all information about previous / following chapters and obviously the program can't guess them :).

I did the best I could to support MangaHut, and I'm sorry I can't make it work 100% of the time - but since this is a bandaid and not a full featured manga-leecher I guess it is acceptable :).

-added option to download only X number of chapters (via input argument)
for example, to download 5 chapters from H2O, you'd type:

java OneManga http://www.onemanga.com/H2O/1/00-cover/ 5

if you want it to keep going till the end of the series, just leave the space blank

tagno25
02-07-2009, 04:54 AM
-added option to download only X number of chapters (via input argument)
for example, to download 5 chapters from H2O, you'd type:

java OneManga http://www.onemanga.com/H2O/1/00-cover/ 5

if you want it to keep going till the end of the series, just leave the space blank

That downloads X number of pictures not chapters (or at least that is what it is doing for me)

This seems like just the program I was looking for. Does it work for MACs?

It works on any OS that has java.

tagno25
02-08-2009, 01:26 AM
Whenever I click on the link for the program, it opens a window with a lot of words and symbols. When I went to Java's website to download the Java Runtime Environment it didn't show an option for MACs.

http://developer.apple.com/Java/download/

the link to the downloader app is a rar file.

tagno25
02-08-2009, 01:38 AM
Thank you for helping me out with this, but I still cannot open use the application. How do I open an rar file?

you need an rar extraction program (rar files are similar to zip files)
http://www.unrarx.com/

tagno25
02-08-2009, 02:21 AM
I do not own a mac so I am not able to help you any further than I have sorry.

ShinsouX
02-08-2009, 03:11 AM
You can always use my website to view Manga (http://manga.vandeft.com/)
It might be faster and is more compliant with other browsers.

Zezinho
02-14-2009, 01:59 AM
That downloads X number of pictures not chapters (or at least that is what it is doing for me)



It works on any OS that has java.

I'm an idiot, stupid bug. I'll fix it :s

Zezinho
02-14-2009, 02:30 AM
ok, new version with corrected chapter downloading

http://balance.no.sapo.pt/OneManga.rar

only tested it once for both onemanga and mangahut, so there might be some problems... If you find it, feel free to complain here in this thread :)

next on to-do list, significant improvement on the download speed for onemanga (while clogging your internet connection doing it), based on ShinsouX's website design.

Zezinho
02-25-2009, 07:16 AM
After doing what I said I would I just decided not to release it. To put it bluntly, it was too good, as in, it became a great fast way to get a series. Quite sure that if it ever became popular enough (or if someone just designed a nice GUI and released it, java allows stuff like that), it could become a serious problem to Onemanga... And it's not my intent to cause problems ^^

I'll try to think of other ways to improve the one I have now, so that it becomes better, but not awsome.

Samael
03-01-2009, 05:41 PM
Nice! This is a great idea! Though it could cause problems for OneManga in regards to advertising and such.

Edit: It's probably a good idea not to make it too great. Because that could be terrible for our future manga reading!

kuchivaru
03-26-2009, 07:39 PM
hi,

using the onemanga.class provided by zezinho, i got an error saying "Exception in thread "main" java.lang.UnsupportedClassVersionError: Bad version number in .class file
at java.lang.ClassLoader.defineClass1<native Method>.......11 such lines"

sum1 help

thanx

kumorinohito
03-27-2009, 05:19 AM
I don't mean to hijack this thread, but I made my own batch downloader and thought I'd share. I mean, we're all in this thread to help each other out, right? Mine is also a java app (should work anywhere), but it has a (simple) graphical user interface. It allows you to use a time delay between downloading pages so that you don't hit the server too hard. You can also pause your downloads, it remembers what you're downloading when you close the program, and you can have custom download settings for series.

Check it out at http://ombd.relic19.net I've made the source available as well.

I don't think a graphical interface makes the program any more likely to hurt onemanga. If people want to support onemanga, they'll still come and click the ads like me. I bet so many people have their ad blockers on anyway. If people wanted to leech, Zezinho's program works just as well as mine. I just want to make it clear that I don't want to cause onemanga problem and that a site like onemanga needs its ad revenue, so all of us need to be helping out.

kuchivaru >

You're probably using the wrong version of Java. You probably need to download Java 6, which you can get from http://java.sun.com/javase/downloads/index.jsp

Samael
04-09-2009, 01:45 PM
kumorinohito thanks for the program! A GUI is always a nice thing to have. I usually use it to download manga that are finished (wayy too much work to download each and every time a new chap comes out).
Also it's great that it gives you the list and then you just choose, and it handles odd chapter and page names very well. (e.g 4.5 would fail on the other one)
Thanks for sharing your hard work!

(And I hope no one thinks you're trying to hijack the thread, it's all about helping each other out right? Not his vs. yours!)

kumorinohito
04-15-2009, 12:58 AM
Thanks for the compliments, they're much appreciated. I'm glad I could be helpful. I tried to make the gui pretty intuitive. Yeah, the 4.5 type chapters were unexpected, I actually had to fix that recently.

Zezinho
04-16-2009, 04:12 AM
glad to see someone picked it up, I was about to go and update it so it works with the new layout.

nice job you did there :)

SerkJeh
07-18-2009, 10:20 PM
I apologize for reviving a old thread but. Just recently I've noticed that the OneManga.class file isn't working with One Manga any more, neither is the batch file. Any help would be appreciated

kakek
08-17-2009, 10:51 AM
It's never to late to thank,so thank you both for your nice work. I have been needing this kind of tool for a long time now for 2 reasons :

1 / Catching up with a 200 chapters serie : way easier if you can download it overnight and then browse it localy (ad doesn't take more bandwith from the server after all).
2 / Reading in the train. I have long and regular travels where I cannot access the internet. It's cool to be able to download a few chapters beforehand to have something to read.

I'm curently using kumorinohito's gui, but I'll also see how Zezinho's one work, specialy for downloading from free HQ manga.

Thanks again both of you. I promise I will use your work to make my reading more confortable while being carefull not to overuse it and respect the website.

Truth101
08-18-2009, 09:54 AM
I just saw this, and would like to say I love this...

The one reason I hated downloading manga has been taken away =)

I shall forever worship you for this :bow:

strychnine
10-07-2009, 11:37 PM
God! I wish SOMEONE COULD MAKE A VIDEO FOR THIS! I WOULD REALLY APPRICIATE IT.....
I AM A TOTAL NOOB WHEN I CANT SEE THE ACTUALL THINGY. >.>
Can Someone???
Help?
If there is someone who is seraphic enough to have some mercy to the noobs...
Bless you!

inspired_work
12-11-2009, 01:01 PM
Hi,

I've written a manga reader app with a focus on usability. It doesn't support download of images but it prefetches the neighboring images (while you are reading current image) so there is no delay when you jump to next image.

You can get the app, screenshots and more info @ http://easymangareader.blogspot.com

Feel free to post a comment there if you like/hate it. Thanks.

Telotei
12-11-2009, 08:21 PM
Hi,

I've written a manga reader app with a focus on usability. It doesn't support download of images but it prefetches the neighboring images (while you are reading current image) so there is no delay when you jump to next image.

You can get the app, screenshots and more info @ http://easymangareader.blogspot.com

Feel free to post a comment there if you like/hate it. Thanks.


Hey, I was wondering if you could explain how to use the program on the first page. I've "never" done this kinda thing before and i was wondering if you could help me a little. you seem to know about this kinda thing. all i want to do is eventually get a vew "whole" manga titles "into" the memory stick in my psp.

inspired_work
12-12-2009, 12:14 PM
@Telotei: If you need to download images, check out post #28 by Kumorinohito. His program does what you want quite well.

kumorinohito
01-12-2010, 06:19 AM
@inspired_work: Nice app, it works as advertised. I still prefer my zip files and Manga Meeya though, but it is a nice small reader. .Net is pretty fun to work with too, I like doing desktop apps in C#.

@Telotei: And yeah, I wrote an app that should do what you want Telotei. I (well, mostly I) finally got around to updating it over the weekend and I've decided to keep it maintained... it's not going to not work for weeks at a time like before. Take a look at the newest version at http://onemangadownloader.relic19.net. Since it has a fair amount of new features, I might get around to reintroducing it at Otaku Chat... but I think I went on long enough about it already today.