Welcome to Inkbunny...
Allowed ratings
To view member-only content, create an account. ( Hide )
BunnyFoxglove
BunnyFoxglove's Gallery (1)

IB Downloader 2 v1.0a

set default image size: small | medium | wide
I haven't gotten a lot of feedback for this in beta testing, but I think it works well enough to let you all have a go at it now.

Download Rar File Here!
If you are unfamiliar with rar, you can use the installer file instead.
Download Installer File Here!


Staff note: Please follow the instructions to enable TLS 1.2 for .NET 4.5 apps on the Inkbunny Wiki or IB Downloader will not work and will find no files.

The original version will no longer be supported, so I urge you to please update to the new version. Let me know any bugs you find, and I will try to sort them out.

PLEASE MAKE SURE YOU GO INTO THE SETTINGS, AND SELECT PROPER CHECKBOXES! I can't stress this enough. If you don't select the types you want to download it will not find anything. Also, it requires you to put in a default location to save to.

I hope this version is easier for people to use.

As a reminder, this application requires the use of IB's API, so make sure you have that enabled in your account settings on the website. Look for the checkbox "Enable API Access" and make sure it's checked on.

This requires at least Windows 7 with .NET 4.5 I believe. Basically if you ran the older version, this will run as well. Same requirements as before.

Details:
Downloading of multiple artists' complete libraries (including scraps).
Download entire search results
Download a specific user's gallery
Download your favorites
Download your Latest Submissions (this is the new submissions from people you watch provided you haven't cleared it yet)

Please enjoy responsibly.

Keywords
inkbunny 1,264, download 589, access 420, program 215, enable 9, api 5, downloader 1
Details
Type: Picture/Pinup
Published: 6 years, 10 months ago
Rating: General

MD5 Hash for Page 1... Show Find Identical Posts [?]
Stats
7,540 views
217 favorites
87 comments

BBCode Tags Show [?]
 
katsu
6 years, 10 months ago
Thank you very much for the new version!

But I have one problem. Download of search results does not work.
The software searching and download the list of the results, but the download of the files don't work.
BunnyFoxglove
6 years, 10 months ago
Yeah, it seems that option never got tested. I've updated download link with a fixed version. Thanks.
uzumy
6 years, 10 months ago
Thx for the continued work, the downloader is awsome and a great help!
Brexxie
6 years, 10 months ago
ohhh awesome im going to download this and try it out soon, i have thoroughly enjoyed your other versions and put them to good use
wollypegger
6 years, 8 months ago
How about being able to download a pool?
BunnyFoxglove
6 years, 8 months ago
The only way to download a pool is by using the Pool ID. For most users, that's not going be an easy process. That's why it has never been added.
wollypegger
6 years, 7 months ago
But the pool id is part of the URL to the pool, ...
BunnyFoxglove
6 years, 7 months ago
I know, it seems simple enough, but you would be surprised how many people can't figure it out. I had to write up a detailed step-by-step document to teach people how to copy/paste a list of names into a text file for a feature in the old version.

It's fine and dandy for an outsider looking in to say "It's so simple, why not just do it?" But they don't have to deal with the consequences. I'm the guy who has to deal with 20 different people individually, and try to walk them through the process. I have to weigh the cost of my sanity against the value of the feature.
wollypegger
6 years, 7 months ago
I am a programmer, if you ever want to know what of, I'll send you a PM because the programs are NOT associated with my bunny account, ...

So I understand the need to make it simple for anyone to use.
wollypegger
6 years, 6 months ago
P.S. https://pastebin.com/fHg9HXrY e621 Pool Pseudo Downloader
CompliantCoon
6 years, 6 months ago
Sorry if you have already considered/used this, but I am just discovering the tool. It seems like a good way to make the tool more flexible without over-complicating the UI would be to have the major input method be a URL and it downloads the logical thing based on the url. For instance, if given a link to a user's gallery, it downloads all submissions in the gallery, if given a link to a favorites page, it does the same, if given a link to a pool, it downloads all submissions in the pool. This seems logical. Once agian, sorry if this is either impossible/impractical to implement, or already scrapped for some reason or another, it;s just an idea.
Liquidhalo231
6 years, 7 months ago
This is great! Is it possible to get some filters for the "Search Result" function please? =3
I'd love to be able to search descriptions for a username and download all things that mention a person in their descriptions.

Like if I searched this
BunnyFoxglove
6 years, 7 months ago
We'll have to see. I'm trying not to clutter the UI this time so it doesn't confuse people.
Liquidhalo231
6 years, 7 months ago
Perhaps it could be an option when you hit "Next"?
rnixon
6 years, 7 months ago
I haven't downloaded this one to try it yet (going to grab it now!) but I wanted to say thanks for all the work you've put into the Downloader!
Polymorph
6 years, 7 months ago
Mm, thank you for doing this!  
I hate to ask for something else, but is there any chance it could save the description as well, and maybe the comments?  I know some people put a ton of time into the description.

If you'd be willing to release the source code, I could take a look at doing it too.  But in any case, thank you for doing the downloader itself to begin with!
krevth
6 years, 6 months ago
Thanks for this program; its really useful since a lot of artists i follow since 2013 keep deleting their galleries
NightmareReaper013
6 years, 6 months ago
hey it keeps saying Login Failed even though I'm putting in all the info correctly. How do I fix it
BunnyFoxglove
6 years, 6 months ago
In your IB Account Settings (on the website) look for the checkbox "Enable API Access" and make sure it's checked on.
sicklilkitten
6 years, 5 months ago
i can confirm this works out of the box with mono 5.12 on manjaro, cant be sure for other distros/versions though
Blueandgrey
6 years, 2 months ago
it won't accept my log in for some reason :[
BunnyFoxglove
6 years, 2 months ago
In your IB Account Settings (on the website) look for the checkbox "Enable API Access" and make sure it's checked on.

If that doesn't work, make sure you're entering the right password. Try entering it to login manually to the site.
Blueandgrey
6 years, 2 months ago
that worked, thanks!
FoxyIbLover
6 years ago
Hmmm, the idea is nice, but the order in which things happen is a bit weird. Shouldn't the program ask you where to save files and what to save before you can tell it to download stuff? The first time it told me it couldn't find anything and that a folder had to be specified. Had to look for a separate options window. Having written software myself I know how much work it is to write and design a proper program. I've learned there is an enormous difference between a program that works and a program that not only works but doesn't cause a lot of people to complain or ask questions all the time. I believe that this is why in software testing they talk about "user requirements" and "acceptance tests". But hey, for something you wrote in your spare time (I assume) for free, this is pretty good. After writing code in my spare time and sharing it myself I got fed up with what little feedback I got. The whiny ungrateful feedback was the worst - even if they did have a point in their criticism. Thanks for uploading!
BunnyFoxglove
6 years ago
If you look at the posting, there's a note in all caps telling you that you have to go into the settings. If this was a piece of professional software, I might have added something to open the options on first load.
FoxyIbLover
6 years ago
Aha. Duh. Thanks.
KuniMiller
6 years ago
really happy to see this is still being worked on, this new version is so much faster
I do have a request, it easily downloads submissions that were uploaded as a written document, but it doesn't download the other text based submissions where there is a pic with text
examples of what I mean below(both NSFW)
does download this story - https://inkbunny.net/s/1376809
doesn't download this story - https://inkbunny.net/s/964975
is this something that can be fixed?
Ainoko
6 years ago
I gotta say the Ui for the new uploader is both easy and complicated. If there is a way to combine some of the features and aspects of the older version of the downloader, that would be perfect.
Ainoko
6 years ago
Welp, I found a problem, the downloader is stuck on one artist, and I can't figure out how to pull up the complete list of artists I am watching in order to remove the problem artist (right now it is stuck on page 4 of 5, and has been that way for at least 8 hours)
FurFoxy
5 years, 8 months ago
Same. For me it got stuck on "Page 4/5 for Sonsasu" Will have to try running it again with them unfollowed or something I guess.
ZashFerret
5 years, 9 months ago
For "Users Gallery" do I put in the URL for thei page or just their name?
BunnyFoxglove
5 years, 9 months ago
Just their name
ZashFerret
5 years, 9 months ago
Okay. And what if the login fails?
BunnyFoxglove
5 years, 9 months ago
Either you've typed something wrong, or you haven't enabled the API in your IB Settings.
ZashFerret
5 years, 9 months ago
Ah, that was it. Thank you!
ZashFerret
5 years, 9 months ago
:x
Meiji
5 years, 8 months ago
Thanks <3 too many emo artists on this site
digidude
5 years, 6 months ago
suggestion list of users galleries from text doc file
BunnyFoxglove
5 years, 6 months ago
The old version used to have this, but I didn't carry it over because it wasn't user friendly. We'll see in the future.
skyboxmonster
5 years, 5 months ago
PERFECT!
Johnhopps86
5 years, 4 months ago
Good day, I am trying to use this program so I can have an update backup on my follow list. The problem is, it runs for a little over two hours and two days in a row it keeps freezing on "IB Downloader - Searching Page 4/6 for Sonsasu". When I selected only certain user names in the list it displayed I thought it would only do for those, but it is searching everything. I follow over 1000 artists and would really like this to work. Would you be able to help me at all please. Thank you
BunnyFoxglove
5 years, 4 months ago
Any name in the list will get downloaded, however it will skip files you already have. That's why it seems like it's not doing anything for most of them. You can't just select names to do.

What you can do is try removing Sonsasu from the list, and run it. I'll have a look and see what the problem is, but most likely it's a filename issue. I've tried fix the problem several times, but there always seems to be a new edge case pops up.

You can also try just doing Sonsasu by itself and see if that has the same issue. Any time you have this issue, just remove that user it gets stuck on, and run it again. Then tell me the name here, and I'll have a look into it when I have time.

Also, if you look above, several others have had the same issue with that artist's gallery. I just haven't had time to fix it.
GreenReaper
5 years, 4 months ago
One thing that strikes me is that all their work has a # in the submission title. # has special meaning in URLs and is not a valid character in an XML element name (although there should be no problem in a CDATA section, and a sample from their gallery seems to be represented correctly both in XML and JSON format).

Of course, their gallery is also ten pages - plenty of room for other things, like a filename. Or perhaps it is just the sheer length of the number of submissions to deal with that is an issue?
GreenReaper
5 years, 4 months ago
Ooooh. Or it could be this submission which has embedded symbol 0x10's in the title. This appears to be valid (or at least readable) in JSON but not well-formed in XML:
https://inkbunny.net/api_submissions.php?sid=YOURSIDHER...

This shows up something we should probably fix, either on the XML output side or forbidding it as input. But it'd probably be a good idea for IBDownloader to be able to deal with such situations where the XML cannot be parsed, too, even if just by skipping the file.
BunnyFoxglove
5 years, 4 months ago
Until I have time to look at the code, I won't know for sure what's causing it. Once I run it through in debug mode I should be able to find out. I have a long weekend coming up, and a week off. Hopefully I can find time to fix it.

On a side note... I hate when people drop special characters in for no reason. All I see are little box symbols for most of the silly font things people use. I wish they'd stop adding all these texting icons into fonts.
GreenReaper
5 years, 4 months ago
The above API result broke Firefox's XML parser and there are few examples of it on IB, so I'm 99% sure it's the problem; albeit that I don't know the result on your end.

I think emoji have value, but obviously that value only exists if they can be displayed to the people you are trying to contact! 🦝🦨🐇
BunnyFoxglove
5 years, 4 months ago
GreenReaper
5 years, 4 months ago
In fairness, Skunk is very new.
You have Raccoon from 2018, so not far behind.
BunnyFoxglove
5 years, 4 months ago
"Main Exception: '', hexadecimal value 0x10, is an invalid character. Line 1842, position 20."

So there's the answer XD
GreenReaper
5 years, 4 months ago
Cool. Do you have a handler devised for that now? If so I can remove that character from this submission so it won't break existing versions and people can complete their downloads.

Actually, I'll just go ahead and remove it; for now you can just test by putting that character into a hidden submission title (or description...or tags!) and trying to access it via API.
BunnyFoxglove
5 years, 4 months ago
I'll see what I can do about it later. It's actually breaking the XML parser, which is not something I wrote. So I will need to set aside some time to actually figure out how to handle it.
zox
zox
5 years, 3 months ago
I guess simplest solution is xml sanitization before parsing as removal of these characters should not have any negative impact on the downloader itself.
Also think about adding delay between downloads as an option, I'm sure IB admins will appreciate not hammering the servers :-)
GreenReaper
5 years, 4 months ago
The issue above probably caused the download to break on Sonsasu, but it should work if you retry it now because I've removed the control characters in question.
AsterLung101
5 years, 1 month ago
Good to see the program being updated, just two things to add:
1. I also noticed Sonsasu would cause issues if you tried download their gallery (both in old version and this) so something on his particular page is causing a problem rather than the software.
2. Not sure if it is just me but the downloader seem very slow, everything takes 10x or more time than the previous one.

Otherwise it remains an immensely good piece of software
BunnyFoxglove
5 years, 1 month ago
If you read just above you'll see what the problem was with Sonsasu, the admins have removed the control character so it doesn't break the xml and it should work now. If it's not, then I dunno, it's not an easy fix in the code.

As for the speed, nothing has really changed in the speed it takes to download. It might take slightly longer to create the file list, but the actual downloading is exactly the same.
Sonamyfan04
5 years, 1 month ago
Have you considered making something like this for furaffinity?
BunnyFoxglove
5 years, 1 month ago
FA doesn't want applications such as this, and has in the past order a cease and desist against several apps that tried. Furthermore FA doesn't to my knowledge have an API to use, so the application would have to go to every page and download the images. Also, I haven't had an account on FA since they forced a password reset. So I will not be making a version for FA.
Sonamyfan04
5 years, 1 month ago
Fuck. Well thanks for answering. Sorry for bothering you
zox
zox
4 years, 7 months ago
TakiHopper
5 years ago
Works brilliantly! Thank you its a very useful tool especially if you want to make backups.
TakiHopper
5 years ago
By the way forgot to ask does it also download scraps or only the main gallery? :/
BunnyFoxglove
5 years ago
It should download the scraps as well iirc.
TakiHopper
5 years ago
Just tested it and yes turns out it obtains everything including scraps, did not have any errors during process either its a real must have. Wish there was something similar for e621.
BunnyFoxglove
5 years ago
e621 does have an API, so it is possible to create one. I'll look into it at some point when I have more time. These projects take a good amount of work.
TakiHopper
5 years ago
Oh i can imagine especially if its all done by one person :/ Btw i think there used to be a danbooru style e621 downloader in the past but i read somewhere on reddit that since its gone behind cloudflare it stopped working.
BunnyFoxglove
5 years ago
If the app was written without the api, or used hardcoded urls then any changes like that will break them. This app gets the url directly from the api, so no matter which cache your images are coming from it works fine.
skyboxmonster
4 years, 11 months ago
Does the program check to see if a file with the same name already exists in the folder its trying to download to and cancels that specific download?

Or does it just overwrite everything?
BunnyFoxglove
4 years, 11 months ago
It checks if you have the file first, and verifies the md5 checksum to make sure it's complete / not corrupted. If it's there and passes the check, it skips the file. Otherwise it overwrites it. The files won't even make it on the list if it passes the checks.
skyboxmonster
4 years, 11 months ago
oh Good. I had to stop a download because I think it got speed throttled at some points and basically stalled.

I found that several of the pictures only saved the top half of the image. with the MD5 feature you added those pictures should be over written with the full picture. that is very nice ^.=.^
Thank you again for making this. I GREATLY enjoy using this tool.
ucok66
4 years, 11 months ago
It is possible to create a custom name for folder and filename?

Ex:
inkbunny/{rating}/{user gallery}/{year}_{month}_{day}_{hour}_{minute}_{title}_{number}.{extension}

The result becomes something like this:
inkbunny/general/Jav/2011_07_2011_21_14_Equestria theme, night.png
inkbunny/general/Jav/2011_08_02_01_21_Storm reschedulling.jpg

{number} only use for submission for multiple pages.
The download folder location is for the root location of these customs.

I recommend this project for inspiration.
BunnyFoxglove
4 years, 11 months ago
Anything is possible, if you're willing to put the time and effort into coding it. There's a ton of extra work involved with doing it that way, including parsing the title string to remove invalid characters.

Feel free to write one like that.
skyboxmonster
4 years, 10 months ago
Would it be possible to add a "download someone else's favorites" feature?
BunnyFoxglove
4 years, 10 months ago
I'm pretty sure I looked into this before, and it wasn't something easy to do. I would have to look again, but iirc you need the user's ID number. I think when you first login with the app it grabs your user ID, which is how I'm able to do it easily for your own favorites.
Kz
Kz
4 years, 9 months ago
I have a little bug to report: after searching for the files through the "Search Result" option, the screen gets stuck on the file list links, clicking on "Next" here does nothing.

--Kz
BunnyFoxglove
4 years, 9 months ago
Did you setup the application with a download folder?
Kz
Kz
4 years, 9 months ago
i believe so, do i need to turn it off?

--Kz
BunnyFoxglove
4 years, 9 months ago
No, that's typically the only time it won't start downloading after it makes a list is when you don't have anywhere set to put them.
DXH3TPX9N76
4 years, 8 months ago
Need help please: After clicking 'yes' when it asks if I'm ready to download the files, the program basically just stops, then it fills up fast with a bunch of 0 byte empty image "files"; it was working fine a few weeks ago, why won't it work now?
BunnyFoxglove
4 years, 8 months ago
0 bytes means the download failed, either it's a server issue or it's losing internet connection and the transfers are timing out.

Did you let the program sit idle for an extended period before clicking download? If the token had expired it may fail, but I'm not 100% sure since I haven't looked at the code in a while. I thought it refreshed the token if it expires, but I can't remember.

On the plus side, the app will check if the files are complete and re-download them if they're not, or corrupted. So it will pick up and complete any 0 byte files the next time it's run.
DXH3TPX9N76
4 years, 8 months ago
No, I didn't let it sit idle, I did it straight away. I tried again today and it's still doing the same thing. My internet connection is fine. Any ideas what might be wrong?
BunnyFoxglove
4 years, 8 months ago
The only thing I can suggest is to go into your IB account settings, and try switching to another CDN. Look in the settings for "Content Delivery Server:" and change it to something else. See if that helps.

Also, just run a small search, like just do 1 artist to test and see if it works.
Phantasma
4 years, 8 months ago
I was having a similar problem, changing the CDN did the trick. Thanks!
GreenReaper
4 years, 8 months ago
Most caches, such as our one in South Africa, do not store a full copy of the files; instead, they redirect to others. Perhaps this is part of the issue, as they may be protected by the host against excessive access.

We recommend only Virginia (USA), Netherlands (Europe) and (now that we have unlimited transfer within our guaranteed bandwidth) the main server for download apps, as these go to dedicated servers with lots of disk and transfer which are under our control. Obviously you might want to change it back afterwards, as performance could be impacted.
Phantasma
4 years, 8 months ago
Thanks for the reply, I was using the São Paulo cache and that cause problem with ib downloader(Empty Files). I changed to the main server when that happen.
I will try the São Paulo cache again. :)
BunnyFoxglove
4 years, 8 months ago
He means, when you want to use the downloader, switch it to one that he listed.

When you just want to browse the website normally, switch it back to São Paulo to speed up your performance.
DXH3TPX9N76
4 years, 8 months ago
Working fine now, thank you so much! You deserve a medal for your service <3
BunnyFoxglove
4 years, 8 months ago
I just hope
GreenReaper
GreenReaper
knows this is happening. So they can look into what's causing it.
New Comment:
Move reply box to top
Log in or create an account to comment.