Welcome to Inkbunny...
Allowed ratings
To view member-only content, create an account. ( Hide )
Whippy

ArtHawk is re-wired lol

by
before
--------------------------------------------------------------------------------------------------------------------------
Today I spent some time recoding the part that downloads pages of info from InkBunny's API. It got 100 submissions at a time and the code was pretty clean. BUT..it took 5 minutes just to download 13 pages of text. That's...completely horrible in my opinion. So for the moment I'm going to just put ArtHawk aside and try to learn a real programming language in my spare time. At the moment, it feels pretty shitty to have wasted so much time on this, but I guess it's better than plodding on trying to use something that's completely inadequate for the task.

If you want something faster to use for IB, go over to
BunnyFoxglove
BunnyFoxglove
's page and give his InkBunny downloader a try. It's coming along very nicely I must say!

I might split arthawk into separate downloaders for FA and DA later, not really sure yet.

As for programming itself....I ponder this quite a lot...
https://www.youtube.com/watch?v=wNYHoI47fw0
--------------------------------------------------------------------------------------------------------------------------


after:
--------------------------------------------------------------------------------------------------------------------------
Okay, I just tried using URLDownloadToFile and it cut the download time from 5 minutes down to 40 seconds or about a minute for my gallery. That is totally acceptable ^^ I'll see if I can find a cURL wrapper for AHK to get even more speed. I just integrated the fixes into ArtHawk, and it's really fast it grabbing submission info now, all without needing to launch multiple processes.

Sorry about the doom and gloom so quickly. Discouragement is a reflex sometimes, I swear >.> Gotta whip it..
Viewed: 128 times
Added: 6 years, 2 months ago
 
BunnyFoxglove
6 years, 2 months ago
Whippy
6 years, 2 months ago
OMG..you just made my day with that song ^___^ I laughed so hard!!! I needed that ^.^ *squeezes you tight*
smaxattax
6 years, 2 months ago
300 seconds for 13 pages? Ouch. Have you tried cURL? It looks like libcurl is usable in AutoHotKey: http://www.autohotkey.com/community/viewtopic.php?t=22621

I've been using cURL in my PHP script and it usually only takes a second or so to load each page (~15-18 seconds for your 13-page gallery). cURL also uses HTTP keep-alive to re-use the TCP connection (like Inkbunny wants scripts to do) instead of constantly closing and re-opening a new connection.

Also, I recently made my script public and would love your thoughts.
Whippy
6 years, 2 months ago
Actually, I just tried using plain ol vanilla URLDownloadToFile and it got all 13 pages in 45 seconds, the same amount of time it took BunnyFoxGlove's program. So I think I'll roll with that for now. I literally just discovered this after posting this journal ^///^

cURL sounds really badass though!! But something tells me it would take the same amount of time on my internet connection. I would love to see your script btw.
smaxattax
6 years, 2 months ago
edit: Whoops. I meant to reply to your reply.

You might want to do a WireShark dump of URLDownloadToFile downloading multiple files from the same server. You can't see exactly how your HTTP libraries are behaving when your connection is SSL encrypted (unless you man-in-the-middle yourself). I just set up a local webserver with something like 1.jpg, 2.jpg, etc. With cURL (or at least how I'm using it, only initializing it once and updating the URL) the same local port is used for all transfers. If the TCP connection is closed and re-established every time, you'll see your local port change or increment. I imagine this would add a significant amount of delay.

cURL also supports cookies, custom user agents, POST, etc. so it can be used for sites that aren't particularly script-friendly.

Thanks. The script is linked in my journal. You'll have to install PHP and grab Aria2 to use it, which sucks, but because the dependencies are open-source it can be run most platforms. It has roughly the same functionality as ArtHawk for Inkbunny at the moment (mass download from a user list) but I hope clean it up and add support for additional sites in the future.
MichaelJBear
6 years, 2 months ago
Aaawwww... I'm sorry to hear that li'l bro... but I can personnaly say that ArtHawk slim for FA work good for me... Like we say... just let your mind relax a li'l and maybe you'll ahve other idea will pop out on how to solve that problem.... dont give up *hug* I see that you might have the solution after all... I've just read the bottom of your journal... Yeah sometime the solution can hide in another kind of software or procedures/functions... like this URTLDownload... *smile*
fluffdance
6 years, 2 months ago
I've heard that smashing fresh lettuce into your subroutines and screaming obscenities at impromptu deities can help reduce latencies in end-user oriented programs, but I'm not really a programmer, so I may have that a bit wrong...  ;-)

So, instead, have one of the world's most famous voiceover artists cutting loose and having fun:  https://www.youtube.com/watch?v=rLDgQg6bq7o
Trundle
6 years, 2 months ago
OK pun time.. you gotta whip it, whip it good.... (sorry, couldn't resist) :P
btk6
5 years, 2 months ago
Still working on ArtHawk or is there a downloader for FA and DA. that you know of that i can use.
Whippy
5 years, 2 months ago
Still working on it atm. I think Smaxattax up there was working on something, might wanna check it out. I still got a few bugs and adjustments to do to arthawk. Right now there's one bug where it fills the screen with garbage from the listview control and crashes explorer. So until I figure out what's causing that, I'm pretty hesitant on giving it out because I know people will have that problem.
btk6
5 years, 2 months ago
ok thax for the update. I don't know how to install smaxattax JAID but BunnyFoxglove is easy.
Charliemon
3 years, 5 months ago
is art hawlk update for fa as it seems to have stopped working :( you did a great job on it
New Comment:
Move reply box to top
Log in or create an account to comment.