shawn

Please paste app profiles in 'code' blocks so that nothing is reformatted by the forum software. Testing this now.

Hi, Martin, A server status code of 304 isn't an "error", it's an HTTP status response code. In this case, it's intended to help reduce the amount of bandwidth wasted downloading files that haven't changed. I tested with a couple of my profiles where I can access the server logs and it doesn't look like Ketarin is actually sending an ETag or If-Modified-Since header. That means that it simply can't receive a 304 response. Anyway...I'm not seeing this behavior. Can you share the profile you're using?

Is anyone else having random failures with SourceForge downloads? About a quarter of my SF downloads are reporting "Unable to connect to the remote server" each run. Always different apps. Always at least 2 and up to 20. Looks like I might have to impose "one at a time" for sourceforge.net, too.

I think what he's really after is a way to identify a link based on the anchor text, not a URL fragment. This should work: href="([^"]+)"[^>]*>.+?known_part_here.+?</a>

I can replicate the problem, but cannot see why. The Truecrypt server is not behaving the way other servers do when using the httpx protocol extension or the convert-get-proxy with "/dl" or the direct parsed URL you've included above. I'd have to chalk this up to some form of security software on their end that can tell the difference and doesnt like Ketarin.

Also, please use bbcode "code" blocks around any templates you post to make sure that it's easy to replicate them. Otherwise certain characters are likely to be replaced by entities, which makes troubleshooting near impossible. We need to be able to see *exactly* what you see to replicate your situation.

The download predictive percentage can only apply if the server responds with an http header indicating the filesize. In this case, the server doesn't tell Ketarin how big the file is, so Ketarin can only download it with an activity indicator - NOT a percentage view. As far as speed - that's entirely on the server's end - there's rarely any difference between speed within Ketarin and using a browser. Have you timed the download using a browser and within Ketarin to see if there's actually a performance difference?

This is my first try at a Google Code template. Works for me, but it hasn't been exhaustively tested. Please let me know how it works for you. <?xml version='1.0' encoding='utf-8'?> <Jobs> <ApplicationJob xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xsd="http://www.w3.org/2001/XMLSchema" Guid="debb1deb-1024-1975-abcd-aa0000000007" > <Name><placeholder name="Name?" value="" /></Name> <Category><placeholder name="Category?" value="Web" /></Category> <SourceType>FixedUrl</SourceType> <DeletePreviousFile><placeholder name="Delete Previous Version?" value="true" options="false|true" /></DeletePreviousFile> <WebsiteUrl></WebsiteUrl> <UserNotes /> <IgnoreFileInformation>false</IgnoreFileInformation> <DownloadBeta>Default</DownloadBeta> <DownloadDate xsi:nil="true" /> <CheckForUpdatesOnly>false</CheckForUpdatesOnly> <VariableChangeIndicator>version</VariableChangeIndicator> <CanBeShared>true</CanBeShared> <ShareApplication>false</ShareApplication> <ExclusiveDownload>false</ExclusiveDownload> <HttpReferer /> <Variables> <item> <key> <string>tag</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>Textual</VariableType> <Regex /> <TextualContent><placeholder name="What is the tag from the URL at code.google.com?" value="" /></TextualContent> <Name>tag</Name> </UrlVariable> </value> </item> <item> <key> <string>swebsite</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>Textual</VariableType> <Regex /> <TextualContent>http://code.google.com/p/{tag}/</TextualContent> <Name>swebsite</Name> </UrlVariable> </value> </item> <item> <key> <string>schangelog</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>RegularExpression</VariableType> <Regex><link rel="alternate" type="text/html" href="([^"]+)" /></Regex> <Url>http://code.google.com/feeds/p/{tag}/downloads/basic</Url> <TextualContent /> <Name>schangelog</Name> </UrlVariable> </value> </item> <item> <key> <string>version</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>RegularExpression</VariableType> <Regex>Version ([\d\.]+)</Regex> <Url>http://code.google.com/feeds/p/{tag}/downloads/basic</Url> <Name>version</Name> </UrlVariable> </value> </item> <item> <key> <string>sdownload</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>RegularExpression</VariableType> <Regex>generateDownloadEvent[^"]+"[\s\r\n\t]*href="([^"]+)"</Regex> <Url>{schangelog}</Url> <Name>sdownload</Name> </UrlVariable> </value> </item> <item> <key> <string>snotes</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>Textual</VariableType> <Regex /> <Name>snotes</Name> </UrlVariable> </value> </item> <item> <key> <string>spc</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>Textual</VariableType> <Regex /> <TextualContent>gcode</TextualContent> <Name>spc</Name> </UrlVariable> </value> </item> </Variables> <ExecuteCommand /> <ExecutePreCommand /> <Enabled>true</Enabled> <FileHippoId /> <TargetPath>.\{category}\{appname:regexreplace:([\s\t\r\n\-\\&]+):_}-{version}.{url:ext}</TargetPath> <FixedDownloadUrl>http:{sdownload}</FixedDownloadUrl> </ApplicationJob> </Jobs>

I just started playing with SARDU and expect to have a number of >2gb apps (operating systems) in the near future, so this is an essential update. If you haven't checked out Sardu, yet, you'll want to.

Crashed here, too, exactly at 2gb. I download MUCH larger files via browser, FTP, SSH, torrent and other methods all the time, and this is the first file (to my knowledge) that's larger than 2gb via Ketarin, so it's definitely a Ketarin issue.

Is it storing the file to the same drive each time? I'm testing the WoT download here. I'll let you know the results.

Hi, Flo! Since the CNet issues I've been trying to rewrite a bunch of my apps. Doing so is a little more work than it could be, since I have to manually process each variable each time to replace known values with what is being parsed or pre-processed. Which leads me to... In the Variables window: 1) I'd like to be able to click the variable name on the left and "copy" top copy the VALUE of that variable. I'd actually like two methods here. The first, if I select the variable named "version" from the list and CTRL+C/copy it, I'd like to copy the variable name as a variable insert "{version}". With CTRL+SHIFT+C I'd like to have the processed value "2.3.1" copied to the clipboard. 2) I'd also like to be able to copy from the "contents from URL" box with any variables within it processed. This would really help in other areas, too. A key combination like CTRL+SHIFT+C would be perfect.

Any chance you have a 32 bit processor and/or are storing it on a FAT16 drive/partition? Many USB keys are formatted in FAT16, and small partitions can be, too. FAT16 limits you to 2gb per file, regardless of CPU used. Some 32bit operating systems choke on anything larger than 2gb, too, regardless of filesystem in use.

Appyface, replace the "title" variable with the "Product / File Description" string from the download page and this should work for you. <?xml version='1.0' encoding='utf-8'?> <Jobs> <ApplicationJob xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xsd="http://www.w3.org/2001/XMLSchema" Guid="ed8733a7-2e6a-4fcb-bf61-5db4f4d28076"> <Category>Development</Category> <WebsiteUrl /> <UserAgent /> <UserNotes /> <LastFileSize>0</LastFileSize> <LastFileDate xsi:nil="true" /> <IgnoreFileInformation>false</IgnoreFileInformation> <DownloadBeta>Default</DownloadBeta> <DownloadDate xsi:nil="true" /> <CheckForUpdatesOnly>false</CheckForUpdatesOnly> <VariableChangeIndicator /> <CanBeShared>true</CanBeShared> <ShareApplication>false</ShareApplication> <ExclusiveDownload>false</ExclusiveDownload> <HttpReferer /> <SetupInstructions /> <Variables> <item> <key> <string>title</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>Textual</VariableType> <Regex /> <TextualContent>Windows x64</TextualContent> <Name>title</Name> </UrlVariable> </value> </item> <item> <key> <string>url1</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>RegularExpression</VariableType> <Regex>="([^"]+?java-se-jdk[^"]+?)"</Regex> <Url>http://www.oracle.com/technetwork/java/javase/downloads/index.html</Url> <Name>url1</Name> </UrlVariable> </value> </item> <item> <key> <string>url2</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>RegularExpression</VariableType> <Regex>"title":"{title}", "size":"[^"]+", "filepath":"(http[^"]+)"</Regex> <Url>http://www.oracle.com{url1}</Url> <Name>url2</Name> </UrlVariable> </value> </item> <item> <key> <string>url3</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>RegularExpression</VariableType> <Regex>"([^"]+-relnotes-[^"]+)"</Regex> <Url>http://www.oracle.com/technetwork/java/javase/downloads/index.html</Url> <Name>url3</Name> </UrlVariable> </value> </item> <item> <key> <string>url4</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>RegularExpression</VariableType> <Regex>"([^"]+-naming-[^"]+)"</Regex> <Url>http://www.oracle.com{url3}</Url> <Name>url4</Name> </UrlVariable> </value> </item> <item> <key> <string>version</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>RegularExpression</VariableType> <Regex><tt>java version "([\d\.]+)"</tt></Regex> <Url>http://www.oracle.com{url4}</Url> <Name>version</Name> </UrlVariable> </value> </item> </Variables> <ExecuteCommand /> <ExecutePreCommand /> <ExecuteCommandType>Batch</ExecuteCommandType> <ExecutePreCommandType>Batch</ExecutePreCommandType> <SourceType>FixedUrl</SourceType> <PreviousLocation /> <DeletePreviousFile>true</DeletePreviousFile> <Enabled>true</Enabled> <FileHippoId /> <LastUpdated xsi:nil="true" /> <TargetPath>.\{category}\{appname:regexreplace:([\s\t\r\n\-\\&\/]+):_}-{version}.{url:ext}</TargetPath> <FixedDownloadUrl>{url2}</FixedDownloadUrl> <Name>JDK x64</Name> </ApplicationJob> </Jobs>

You'll probably want to copy jobs.db first, of course.

If it's on a USB stick, I'd recommend instead you just duplicate the jobs.db and alter the new database directly to remove the before/after events before running it. Wouldn't that be more effective in a temporary and inconsistent situation like this one? sqlite3 jobs.db "update settings set SettingValue = 'System.String:' where SettingPath = 'PreUpdateCommand';" sqlite3 jobs.db "update settings set SettingValue = 'System.String:' where SettingPath = 'PostUpdateCommand';" Tested, and it's working.

Thanks, Flo!

I think it ought to be better coupled to an author. Probably require membership in the forum to be able to submit to the online db. Then, the script on the AUTHORs machine has to be processed successfully at least once per year in order to remain in the online db. The author then enters their login and a key provided by their profile on the forum to enable online database interaction. WordPress just announced that they were going to start "sunsetting" plugins and themes that weren't updated within a certain period (I think they said 2 years). In any case, Ketarin wouldn't be the first to do it.

Whether it's an *intended* feature or not, this has saved me quite a bit of time in the past when troubleshooting a regex pattern or on a site that requires alternate methods for different sources. I'd just as soon suffer with the "bloat" of a few extra kb of space in the jobs.db. Unless it's causing actual problems, I don't see how removing the data would help at all.

yep. just lost all respect for cnet.

Oh, and for updating the filename in Ketarin, just manipulate the database directly using sqlite. That's probably a lot easier than lying to Ketarin about the name so it stores it correctly via the interface.

How about going about it another way? Instead of renaming them inline, use the "after updating an app" option to export the current path to a list file which, when you're done, simply lists all files that require updating their names. Then, "after updating all apps" you run a batch or other script that then performs all of the actions for each file within the list and deletes the list file. Should be pretty simple, and the batch script will have access to pipes and what-not.

What's in your global "after updating an application" and "after updating all applications" settings?

+1. Very important.

For specific model support (though they're the same on all, as far as I can tell), you can change the URL used in the version & dl variables.