CybTekSol

It's time to modernize appyface... a good template will end these repetitive tasks! Come over to the enlightened side... LOL

@FranciscoR, THANK YOU for the heads up on these... I try to get everything I can from Micro$haft for free in an attempt to recover some of my investment with them over the years!

Not until 1.0.3 Flo? Does that mean you're going to jump from 1.0.2.215 to 1.0.3?

@appyface,I explained the method I am currently using to accomplish this in the original post above... what you are doing is just a variation of that which I have also used, NOT IDEAL... and not worthy of the polished app that I believe Flo is aiming for. What I am requesting as an added feature which would streamline the process. What I would PREFER to have added is this... included in my original post. This would allow me to add the exported 'Errors Log' to a tab in 'NoteTab Pro' that I always load for various reasons when I am working with Ketarin. Wouldn't that feature be beneficial to you or are you satisfied with additional manual steps?

I think you are referring to the 'Log' window, where I am referring to the 'Error' window. Even on the latest version (1.0.2.215) posted today there is NO CTRL-A to select all (or right click and choose select all) capability for the 'Error' window.

Agreed... I think the average user will not have any problems doing that. Users can create two different versions of the template on their own with a simple copy/paste replacement of the {version} regex with this: ([a-z]+?\s\d{1,2}[a-z]{2}\,\s\d{4}\,\s\d{2}\:\d{2})(?:\sGMT)? either within an external editor, since there are no converted characters (new users see more on this below) or within Ketarin and exporting it as template. When confronted with a situation like this at Softpedia (where multiple versions and download locations are combined), they can import the alternative template which captures the 'Last updated' date and then tweak the {download_url} by inserting an additional anchor from the app's download page for the download location displayed ABOVE the location they actually want to use, such as Softpedia Secure Download \(RO\).*? inserted which would change the {download_url} scrape from: (?<=DOWNLOAD LOCATIONS.*?<table width=".*?<a href=").*?(?=") to: (?<=DOWNLOAD LOCATIONS.*?<table width=".*?Softpedia Secure Download \(RO\).*?<a href=").*?(?=") and in the case of "Everest Ultimate Edition" would capture the third download url (the Beta version). I must caution new users regarding pasting text directly into a template with an external editor as certain characters are converted on export from Ketarin. For example: If you paste the regular expression above into Ketarin it would be exported to a template as: (?<=DOWNLOAD LOCATIONS.*?<table width=".*?Softpedia Secure Download \(RO\).*?<a href=").*?(?=") Notice the < character is converted to < (its hypertext equivalent). This is the case for several other characters as well and can result in template import errors if you are not careful. Just 'food for thought' to give new users a head start! If you are unsure, the safest method is to paste the expression into Ketarin first, then export, and work with the template in an external editor afterwards. CybTekSol

Cool... sounds GOOD to me!

I'm confused... the user would have to input this each time or could this be generated from a custom global variable preset by the user under 'Settings' from {Target path}=whatever ?

My LifeHacker.com Exclusive Downloads Generic template: This template uses Google's search engine to compensate for URL changes at LifeHacker. NOTE: This is a 'generic' template which I use for LifeHacker.com Exclusive Downloads when they are 'featured' on their site on any given day. It may require a small tweak or two each time due to their inconsistencies in page layout, but, it will give to something to play with. 1) There are two user defined global variables used, download_url={download_url} (used as an alternative to {url}) and root_folder=Insert YOUR download destination ROOT folder here [for example C:\Latest-Apps]. 2) The latest version of Ketarin (.0.9.9.22) released January 18, 2009 or later is required as this revision uses the new 'placeholder' feature implemented by Florian. 3) The template follows: <?xml version="1.0" encoding="utf-16"?> <Jobs> <ApplicationJob xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xsd="http://www.w3.org/2001/XMLSchema"> <DownloadBeta>Default</DownloadBeta> <DownloadDate xsi:nil="true" /> <VariableChangeIndicator /> <CanBeShared>true</CanBeShared> <ShareApplication>false</ShareApplication> <HttpReferer>{find}</HttpReferer> <Variables> <item> <key> <string>LifeHackerPageName</string> </key> <value> <UrlVariable> <VariableType>Textual</VariableType> <Regex /> <TextualContent><placeholder name="LifeHacker.com Page Name from URL [Example: belvedere-automates-your-self+cleaning-pc]" /></TextualContent> <Name>LifeHackerPageName</Name> </UrlVariable> </value> </item> <item> <key> <string>find</string> </key> <value> <UrlVariable> <VariableType>RegularExpression</VariableType> <Regex>(?<=Search[ ]Results.*?a href=")http://lifehacker.com/[\d]+/.+?(?=")</Regex> <Url>http://www.google.com/search?hl=en&hl=en&as_q=&as_epq={LifeHackerPageName}&as_sitesearch=lifehacker.com</Url> <Name>find</Name> </UrlVariable> </value> </item> <item> <key> <string>version</string> </key> <value> <UrlVariable> <VariableType>RegularExpression</VariableType> <Regex>Version.*?(Beta.+?Build.+?|Beta.+?|Build.+?|\d.*?)[?:\:|<|&]</Regex> <Url>{find}</Url> <Name>version</Name> </UrlVariable> </value> </item> <item> <key> <string>download_url</string> </key> <value> <UrlVariable> <VariableType>RegularExpression</VariableType> <Regex>[a-z]+[ ]only:.*?a href="([a-z]+://.*?\.[a-z]{3})"</Regex> <Url>{find}</Url> <Name>download_url</Name> </UrlVariable> </value> </item> </Variables> <ExecuteCommand /> <Category>LifeHacker-Exclusive-Apps</Category> <SourceType>FixedUrl</SourceType> <PreviousLocation /> <DeletePreviousFile>true</DeletePreviousFile> <Enabled>true</Enabled> <FileHippoId /> <LastUpdated xsi:nil="true" /> <TargetPath>{root_folder}\{category}\{appname:replace: :_}_v{version:replace: :_}.{url:ext}</TargetPath> <FixedDownloadUrl>{download_url}</FixedDownloadUrl> <Name><placeholder name="Application Name" /></Name> </ApplicationJob> </Jobs> To use it: 1) Define the user defined global variables under 'Settings' in Ketarin to YOUR preferences 2) Edit the template externally to reflect these modifications (if you choose not to use mine) and change the <TargetPath> line to YOUR preferences 3) Then: a) Import it (Obviously) Enter the information needed as requested as a result of the 'placeholder' prompts... it will ask for the LifeHacker.com Page Name from URL [Example: belvedere-automates-your-self+cleaning-pc] and the application's name c) Modify the Category to YOUR preferences d) Change the 'Advanced Settings' to YOUR preferences e) TWEAK the regular expressions for {version} and {download_url} f) VERIFY...VERIFY...VERIFY that ALL regex matches WORK and MAKE ADJUSTMENTS to them as necessary! REFINE it to YOUR NEEDS! Enjoy! CybTekSol

Flo, Could you add this request to the 'queue' for me please? Since I have over a thousand apps configured in Ketarin now, it is not uncommon to have 10-20 errors per global download session. To capture the output from the 'Errors' dialog, I have to Ctrl-Left-Click each line to highlight, then Ctrl-C to get them to the clipboard and them past them into NotePad2 for review and subsequent resolution. Ideally, it would be GREAT to have these errors automatically exported to a designated 'Errors Log' file each session with an overwrite or append option. Short of that... maybe a Right-Click, paste error contents to clipboard. No rush as it's simply an efficiency issue for me. Thanks, as always!

Hey Flo, I've been getting the latest versions of Ketarin manually so this issue hasn't affected me but I'm somewhat curious after a cursory overview of this thread... Will Ketarin always download the latest stable version of Ketarin, not the latest beta version, even if it is set to always download beta version as a result of your configuration of the server? Makes me wonder just how effective this setting is with other developer's sites if the have a similar server configuration? OR, are you able to accomplish this due to some specific ability to override the setting through your intimate knowledge of Ketarin's code?

I'm glad you could use it. Would you please take my template, make changes that you have implemented to suit your needs and post it to this same thread to give other users better coverage of Softpedia apps? Thanks in advance...

If my memory serves me correctly, it was an issue for a couple of the apps I get from there for some freaky reason, so I left it in the template... can't remember the specifics.

I just took a quick stab at it when I made that small tweak as my time is limited... didn't have a chance to verify the match between version and DL... I should have known they would be reversed!

Made a small temporary tweak to the {version} regex... looking forward to your input.

@FranciscoR, This is an example of one of the Softpedia inconsistencies we discussed in the past. This particular example would require some major regex tweaking... OBVIOUSLY! The 80-90% success rate is still better than starting from scratch with every app there though... know what I mean? I don't ever see an infallible template for their site.

Go for it! Suggestions?

I believe (not positive though) it will create the necessary ones on first run, just not the un-install info, etc.. It is not a stealthy app, therefore, if it is run as a portable app manual cleaning of the registry (at least) will be required to eliminate evidence of your presence... know what I mean?

A typo during an external edit... corrected now... THANKS for catching it!

My LATEST Universal Softpedia.com Template (TEST): ****PLEASE TEST it and give me some feedback on this one if you refine it or have significant problems citing specific examples. ****NOTE: This template uses the application's INFO page URL. 1) There are two user defined global variables used, download_url={download_url} (used as an alternative to {url}) and root_folder=Insert YOUR download destination ROOT folder here (for example C:\Latest-Apps). 2) The latest version of Ketarin (1.0.3) released February 24, 2009 or later is required to overcome their site changes for 'user-agent'. 3) The template follows: <?xml version="1.0" encoding="utf-16"?> <Jobs> <ApplicationJob xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xsd="http://www.w3.org/2001/XMLSchema"> <DownloadBeta>Avoid</DownloadBeta> <DownloadDate xsi:nil="true" /> <VariableChangeIndicator /> <CanBeShared>true</CanBeShared> <ShareApplication>false</ShareApplication> <HttpReferer>{redir1}</HttpReferer> <Variables> <item> <key> <string>version</string> </key> <value> <UrlVariable> <VariableType>RegularExpression</VariableType> <Regex><title>Download.*?(\d.*?|\d.*?[ ]Build[ ]\d.*?|\d.*?[ ]Beta[ ]\d.*?)(?:\s\/\s|\s-\s)</Regex> <Url><placeholder name="Application Info Page URL from Softpedia" /></Url> <Name>version</Name> </UrlVariable> </value> </item> <item> <key> <string>redir1</string> </key> <value> <UrlVariable> <VariableType>RegularExpression</VariableType> <Regex>(?<=download_bkg.gif.*?<a href=").*?(?=")</Regex> <Url><placeholder name="Application Info Page URL from Softpedia" /></Url> <Name>redir1</Name> </UrlVariable> </value> </item> <item> <key> <string>download_url</string> </key> <value> <UrlVariable> <VariableType>RegularExpression</VariableType> <Regex>(?<=DOWNLOAD LOCATIONS.*?<table width=".*?<a href=").*?(?=")</Regex> <Url>{redir1}</Url> <Name>download_url</Name> </UrlVariable> </value> </item> </Variables> <ExecuteCommand /> <Category>[iNSERT CATEGORY HERE]</Category> <SourceType>FixedUrl</SourceType> <DeletePreviousFile>false</DeletePreviousFile> <Enabled>true</Enabled> <FileHippoId /> <LastUpdated xsi:nil="true" /> <TargetPath>{root_folder}\{category}\{appname:replace: :_}_v{version:replace: :_}.{url:ext}</TargetPath> <FixedDownloadUrl>{download_url}</FixedDownloadUrl> <Name><placeholder name="Application Name" /></Name> </ApplicationJob> </Jobs> To use it: 1) Define the user defined global variables under 'Settings' in Ketarin to YOUR preferences 2) Edit the template externally to reflect these modifications (if you choose not to use mine) and change the <TargetPath> line to YOUR preferences 3) Then: a) Import it (Obviously) Enter the information needed as requested as a result of the 'placeholder' prompts... it will ask for the application's DOWNLOAD page URL (NOT the information page URL) and the application's name c) Modify the Category to your preferences d) Change the 'Advanced Settings' to your preferences e) VERIFY...VERIFY...VERIFY that ALL regex matches WORK and MAKE ADJUSTMENTS to them as necessary! I have had a 80-90% success rate with this template; in instances where it failed, I simply tweak the regular expression. CybTekSol

There is still a policy on some... although the template can be simplified as the download url is always hxxps://addons.mozilla.org/en-US/firefox/downloads/latest/{Add-On_ID} for cross-platform extensions, platform specific extensions would not be supported. Since you may not be interested in all platforms, I will release a simpler template that you might prefer to use. In the interim, I have revised the template above (and the Thunderbird extensions template) to reflect their site changes!

One of my favorite apps, Universal Extractor is a perfect solution to this... works with MOST installers. It's available HERE.

I think it's a different issue (input string of characters with wrong format)... probably while FranciscoR was testing the [+Function "regex" (takes arguments "regular expression" and "index of match group" optionally)] features Flo has implemented.

One of my favorite extensions for Firefox, DownThemAll, is great for capturing such information. Just configure it not to close the 'Download Manager' window when downloads are complete and you can glean this info by right-clicking on the download entry in the manager and selecting 'Download information'. There are other ways to accomplish this but this is most efficient for me at present.

I was about to ask the same question in order that I can 'give it a spin', so to speak.