CybTekSol

Ditto from me!

Excellent input FranciscoR... some notes: Maybe swap 2 & 3 positions as some light users may not need to dive into the 'geeky' stuff such as advanced regex or break it down into casual and advanced categories? Describe to dutchclimber your defined 'global variables' such a {shared} for clarification BTW... what did you create the diagram with? I like it.

It is evolving dutchclimber... keep up the good work. I would hope that at some point in the future, Flo would consider an editable Wiki based along these lines that would be dynamic as 'proficient forum members' could add content and a moderator (you possibly?... since you took the initiative) parse/organize it with oversite and feedback. When new features are added to Ketarin, they could be documented quickly in an indexed/structured manner such as you are using in the PDF. New users could request features be added/clarified in a dedicated forum section and the more advanced users could add/edit Wiki content and share the load. It would shorten the learning curve for new users as all the info would be in one place and indexed for quick access. A Wiki snapshot in PDF format could easily be packaged with each successive release of Ketarin... just my humble opinion. As always, it's Flo's decision to make.

I'm approaching the 'placeholder' prompt choices differently... just experimenting. It was my altered template that was at fault, not a bug; I didn't keep up with the regex being input as I was tired and it resulted in feeding Ketarin a ridiculous regex. lol I think you should post your new SP template in a separate thread when you are able to find the time as it is certainly a breakthrough with SoftPedia.

@FranciscoR, I've been playing with your SP template attempting to incorporate your ideas in a slightly different direction and goofed up with the placeholder inputs, crashed Ketarin and wiped my database. Glad I have those backups! I've been working 22 hrs. now so that may be the reason for the slip-up... signing off and goin' to get some sleep. Will work on it again in a few days... I do like it though... GREAT job!

I rotate using those methods as well... depends on my mood. This will open up a new frontier of possibilities for templates indeed... I am anxiously anticipating it for sure. (and cookie support)

TEMPLATE: CybTekSol's Improved Generic Template LOCATION: http://ketarin.canneverbe.com/forum/viewtopic.php?pid=2366#p2366 DATE: May 5, 2009 OVERVIEW: Revision of my Generic Template that includes 'anchor element' input in regex for version and download URL variables to improve reliability MINIMUM KETARIN VERSION REQUIRED: 1.0.5 due to 'variables within regex'

My Improved Generic template: NOTE: This is a improved version of my 'generic' template which I use when an application is not hosted on one of the major sites for which I have an existing template. It now allows you to input an 'anchor string' for the {version} and {download_url} variable regex(s). This should be characters that are recurring and exist BEFORE and NEAR the version or download URL that you desire to match. 1) There are two user defined global variables used, download_url={download_url} (used as an alternative to {url}) and root_folder=Insert YOUR download destination ROOT folder here [for example C:\Latest Downloads]. 2) The latest version of Ketarin (1.0.5) released March 21, 2009 or later is required as this revision uses 'variables within regex'. 3) The template follows: <?xml version="1.0" encoding="utf-16"?> <Jobs> <ApplicationJob xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xsd="http://www.w3.org/2001/XMLSchema"> <DownloadBeta>Default</DownloadBeta> <DownloadDate xsi:nil="true" /> <VariableChangeIndicator>{version}</VariableChangeIndicator> <CanBeShared>true</CanBeShared> <ShareApplication>false</ShareApplication> <HttpReferer /> <Variables> <item> <key> <string>anchor1</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>Textual</VariableType> <Regex /> <TextualContent><placeholder name="Recurring 'Anchor String' BEFORE and NEAR Version Number? (Example: Version)" value="Version" /></TextualContent> <Name>anchor1</Name> </UrlVariable> </value> </item> <item> <key> <string>version</string> </key> <value> <UrlVariable> <VariableType>RegularExpression</VariableType> <Regex>(?:{anchor1}.*?)(Beta.+?|Build.+?|\d.*?)(?:<|&)</Regex> <Url><placeholder name="URL to be 'scraped'?" /></Url> <Name>version</Name> </UrlVariable> </value> </item> <item> <key> <string>anchor2</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>Textual</VariableType> <Regex /> <TextualContent><placeholder name="Recurring 'Anchor String' BEFORE and NEAR URL? (Example: Download)" value="Download" /></TextualContent> <Name>anchor2</Name> </UrlVariable> </value> </item> <item> <key> <string>download_url</string> </key> <value> <UrlVariable> <VariableType>RegularExpression</VariableType> <Regex>(?:{anchor2}.*?)(?:"|')(\w+:\/\/([\w@][\w.:@]+)\/?[\w\.?=%&=\-@/$,]*[\w\.?=%&=\-@/$.]*\.(?:exe|7z|zip|zip2|arc|bz|bz2|bzip|gz|gzip|jar|lha|lzh|lzw|pak|rar|sit|sit!|sit5|sitd|sithqx|sitx|tz|wsz|cab|msi|bin|img|iso|xpi|pbp))(?:"|')</Regex> <Url><placeholder name="URL to be 'scraped'?" /></Url> <Name>download_url</Name> </UrlVariable> </value> </item> </Variables> <ExecuteCommand /> <Category><placeholder name="Category?" value="New App" /></Category> <SourceType>FixedUrl</SourceType> <DeletePreviousFile>false</DeletePreviousFile> <Enabled>true</Enabled> <FileHippoId /> <LastUpdated xsi:nil="true" /> <TargetPath>{root_folder}\{category}\{appname:replace: :_}_v{version:replace: :_}.{url:ext}</TargetPath> <FixedDownloadUrl>{download_url}</FixedDownloadUrl> <Name><placeholder name="Application Name?" /></Name> </ApplicationJob> </Jobs> To use it: 1) Define the user defined global variables under 'Settings' in Ketarin to YOUR preferences 2) Edit the template externally to reflect these modifications (if you choose not to use mine) and change the <TargetPath> line to YOUR preferences 3) Then: a) Import it (Obviously) Enter the information needed as requested as a result of the 'placeholder' prompts... it will ask for regex anchors, the URL to be 'scraped' and the application's name c) Modify the Category to YOUR preferences d) Change the 'Advanced Settings' to YOUR preferences e) TWEAK the regular expressions for {version} and {download_url}... if needed f) VERIFY...VERIFY...VERIFY that ALL regex matches WORK and MAKE ADJUSTMENTS to them as necessary! REFINE it to YOUR NEEDS! This template will give you a solid starting point with applications from sites that are simply too small to justify developing a template and the {version} and {download_url} regex(s) can be saved in your 'default template' if you Like them. CybTekSol

I found a thread in the forum that may point you in the right direction. If my memory serves me correctly, Kerberos and a couple of other forum members are compiling hacked versions of Ketarin, so maybe they will respond with some info/help.

Nice one dutchclimber... thanks!

20Mbit bandwidth Stalker? Man... now I have 'bandwidth envy'! LOL...

If any other geeks are interested, the Giveaway of the Day at the 'GOTD' site is ForeUI, a Java-based UI prototype mock-up app that appears pretty cool! It is packaged with Java but by simply editing the .ini file in the main folder to reflect the path to your installed version, the packaged Jave jre folder can be deleted to save disk space. There are about 12 hours left on installing and activating this one. Happy UI prototyping! There is a in-depth review and a video tutorial link at 'GOTD' for more info. I can envision several uses for this one.

Hey dutchclimber, I need some snowy mountain wallpaper... did you take any high res pics?

I have developed a 'Generic Template for PADfiles' based on the above example and I will post it if you are interested Stalker. It works very well so far.

You've made my day FranciscoR... I try! I haven't had a chance to test your SoftPedia template yet but it looks very impressive... I can't wait. Ironically, I designed a 'Generic Template' with placeholders for anchor elements (for version and download URL regex) a few days ago using this same concept and it works beautifully... so far!

Will do FranciscoR... but it may be Monday or Tuesday before I get a chance.

Also, remember you can set the 'add application' defaults with generic values and regex 'scrapes' for version and download URL which will give you a starting point each time. See this thread for more info if you are not aware of this.

It makes me feel better when I find I'm not alone in making mistakes Flo... LOL. Even 'SUPER-CODERS' are not immune. Otherwise, the other features are working well for me! I was hoping for an initial 'search and select' feature (or similar) in this ... maybe next release? OK... I'm being picky... keep up the great work... I'm patient. BTW... your thoughts on cookie support in the future?

You are right I copied the wrong URL... but I was real close... LOL

Sounds like a plan to me dutchclimber... if Flo agrees. Obviously you have some photography skills as well.

Are you 'scraping' the version? Try this: <?xml version="1.0" encoding="utf-16"?> <Jobs> <ApplicationJob xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xsd="http://www.w3.org/2001/XMLSchema"> <DownloadBeta>Default</DownloadBeta> <DownloadDate xsi:nil="true" /> <CheckForUpdatesOnly>false</CheckForUpdatesOnly> <VariableChangeIndicator>{version}</VariableChangeIndicator> <CanBeShared>true</CanBeShared> <ShareApplication>false</ShareApplication> <ExclusiveDownload>false</ExclusiveDownload> <HttpReferer /> <Variables> <item> <key> <string>version</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>RegularExpression</VariableType> <Regex>(?:\<Program_Version\>)(Beta.+?|Build.+?|\d.*?)(?:[\s\s]|<|&)</Regex> <Url>http://cdburnerxp.se/rss/padfile.xml</Url> <Name>version</Name> </UrlVariable> </value> </item> </Variables> <ExecuteCommand /> <ExecutePreCommand /> <Category>CD-DVD</Category> <SourceType>FixedUrl</SourceType> <PreviousLocation /> <DeletePreviousFile>false</DeletePreviousFile> <Enabled>true</Enabled> <FileHippoId /> <LastUpdated xsi:nil="true" /> <TargetPath>{target}\{category}\{appname:regexreplace:(\w+[\s]?\w+)(\s\(\w+\))?:$1}\{appname:replace: :_}_v{version:replace: :_}.{url:ext}</TargetPath> <FixedDownloadUrl>http://cdburnerxp.se/rss/padfile.xml</FixedDownloadUrl> <Name>CDBurnerXP</Name> </ApplicationJob> </Jobs> Modify it to your needs.

Read the thread for version 1.0.5 starting with this post and see the example xml post by Flo below in the thread. As FranciscoR posted while I was preparing this, FranciscoR's Totalcmd.pl template is a great example to study.

Looks promising FranciscoR... I'll do a little experimenting when I have the time.

A quick glance and it looks good so far dutchclimber! This is one of the things I have not had the time to tackle yet and I will try to take a closer look later and contribute. Who knows... we may be able to get it to a point that Flo would consider packaging the PDF with Ketarin. BTW, are you affiliated with DutchOrange.com? I am an animal lover and the photos there are BEAUTIFUL... EXCELLENT photography!!

A scrollable 'drop-down menu' that is populated with the user's existing categories using a 'placeholder' would be awesome for me Flo!