FranciscoR Posted February 5, 2009 Report Share Posted February 5, 2009 (edited) 1) Totalcmd.net template <?xml version="1.0" encoding="utf-16"?> <Jobs> <ApplicationJob xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xsd="http://www.w3.org/2001/XMLSchema"> <DownloadBeta>Default</DownloadBeta> <VariableChangeIndicator /> <CanBeShared>true</CanBeShared> <ShareApplication>false</ShareApplication> <HttpReferer /> <Variables> <item> <key> <string>version</string> </key> <value> <UrlVariable> <VariableType>RegularExpression</VariableType> <Regex>(?:<title>).+?((\d+?\.*?){1,5}\d+?\w{0,1}).+?(?:</title>)</Regex> <Url><placeholder name="Application Page URL" /></Url> <Name>version</Name> </UrlVariable> </value> </item> <item> <key> <string>app</string> </key> <value> <UrlVariable> <VariableType>RegularExpression</VariableType> <Regex>(?:="/download\.php\?id=)(\w+?)(?:")</Regex> <Url><placeholder name="Application Page URL" /></Url> <Name>app</Name> </UrlVariable> </value> </item> </Variables> <ExecuteCommand /> <Category>Totalcmd</Category> <SourceType>FixedUrl</SourceType> <DeletePreviousFile>true</DeletePreviousFile> <Enabled>true</Enabled> <FileHippoId /> <TargetPath>{target}\{category}\</TargetPath> <FixedDownloadUrl>http://www.totalcmd.net/download.php?id={app}</FixedDownloadUrl> <Name><placeholder name="Application Name" /></Name> </ApplicationJob> </Jobs> Insert App Page URL and App name. App Page URL example: http://www.totalcmd.net/plugring/fileinfo.html Note: Regex was tested against several urls in this site retrieving NO error (01-02-2009). Known limitations: none. How-To use a Template. 2) Ghisler.com template <?xml version="1.0" encoding="utf-16"?> <Jobs> <ApplicationJob xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xsd="http://www.w3.org/2001/XMLSchema"> <DownloadBeta>Default</DownloadBeta> <CheckForUpdatesOnly>false</CheckForUpdatesOnly> <VariableChangeIndicator /> <CanBeShared>true</CanBeShared> <ShareApplication>false</ShareApplication> <ExclusiveDownload>false</ExclusiveDownload> <HttpReferer /> <Variables> <item> <key> <string>version</string> </key> <value> <UrlVariable> <VariableType>RegularExpression</VariableType> <Regex>(?<=<placeholder name="Download URL" />.+?<strong>).*?(\d{1,2}\.?\d{1,4}\.?\d{0,4}\.?\d{0,4}\.?\d{0,4}\.?[a-z]{0,5})(?=<)</Regex> <Url>http://www.ghisler.com/plugins.htm</Url> <Name>version</Name> </UrlVariable> </value> </item> <item> <key> <string>durl</string> </key> <value> <UrlVariable> <VariableType>Textual</VariableType> <Regex /> <TextualContent><placeholder name="Download URL" /></TextualContent> <Name>durl</Name> </UrlVariable> </value> </item> <item> <key> <string>durl1</string> </key> <value> <UrlVariable> <VariableType>Textual</VariableType> <Regex /> <TextualContent>{durl:regex:(ghisler\.fileburst\.com/.+?)(\d.*?)?\.zip:1}</TextualContent> <Name>durl1</Name> </UrlVariable> </value> </item> <item> <key> <string>durl2</string> </key> <value> <UrlVariable> <VariableType>RegularExpression</VariableType> <Regex>http://({durl1}(?:\d.*?)?)\.zip(?=")</Regex> <Url>http://www.ghisler.com/plugins.htm</Url> <Name>durl2</Name> </UrlVariable> </value> </item> </Variables> <ExecuteCommand /> <ExecutePreCommand /> <Category>Ghisler</Category> <SourceType>FixedUrl</SourceType> <DeletePreviousFile>false</DeletePreviousFile> <Enabled>true</Enabled> <FileHippoId /> <TargetPath>{target}\{category}\</TargetPath> <FixedDownloadUrl>http://{durl2}.zip</FixedDownloadUrl> <Name><placeholder name="Application Name" /></Name> </ApplicationJob> </Jobs> Insert Download URL (from the Name column) and App name. Download URL example: http://ghisler.fileburst.com/plugins/diskdirextended.zip Note: Regex was tested against several urls in this page retrieving NO error (15-02-2009/10-03-2009). Known limitations: the Ghisler.com template doesn't handle Donwload URLs located in any other page. You need to use Ketarin 1.0.4.235 or above with this template. How-To use a Template. 3) Totalcmd.pl template <?xml version="1.0" encoding="utf-16"?> <Jobs> <ApplicationJob xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xsd="http://www.w3.org/2001/XMLSchema"> <DownloadBeta>Default</DownloadBeta> <CheckForUpdatesOnly>false</CheckForUpdatesOnly> <VariableChangeIndicator /> <CanBeShared>true</CanBeShared> <ShareApplication>false</ShareApplication> <ExclusiveDownload>true</ExclusiveDownload> <HttpReferer /> <Variables> <item> <key> <string>value</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>RegularExpression</VariableType> <Regex>(?<=\<input type\="hidden" name\="id" value\=")([^\s]+)(?="/\>)</Regex> <Url><placeholder name="Info Page URL" /></Url> <Name>value</Name> </UrlVariable> </value> </item> <item> <key> <string>durl</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>RegularExpression</VariableType> <Regex>ResponseUri: ([^\s]+)</Regex> <PostData>id=%7bvalue%7d</PostData> <Url>http://en.totalcmd.pl/gets.php?serwer=1</Url> <Name>durl</Name> </UrlVariable> </value> </item> <item> <key> <string>version</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>RegularExpression</VariableType> <Regex>(?<=(?-i:VERSION|WERSJA).*?\>[\s]+?)(\d+.*?)(?=[\s]+?\</div\>)</Regex> <Url><placeholder name="Info Page URL" /></Url> <Name>version</Name> </UrlVariable> </value> </item> </Variables> <ExecuteCommand /> <ExecutePreCommand /> <Category>Totalcmd</Category> <SourceType>FixedUrl</SourceType> <DeletePreviousFile>false</DeletePreviousFile> <Enabled>true</Enabled> <FileHippoId /> <TargetPath>{target}\{category}<placeholder name="TargetPath" value="\wlx-\wcx-\wdx-\wfx-\tools-\tc-\test" />\{url:basefile}.{url:ext}</TargetPath> <FixedDownloadUrl>{durl}</FixedDownloadUrl> <Name><placeholder name="AppName" /></Name> </ApplicationJob> </Jobs> Enter Info Page URL, confirm/change TargetPath and you're ready to go. =) Start here (EN) or here (PL), Info Page URL example. You need to use Ketarin 1.0.5.235 or above with this template. How-To use a Template. Note: this template uses the new POST method of and it is still being tested. Edited April 17, 2009 by FranciscoR Link to comment Share on other sites More sharing options...
FranciscoR Posted February 15, 2009 Author Report Share Posted February 15, 2009 +Gisler.com template @CybTekSol: check this placeholder location. =D Link to comment Share on other sites More sharing options...
CybTekSol Posted February 16, 2009 Report Share Posted February 16, 2009 +Gisler.com template @CybTekSol: check this placeholder location. =D Nice! I've starting working with a similar use of the 'placeholder' feature in my Firefox & Thunderbird extensions templates (inspired by Stalker's template) that I am refining to try to use one template for different platforms and no-policy/policy. IMHO... 'placeholders' have been one of the most productive additions to Ketarin for template flexibility thus far! Link to comment Share on other sites More sharing options...
FranciscoR Posted March 10, 2009 Author Report Share Posted March 10, 2009 !The Ghisler Template now handles changes in filename. Link to comment Share on other sites More sharing options...
CybTekSol Posted March 10, 2009 Report Share Posted March 10, 2009 !The Ghisler Template now handles changes in filename. NICE! I haven't had the time to use 'variables within regex' yet and the delay is frustrating me! Too much work backlog for now. Link to comment Share on other sites More sharing options...
FranciscoR Posted March 11, 2009 Author Report Share Posted March 11, 2009 It's working great. Just don't try to use functions by mistake. =D Flo said variables and he means variables. =) Link to comment Share on other sites More sharing options...
FranciscoR Posted March 19, 2009 Author Report Share Posted March 19, 2009 +Totalcmd.pl template @floele: The credit for this template is all yours. Awesome ! Link to comment Share on other sites More sharing options...
CybTekSol Posted March 20, 2009 Report Share Posted March 20, 2009 +Totalcmd.pl template Do you have a 'version scrape' for this template... or am I missing something? POST data capability is going to broaden our horizons with Ketarin! Link to comment Share on other sites More sharing options...
FranciscoR Posted March 20, 2009 Author Report Share Posted March 20, 2009 Man, I cannot believe I forgot to add version !!! =D I'll add it later. Link to comment Share on other sites More sharing options...
FranciscoR Posted March 20, 2009 Author Report Share Posted March 20, 2009 !Updated Totalcmd.pl template Link to comment Share on other sites More sharing options...
CybTekSol Posted March 21, 2009 Report Share Posted March 21, 2009 !Updated Totalcmd.pl template Thanks FranciscoR... I'm currently testing Total Commander due to your templates as I have not used it before and it appears to be very customizable. If you get the time, could you please e-mail me a list of the URLs for your favorite Total Commander add-ons, plug-ins, etc. through the forum e-mail? Alternately, I think it would be appropriate to post them in this thread since others may be interested as well if Flo has no objections. OK, Flo? TIA FranciscoR. Link to comment Share on other sites More sharing options...
FranciscoR Posted March 21, 2009 Author Report Share Posted March 21, 2009 (edited) Well TC used to make the difference... but yeah, I still prefer it to Vista or 7 Explorer, with FC you can only use wlx... and all the other free file managers are crippled. I have included below a list of the addons I'm using right now. The Ghisler site will give you the recommended addons (tested by the author), Totalcmd.net and Totalmd.pl are well known sites, and if you're feeling lucky , a repository for unreleased addons is http://www.ghisler.ch/wiki/index.php?title=Unreleased_plug-ins . TC 7.5 (w/new features and fixes) will be released in April (I think), for the moment there's no public beta. C:\Program Files\totalcmd\wdx\cdocprop\CDocProp.wdx C:\Program Files\totalcmd\wdx\exif\exif.wdx C:\Program Files\totalcmd\wdx\imageinfo\Images.wdx C:\Program Files\totalcmd\plugins\wdx\TextSearch\TextSearch.wdx C:\Program Files\totalcmd\wfx\wfx_TConsole21\TConsole.wfx C:\Program Files\totalcmd\wlx\vdirsize\visualdirsize.wlx C:\Program Files\totalcmd\wlx\csv\wlx_csv.wlx C:\Program Files\totalcmd\wlx\excellence\excellence.wlx C:\Program Files\totalcmd\wlx\listDoc\listdoc.wlx C:\Program Files\totalcmd\wlx\OpenOffice\OOView.wlx C:\Program Files\totalcmd\plugins\wlx\Imagine\Imagine.wlx C:\Program Files\totalcmd\wlx\inied\IniEd.wlx C:\Program Files\totalcmd\wlx\fileinfo\fileinfo.wlx C:\Program Files\totalcmd\wlx\mMedia\mmedia.wlx C:\Program Files\totalcmd\plugins\wlx\CADView\CADView.wlx C:\Program Files\totalcmd\plugins\wlx\IEView\ieview.wlx C:\Program Files\totalcmd\wlx\SynPlus\SynPlus.wlx C:\Program Files\totalcmd\plugins\wcx\checksum\checksum.wcx C:\Program Files\totalcmd\wcx\chm\CHMDir.wcx C:\Program Files\totalcmd\wcx\diskdir\DiskDirExtended.wcx C:\Program Files\totalcmd\wcx\iso\iso.wcx C:\Program Files\totalcmd\wcx\msi\msi-plus.wcx C:\Program Files\totalcmd\plugins\wcx\WCReg_patched\WCReg_patched.wcx C:\Program Files\totalcmd\plugins\wcx\wordarc\wordarc.wcx Edited March 21, 2009 by FranciscoR Link to comment Share on other sites More sharing options...
CybTekSol Posted March 21, 2009 Report Share Posted March 21, 2009 @FranciscoR, Thanks for the TC info... I'll start tweaking and testing it this week. Link to comment Share on other sites More sharing options...
FranciscoR Posted March 27, 2009 Author Report Share Posted March 27, 2009 ! Minor adjustments to the Totalcmd.pl template Link to comment Share on other sites More sharing options...
CybTekSol Posted March 28, 2009 Report Share Posted March 28, 2009 ! Minor adjustments to the Totalcmd.pl template I had discovered the same problems earlier today and made the very same adjustments to your template as it appears that the 'variable scrape order' does make a difference with their site and simultaneous access to their site causes failures now. I was going to post a 'heads up' regarding this but obviously you had already caught it. Props for being 'on the ball' once again FranciscoR! They must have changed something as it was not an issue before in my experience. Do you have any idea what they changed to cause this? I've not had a good day due to site changes that have forced me to modify 30+ app entries and virtually rendered my CNET template useless. I hope this does NOT become a trend. Link to comment Share on other sites More sharing options...
FranciscoR Posted March 28, 2009 Author Report Share Posted March 28, 2009 (edited) Did you have the same problem with your CNET template ? Problem here was a random 406 error 27-03-2009 20:36:45: Log Viewer: Failed, O servidor remoto devolveu um erro: (406) Não aceitável. 27-03-2009 20:36:46: Log Viewer: Replacing {value} in '{value}' with '745' 27-03-2009 20:36:47: Log Viewer: Replacing {durl} in '{durl}' with 'http://mirror1.bloodman.one.pl/totalcmd/get_remote.php?file=addTls_TC.Log.Viewer_1.10.zip&kat=add&hash=997490be1e2893061c387d6f94237256' 27-03-2009 20:36:47: Log Viewer: Using referer: http://en.totalcmd.pl/download/add/Tls/TC_Log_Viewer 27-03-2009 20:36:48: Log Viewer: Server source file: /totalcmd/get_remote.php 27-03-2009 20:36:48: Log Viewer: Determined target file name: D:\Programas\Totalcmd\tools\addTls_TC.Log.Viewer_1.10.zip 27-03-2009 20:36:48: Log Viewer: Checking if update is required... 27-03-2009 20:36:48: Log Viewer: Update not required, since date and file size remain unchanged 27-03-2009 20:36:49: Log Viewer: Replacing {version} in '{version}' with '1.10' or 27-03-2009 20:36:55: Scintilla: Replacing {value} in '{value}' with '413' 27-03-2009 20:36:56: Scintilla: Replacing {durl} in '{durl}' with 'http://mirror1.bloodman.one.pl/totalcmd/get_remote.php?file=wlxAdv_Scintilla.Lister_0.1.1.zip&kat=wlx&hash=997490be1e2893061c387d6f94237256' 27-03-2009 20:36:56: Scintilla: Using referer: http://en.totalcmd.pl/download/wlx/adv/Scintilla 27-03-2009 20:36:56: Scintilla: Server source file: /totalcmd/get_remote.php 27-03-2009 20:36:56: Scintilla: Determined target file name: D:\Programas\Totalcmd\test\wlxAdv_Scintilla.Lister_0.1.1.zip 27-03-2009 20:36:56: Scintilla: Checking if update is required... 27-03-2009 20:36:56: Scintilla: Update not required, since date and file size remain unchanged 27-03-2009 20:36:58: Scintilla: Failed, O servidor remoto devolveu um erro: (406) Não aceitável. 27-03-2009 20:36:58: Scintilla: Replacing {value} in '{value}' with '413' 27-03-2009 20:36:59: Scintilla: Replacing {durl} in '{durl}' with 'http://mirror1.bloodman.one.pl/totalcmd/get_remote.php?file=wlxAdv_Scintilla.Lister_0.1.1.zip&kat=wlx&hash=997490be1e2893061c387d6f94237256' 27-03-2009 20:36:59: Scintilla: Using referer: http://en.totalcmd.pl/download/wlx/adv/Scintilla 27-03-2009 20:37:00: Scintilla: Server source file: /totalcmd/get_remote.php 27-03-2009 20:37:00: Scintilla: Determined target file name: D:\Programas\Totalcmd\test\wlxAdv_Scintilla.Lister_0.1.1.zip 27-03-2009 20:37:00: Scintilla: Checking if update is required... 27-03-2009 20:37:00: Scintilla: Update not required, since date and file size remain unchanged 27-03-2009 20:37:01: Scintilla: Replacing {version} in '{version}' with '0.1.1' I discovered that changing referer and using exclusive download helps minimizing error but doesn't fix it completely. At least 2 retry's are needed. But I have no clue on what causes it (but I only started monitoring this server recently). Edited March 28, 2009 by FranciscoR Link to comment Share on other sites More sharing options...
CybTekSol Posted March 28, 2009 Report Share Posted March 28, 2009 Did you have the same problem with your CNET template ? No... CNET has changed their cryptic naming scheme to their app pages which changes randomly with a subsequent app version... VERY frustrating. This scheme renders the Google scrape unreliable as it may return the older version's page. I discovered that changing referer and using exclusive download helps minimizing error but doesn't fix it completely. At least 2 retry's are needed. But I have no clue on what causes it (but I only started monitoring this server recently). That is exactly what I have experienced even after making the same changes to the Totalcmd.pl template that you have and I cannot determine what has changed with their site either. Puzzling and disturbing day with Ketarin yesterday for me. Link to comment Share on other sites More sharing options...
FranciscoR Posted March 28, 2009 Author Report Share Posted March 28, 2009 I have created a Cnet template a while ago but these days I never use Cnet, so I never tested it. Guess what, it still works and I didn't change it a bit. =) If you want it I'll post it in your Cnet page (but probably needs more testing). 28-03-2009 22:15:39: Update started with 1 application(s) 28-03-2009 22:15:46: Cnet: Replacing {durl} in '{durl}' with 'http://software-files.download.com/sd/K_QYwuBiLuGNpRPRhsXZ3anOXMOSDmX5uK3YnIDR4RXxu4eCVLa41LdrTyaC8lhHIJzqF3E02zhaornMitDmJGxrw-6VhnGy/software/11011592/10150342/3/absetup.exe?lop=link&ptype=1901&ontid=2356&siteId=4&edId=3&spi=15642ecb0409c971c077f3b8b59b3b3b&pid=11011592&psid=10150342' 28-03-2009 22:15:46: Cnet: Using referer: http://dw.com.com/redir?edId=3&siteId=4&oId=3000-2356_4-10150342&ontId=2356_4&spi=15642ecb0409c971c077f3b8b59b3b3b&lop=link&tag=tdw_dltext<ype=dl_dlnow&pid=11008370&mfgId=109407&merId=109407&pguid=FVhgdAoPjF4AAHKbeeIAAAAt&destUrl=http%3A%2F%2Fwww.download.com%2F3001-2356_4-10150342.html%3Fspi%3D15642ecb0409c971c077f3b8b59b3b3b 28-03-2009 22:15:47: Cnet: Server source file: /sd/K_QYwuBiLuGNpRPRhsXZ3anOXMOSDmX5uK3YnIDR4RXxu4eCVLa41LdrTyaC8lhHIJzqF3E02zhaornMitDmJGxrw-6VhnGy/software/11011592/10150342/3/absetup.exe 28-03-2009 22:15:47: Cnet: Determined target file name: D:\Programas\Test\absetup.exe 28-03-2009 22:15:47: Cnet: Checking if update is required... 28-03-2009 22:15:47: Cnet: Update required, 'D:\Programas\Test\absetup.exe' does not yet exist 28-03-2009 22:15:52: Cnet: Replacing {version} in '{version}' with '11.7 build 23' 28-03-2009 22:15:53: Update finished Link to comment Share on other sites More sharing options...
CybTekSol Posted March 29, 2009 Report Share Posted March 29, 2009 @FranciscoR, My template still works for CNET itself, it's that they randomly change the URL for the app with a subsequent version, so any template based on a static app URL will eventually break. I've developed a prototype template based on CNET's own search engine that compensates for this and will be posting it this week as so far it is very reliable. Who knows though, their methods are so cryptic, this one will probably break eventually. I'm beginning to get frustrated trying to keep up with all the site changes that I have seen this week. Link to comment Share on other sites More sharing options...
CybTekSol Posted April 3, 2009 Report Share Posted April 3, 2009 @FranciscoR, I'm having so much trouble with Totalcmd.pl now I've disabled their app entries so they do not update when I perform a 'global' update of apps. I don't have a clue what has changed with their site... which is frustrating. Can't win 'em all. Link to comment Share on other sites More sharing options...
FranciscoR Posted April 3, 2009 Author Report Share Posted April 3, 2009 Are you using my latest Totalcmd.pl template ? I have run a FULL update right now and I've had NO errors. But this whole week I experienced several random 406 errors (like I said before)... second retry usually runs well (for me). Link to comment Share on other sites More sharing options...
CybTekSol Posted April 4, 2009 Report Share Posted April 4, 2009 Are you using my latest Totalcmd.pl template ? Yes, and for me, the only way to get them to update is to manually reload the pages for the regexs one by one, then update. How freaky is this? Link to comment Share on other sites More sharing options...
FranciscoR Posted April 4, 2009 Author Report Share Posted April 4, 2009 That's freaky allright but I'm afraid it's up to Flo now. I cannot reproduce it, today I've had 0 errors while updating and I have never experienced an issue like that with Ketarin. Nails for a Universal Template coffin... Link to comment Share on other sites More sharing options...
floele Posted April 4, 2009 Report Share Posted April 4, 2009 I'm not sure, what should I do? Link to comment Share on other sites More sharing options...
CybTekSol Posted April 5, 2009 Report Share Posted April 5, 2009 I'm not sure, what should I do? I don't have a clue what can be done yet Flo... it is still occurring in my Totalcmd.pl apps as of today. Could it be due to a prioritizing scheme they are employing which is why it is difficult for me to have any success on this side of the Atlantic? Link to comment Share on other sites More sharing options...
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now