Testing a new CNET Download.com Template

CybTekSol · February 23, 2010

I am testing a new version of my CNET Download.com template that uses THEIR search engine to overcome the ever-changing app page URLs with newer versions of an app hosted on CNET. If anyone is interested in helping with testing and suggestions for tweaking... post back to this thread.

Thanks,

CybTekSol

shawn · May 30, 2010

I'm interested.

CybTekSol · June 3, 2010

I use it daily now as it has proven to be reliable so far... I'll try to get it posted in the next few days for you shawn... my work load is almost unbearable at the moment which is why I have not been on the forum more often. I don't see any relief in sight which is depressing me. More hours... less rewards... poor economy... inflation... it's enough to drive me to drink but I can't afford it financially. lol

shawn · June 13, 2010

I know the feeling. I put in over 500 hours in May and am on track to do close to the same this month. It's painful. I've been using Ketarin to try to minimize the amount of manual work I have to do - but some sites (like CNET) require extra coding to keep things clean or change things often, and that's a PITA.

Contact me by email if you're looking for work.

CybTekSol · July 7, 2010

I'll still get this to you Shawn at some point... I may e-mail it to you instead of posting it until I'm completely satisfied with it.

shawn · July 8, 2010

That works for me, and I'm happy to give you constructive feedback.

shawn · July 8, 2010

I had made a template for CNET to address Connectify (nifty tool if you're looking for this kind of thing - http://www.connectify.me/), but over the last 48 hours it stopped working. REALLY hoping that your new base template addresses whatever is going on.

CybTekSol · July 8, 2010

Try this Shawn... it is based on my CNET template. Modify it for your setup...

<?xml version='1.0' encoding='utf-8'?>
<Jobs>
 <ApplicationJob xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xsd="http://www.w3.org/2001/XMLSchema" Guid="532b2dd1-6688-417b-be8f-60b9dccb6f87">
<DownloadBeta><placeholder name="Download Beta Versions?" value="Default" options="Default|Avoid|AlwaysDownload" /></DownloadBeta>
<DownloadDate xsi:nil="true" />
<CheckForUpdatesOnly><placeholder name="Check for Updates Only?" value="false" options="false|true" /></CheckForUpdatesOnly>
<VariableChangeIndicator><placeholder name="Change Indicator?" value="" options="|version|{f:yyyy}-{f:MM}-{f:dd}" /></VariableChangeIndicator>
<CanBeShared>true</CanBeShared>
<ShareApplication>false</ShareApplication>
<ExclusiveDownload><placeholder name="Exclusive Download?" value="false" options="false|true" /></ExclusiveDownload>
<HttpReferer>{redir1}</HttpReferer>
<Variables>
  <item>
	<key>
	  <string>CNetDownloadName</string>
	</key>
	<value>
	  <UrlVariable>
		<RegexRightToLeft>false</RegexRightToLeft>
		<VariableType>Textual</VariableType>
		<Regex />
		<TextualContent><placeholder name="CNet Download.com App Name from URL? [Example: Avast-Home-Edition]" /></TextualContent>
		<Name>CNetDownloadName</Name>
	  </UrlVariable>
	</value>
  </item>
  <item>
	<key>
	  <string>CNetSearchPage</string>
	</key>
	<value>
	  <UrlVariable>
		<RegexRightToLeft>false</RegexRightToLeft>
		<VariableType>RegularExpression</VariableType>
		<Regex>(?<=\<form method="get"\saction="/)(.+?)(?="\sclass="universalSearch")</Regex>
		<Url>http://download.cnet.com/</Url>
		<Name>CNetSearchPage</Name>
	  </UrlVariable>
	</value>
  </item>
  <item>
	<key>
	  <string>find</string>
	</key>
	<value>
	  <UrlVariable>
		<RegexRightToLeft>false</RegexRightToLeft>
		<VariableType>RegularExpression</VariableType>
		<Regex>(?<="resultInfo".*?href=.+?)({CNetDownloadName}/.+?\.html)(?=")</Regex>
		<Url>http://download.cnet.com/{CNetSearchPage}?query={CNetDownloadName}&tag=srch&searchtype=downloads</Url>
		<Name>find</Name>
	  </UrlVariable>
	</value>
  </item>
  <item>
	<key>
	  <string>version</string>
	</key>
	<value>
	  <UrlVariable>
		<RegexRightToLeft>false</RegexRightToLeft>
		<VariableType>RegularExpression</VariableType>
		<Regex>(?:"softwareVersion"\scontent=")(\d+[\.\d+]+?.*?)(?:")</Regex>
		<Url>http://download.cnet.com/{find}</Url>
		<Name>version</Name>
	  </UrlVariable>
	</value>
  </item>
  <item>
	<key>
	  <string>redir1</string>
	</key>
	<value>
	  <UrlVariable>
		<RegexRightToLeft>false</RegexRightToLeft>
		<VariableType>RegularExpression</VariableType>
		<Regex>(?<=class="downloadNow".*?a\shref=")http://dw.com.com.+?(?=")</Regex>
		<Url>http://download.cnet.com/{find}</Url>
		<Name>redir1</Name>
	  </UrlVariable>
	</value>
  </item>
  <item>
	<key>
	  <string>download_url</string>
	</key>
	<value>
	  <UrlVariable>
		<RegexRightToLeft>false</RegexRightToLeft>
		<VariableType>RegularExpression</VariableType>
		<Regex>(?<=META\sHTTP-EQUIV="Refresh"\sCONTENT="\d;\sURL=)[a-z]+://.+?(?="/>)</Regex>
		<Url>{redir1}</Url>
		<Name>download_url</Name>
	  </UrlVariable>
	</value>
  </item>
</Variables>
<ExecuteCommand><placeholder name="Execute Command AFTER Downloading?" value="" options="copy /y "{file}" "{archive_folder}\{category}"|copy /y "{file}" "{install_cache_folder}"&|copy /y "{file}" "{shared}\{category}"&|copy /y "{file}" "{install_cache_folder}" & copy /y "{file}" "{secunia_suggested}"&|{run_7-zip} x "{file}" -r -aoa -o"{install_cache_folder}{appname:replace: :_}_v{version}"&|{run_ue} "{file}" "{install_cache_folder}{appname:replace: :_}_v{version}"&|{run_7-zip} x "{file}" -r -aoa -o"{nirsoft_utilities_root_folder}{appname:replace: :_}"&|{run_7-zip} x "{file}" -r -aoa -o{sysinternals_suite_root_folder}&|" /></ExecuteCommand>
<ExecutePreCommand><placeholder name="Execute Command BEFORE Downloading?" value="copy /y "{file}" "{archive_folder}\{category}"" options="copy /y "{file}" "{archive_folder}\{category}"|move /y "{target}\{category}\{appname:replace: :_}*.*" "{archive_folder}\{category}"|move /y "{target}\{category}\{appname:replace: :_}*.*" "{archive_folder}\{category}"|del /q "{target}\{category}\{appname:replace: :_}*.*"|del /q "{target}\{category}\{appname:replace: :_}*.*"|" /></ExecutePreCommand>
<Category><placeholder name="Category?" value="New" options="Antivirus|CD-DVD|Data|Distros|Drivers|Education|Engineering|Finance|Games|Internet|Media|Miscellaneous|New|Office|Personal Productivity|Programming|Security|Test|Text|Utilities" /></Category>
<SourceType>FixedUrl</SourceType>
<PreviousLocation />
<DeletePreviousFile><placeholder name="Delete Previous Version?" value="true" options="true|false" /></DeletePreviousFile>
<Enabled>true</Enabled>
<FileHippoId />
<LastUpdated xsi:nil="true" />
<TargetPath><placeholder name="Save to Location?" value="{target}\{category}\" options="{target}\{category}\|{target}\|{startuppath}\{category\|{startuppath}\|" /><placeholder name="Rename Rule Convention?" value="{appname:replace: :_}_v{version:replace: :_}.{url:ext}" options="{appname:replace: :_}_v{version:replace: :_}.{url:ext}|{appname:replace: :_}_install_v{version:replace: :_}.{url:ext}|{appname:replace: :_}_installer_v{version:replace: :_}.{url:ext}|{appname:replace: :_}_setup_v{version:replace: :_}.{url:ext}|{url:basefile}_v{version:replace: :_}.{url:ext}" /></TargetPath>
<FixedDownloadUrl>{download_url}</FixedDownloadUrl>
<Name><placeholder name="Application Name?" value="New CNet App Download" /></Name>
 </ApplicationJob>
</Jobs>

Enjoy!!

Edited October 13, 2011 by CybTekSol

mkoepke · July 24, 2010

I used the cnet template above, but found a case where it is breaking trying to resolve CNETSearchPage.

http://download.cnet.com/System-Nucleus-Portable-x32/3000-2094_4-75218308.html?tag=mncol

CybTekSol · July 25, 2010

This is due to a typo on CNet's behalf... try the modified version of the template above to compensate for it.

shawn · July 30, 2010

It's working great - thank you!

mkoepke · September 12, 2010

Trying to download the latest System Explorer (System-Explorer) from CNet using the template above gives the following error. The template worked prior to the latest version. It looks like it is having problems with the regex parsing for the download_url variable.

Here is the error output.

System Explorer Invalid URI: The URI scheme is not valid. (<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd">

<html>

<head>

<!--[if IE 7]>

<![endif]-->

<title>Thank you for downloading System Explorer 2.3.5</title>

</head>

<div style='font-size: 14px; font-weight: bold; margin-top: 12px;'>You are using an outdated browser</div>

<div style='font-size: 12px; margin-top: 6px; line-height: 12px;'>For a better experience using this site, please upgrade to a modern web browser.</div>

</div>

</div>

<![endif]-->

<ul>

<li><a id="mi_3" href="/download.php">Download</a></li>

<li><a id="mi_4" href="/reviews.php">Awards</a></li>

<li><a id="mi_8" href="/forum" target="_blank">Forum</a></li>

<li><a id="mi_7" href="/support/index.php">Support</a></li>

<li><a id="mi_2" style="margin-left:50px" href="/filedb.php">File Database</a></li>

</ul>

el=document.getElementById("mi_-1");

if (el)

el.className="miactive";

</script>

</div>

</div>

var r=Math.ceil(3*Math.random())

if (r==2)

{

document.write('<a href="http://www.kqzyfj.com/click-3806651-10542744" onclick="if (pageTracker) pageTracker._trackEvent(\'UPAD\', \'PCTOOLS-1\');" target="_blank"><img src="http://www.tqlkg.com/image-3806651-10542744" width="468" height="60" alt="Registry Mechanic Free Scan" border="0"/></a>');

} else

if (r==1)

{

document.write('<a href="http://www.dpbolvw.net/click-3806651-10545512" onclick="if (pageTracker) pageTracker._trackEvent(\'UPAD\', \'PCTOOLS-2\');" target="_blank"><img src="http://www.awltovhc.com/image-3806651-10545512" width="468" height="60" alt="http://www.pctools.com/desktop-maestro/" border="0"/></a>');

} else

{

document.write('<a href="http://www.tkqlhce.com/click-3806651-10542743" onclick="if (pageTracker) pageTracker._trackEvent(\'UPAD\', \'PCTOOLS-3\');" target="_blank"><img src="http://www.awltovhc.com/image-3806651-10542743" width="468" height="60" alt="" border="0"/></a>');

}

</script>

<!-- <iframe src="http://appsmarks.com/newsad.php" width="728" height="90" scrolling="no" frameborder="0">

</iframe>

-->

</div>

<h1 style="margin-top:0px;margin-bottom:5px;">Thank you for downloading System Explorer 2.3.5</h1>

System Explorer is <span class="mp_descb">free</span>, awards winning software for exploration and

management of System Internals. This small software includes many usefull

tools which help you <span class="mp_descb">Keep Your System Under Control</span>. With System Explorer You

get also fast access to <span class="mp_descb">File Database</span> which help you to determine unwanted processes or <span class="mp_descr">threats</span>.

System Explorer is translated into <span class="mp_descb">21 languages</span> and is available for download in <span class="mp_descb">installer</span> and <span class="mp_descb">portable</span> version.

</p>

<table>

<tr>

<td>

google_ad_client = "pub-2292771559706071";

/* System Explorer Downloading (300x250) */

google_ad_slot = "2735819118";

google_ad_width = 300;

google_ad_height = 250;

//-->

</script>

src="http://pagead2.googlesyndication.com/pagead/show_ads.js">

</script>

</td>

<h4 style="margin-bottom:0px;font-size:13px;margin-top:0px;">Our Tip For Hardware Exploration</h4>

</td>

<td>

google_ad_client = "pub-2292771559706071";

/* System Explorer Downloading (300x250) */

google_ad_slot = "2735819118";

google_ad_width = 300;

google_ad_height = 250;

//-->

</script>

src="http://pagead2.googlesyndication.com/pagead/show_ads.js">

</script>

</td>

</tr>

</table>

Your download will begin in a moment. If it doesn't, <a href="/download/1284306978-2c4943e2a994accba0aa2f8223658320/SystemExplorerSetup_235.exe">click here</a> to try again.<br>

Still having trouble? Contact us via Support section.

</div>

google_ad_client = "pub-2292771559706071";

/* 728x90, downloading */

google_ad_slot = "6951772048";

google_ad_width = 728;

google_ad_height = 90;

//-->

</script>

src="http://pagead2.googlesyndication.com/pagead/show_ads.js">

</script>

</div>

setTimeout(

function()

{

window.location.href = '/download/1284306978-2c4943e2a994accba0aa2f8223658320/SystemExplorerSetup_235.exe';

}, 3000);

</script>

<a href="http://www.appsmarks.com" target="_blank">AppsMarks</a>

<a href="/referers.php" target="_blank">Referers</a>

</span>

</script>

</span>

</a>

</div>

var gaJsHost = (("https:" == document.location.protocol) ? "https://ssl." : "http://www.");

document.write(unescape("%3Cscript src='" + gaJsHost + "google-analytics.com/ga.js' type='text/javascript'%3E%3C/script%3E"));

</script>

var pageTracker = _gat._getTracker("UA-5036703-2");

pageTracker._initData();

pageTracker._trackPageview();

</script>

google_ad_client = "pub-2292771559706071";

/* 160x600, vytvoÅ™eno 6.7.10 */

google_ad_slot = "7730991279";

google_ad_width = 160;

google_ad_height = 600;

//-->

</script>

src="http://pagead2.googlesyndication.com/pagead/show_ads.js">

</script>

</div>

google_ad_client = "pub-2292771559706071";

/* SideAds Right (160x600) */

google_ad_slot = "5473050114";

google_ad_width = 160;

google_ad_height = 600;

//-->

</script>

src="http://pagead2.googlesyndication.com/pagead/show_ads.js">

</script>

</div>

<!--

<ascript type="text/javascript">WAU_map('ej2hfxnxzj34', 214, 107, 'night', 'default-blue')</script>

</div>

-->

</body>

</html>)

CybTekSol · September 13, 2010

It should work now mkoepke... I edited the template above.

jadog · January 5, 2011

@CybTekSol

Just tried using this template and it failed. Tried it again using the default imported app (Connectify) and it still failed. Giving me the following error: "Invalid URI: The URI is empty."

Any thoughts?

CybTekSol · January 5, 2011

Try the above modification of the template to see if it works for you jadog.

jadog · January 5, 2011

Ok, it's working again. Thanks! However, for some odd reason, after changing the name of the app in the variables, it showed right away that it was up to date. But the directory it's pointing to is empty?!?!? So I tried it with some other apps on Download.com and those showed that they should be updated. The name of the app is Bit-Che.

Tomorrow · January 6, 2011

I would prefer apps own homepage as these download mirrors are not very fast in my eyes(meaning they lag when it comes to updating apps to latest version after app has been updated by maker).This goes for download.com,softpedia,brothersoft,betanews etc...

CybTekSol · January 6, 2011

I agree Tomorrow... I maintain other functional download site templates for those cases where the author cannot afford the bandwidth required to host their own apps... about 20+ of my 1300+ apps if my memory serves me correctly. Of all my download site templates, my Snapfiles template is my favorite as it is the fastest and most reliable. Other than Snapfiles, virtually all of my newly added apps are from the app's homepage if possible using one of my generic templates.

Tomorrow · March 8, 2011

WinRAR is now only on CNet

CybTekSol's template is unable to get correct version number but i managed to get it working.For 64bit winrar you have to enter

WinRAR-64-bit

in CNetDownloadName variable.For regular 32bit simple WinRAR will do.

Maybe time to update template.And please can you make it faster?.The current one is like a snail crawling on a wet wood (nearly 20 seconds to check)

necrox · March 9, 2011

WinRAR is now only on CNet

Sure? -> http://www.rarlab.com/download.htm

Tomorrow · March 9, 2011

WinRAR is now only on CNet

Sure? -> http://www.rarlab.com/download.htm

Lol they added direct download too now.It was not there yesterday .Anyway good.I was afraid one of my favorite tools was going to be hosted on CNet only.

CybTekSol · March 12, 2011

I changed the version regex in the CNet template above... works for most of my 34 apps from there. As far as speeding it up... I don't really have the time to tackle it right now. A portion of the lag is because it is necessary to use their search engine to capture the url of the latest version as it changes each time. Other users... feel free to tweak it and post an improved version.

UksusoFF · May 26, 2011

---------------------------

Ketarin

---------------------------

Failed to import the file: Начальный тег "Regex" в строке 68 не соответствует конечному тегу "b". Строка 68, позиция 33.

---------------------------

ОК

---------------------------

What's wrong? I use this template

shawn · May 26, 2011

Sounds like it was copied wrong. Make sure you're copying the one up in the white code block, as anything pasted into the forum outside of one of those blocks loses any embedded HTML, which is often required when parsing content.

UksusoFF · May 27, 2011

Sounds like it was copied wrong. Make sure you're copying the one up in the white code block, as anything pasted into the forum outside of one of those blocks loses any embedded HTML, which is often required when parsing content.

I try copy again, but the same result

Sign In

Testing a new CNET Download.com Template

Recommended Posts

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Create an account or sign in to comment

Create an account

Sign in

Important Information