• Announcements

necrox

Moderators
  • Content count

    230
  • Joined

  • Last visited

About necrox

Profile Information

  • Gender
    Male
  • Location
    FR, Germany
  1. Instead of specifying the complete installation path, I would use "{startuppath}log.txt" This makes it more flexible if you want to use Ketarin from a external hard disk for example.
  2. Thank you!
  3. Some background info: Two commonly used methods for request/response communication between clients and servers are GET and POST. GET requests data and POST submits data. (For a more detailed explanation: W3Schools - HTTP Methods) Regarding Onetastic: In this case, you can reach your goal in two different ways. Method 1: Add agree=1 to your download link and that's it! For the 32-bit version: https://getonetastic.com/downloadFile&fv=0&file=OnetasticInstaller.x86.zip&agree=1 For the 64-bit version: https://getonetastic.com/downloadFile&fv=0&file=OnetasticInstaller.x64.zip&agree=1 Method 2: Currently, downloading via ketarin only works via method 1, because there are probably also on this page problems with the TLS 1.2 protocol. I hope, floele can fix this issue. But it would work like this: First of all, we need to check which POST variables must be passed in order for the download to start. There are two ways to this. You can take a look at the source code of the web site or you can use web developer tools (like the Firefox Developer Tools, as described here). The first way: We need the web page to which the variable is passed and, of course, the variables. For this we look in the source code for the form with the variable to be passed. In this case, our required data is in line 37 and 38. In line 37 we have the page to which the variables are sent and in line 38 the variable itself (in this case by using checkboxes, which means checked=1 unchecked=0). They called the variable agree. So the value for the checked checkbox called 'agree' will be 1. In the next step we use this data in Ketarin. You can also use the main downloadpage https://getonetastic.com/downloadFile as download url to pass all the other variables instead. Which looks like this: But in this case there is no need to do this. This is just another variation for this website. The second way: The source code (and much more) can also be analyzed with the Firefox developer tools. We need the referer, and all the POST variables submitted. Here is a short video of how to do this for Onetastic.
  4. For each app, you can choose whether the template is submitted to the database or not. The database is a global collection of all apps that have been uploaded AND have been updated so far - if the 'shared' option was activated.
  5. You don't need the mediafire thing. Here is my last version (Updated on 10 April 2017 in the online database). If an app doesn't work anymore, it's best to have a look at the online database regularly for an updated version. <?xml version='1.0' encoding='utf-8'?> <Jobs> <ApplicationJob xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xsd="http://www.w3.org/2001/XMLSchema" Guid="7bb5b4f4-2376-4e38-b0b6-b14768e98027"> <Category>Utilities</Category> <WebsiteUrl>https://www.freefilesync.org/download.php</WebsiteUrl> <UserAgent>{mozilla}</UserAgent> <UserNotes /> <LastFileSize>12620128</LastFileSize> <LastFileDate>2017-05-26T07:52:04.7088937</LastFileDate> <IgnoreFileInformation>false</IgnoreFileInformation> <DownloadBeta>Default</DownloadBeta> <DownloadDate xsi:nil="true" /> <CheckForUpdatesOnly>false</CheckForUpdatesOnly> <VariableChangeIndicator>version</VariableChangeIndicator> <HashVariable /> <HashType>None</HashType> <CanBeShared>true</CanBeShared> <ShareApplication>true</ShareApplication> <ExclusiveDownload>false</ExclusiveDownload> <HttpReferer>{referer}</HttpReferer> <SetupInstructions /> <Variables> <item> <key> <string>appcat</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>Textual</VariableType> <Regex /> <TextualContent>{appname:regexreplace: \(.*\):}</TextualContent> <Name>appcat</Name> </UrlVariable> </value> </item> <item> <key> <string>appfile</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>Textual</VariableType> <Regex /> <TextualContent>{appname:multireplace:|:(|)| :|_|_}</TextualContent> <Name>appfile</Name> </UrlVariable> </value> </item> <item> <key> <string>version</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>RegularExpression</VariableType> <Regex>(?&lt;=Changelog.*?FreeFileSync )[0-9.]{2,}</Regex> <Url>http://freefilesync.sourceforge.net/download.php</Url> <Name>version</Name> </UrlVariable> </value> </item> <item> <key> <string>url</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>Textual</VariableType> <Regex>Problems with the download.*?href="(.+?)"</Regex> <Url>http://www.fosshub.com/FreeFileSync.html/FreeFileSync_{version}_Windows_Setup.exe</Url> <TextualContent>http://www.freefilesync.org{download}</TextualContent> <Name>url</Name> </UrlVariable> </value> </item> <item> <key> <string>download</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>RegularExpression</VariableType> <Regex>([^"]*Setup.exe)</Regex> <PostData /> <Url>http://www.freefilesync.org/download.php</Url> <Name>download</Name> </UrlVariable> </value> </item> <item> <key> <string>referer</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>Textual</VariableType> <Regex /> <TextualContent>https://www.freefilesync.org/download.php</TextualContent> <Name>referer</Name> </UrlVariable> </value> </item> </Variables> <ExecuteCommand>echo %date% - %time% // {appname} v{version} &gt;&gt; "{file:directory}"\history.txt</ExecuteCommand> <ExecutePreCommand /> <ExecuteCommandType>Batch</ExecuteCommandType> <ExecutePreCommandType>Batch</ExecutePreCommandType> <SourceType>FixedUrl</SourceType> <PreviousLocation>P:\KETARIN\Downloads\Utilities\FreeFileSync\FreeFileSync_Setup_v9.1.exe</PreviousLocation> <DeletePreviousFile>true</DeletePreviousFile> <Enabled>true</Enabled> <FileHippoId /> <LastUpdated>2017-05-26T07:52:04.7088937</LastUpdated> <TargetPath>{downloads}\{category}\{appcat}\{appfile}v{version}.{url:ext}</TargetPath> <FixedDownloadUrl>{url}</FixedDownloadUrl> <Name>FreeFileSync (Setup)</Name> </ApplicationJob> </Jobs>
  6. It all worked great, until the website switched to HTTPS.... <?xml version='1.0' encoding='utf-8'?> <Jobs> <ApplicationJob xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xsd="http://www.w3.org/2001/XMLSchema" Guid="5ac4c057-311c-4b51-8067-dd51ba993f15"> <Category>Graphic Tools</Category> <WebsiteUrl>http://www.inkscape.org/?lang=de</WebsiteUrl> <UserAgent>{mozilla}</UserAgent> <UserNotes /> <LastFileSize>75408268</LastFileSize> <LastFileDate>2017-02-16T19:12:10.03125</LastFileDate> <IgnoreFileInformation>false</IgnoreFileInformation> <DownloadBeta>Default</DownloadBeta> <DownloadDate xsi:nil="true" /> <CheckForUpdatesOnly>false</CheckForUpdatesOnly> <VariableChangeIndicator>version</VariableChangeIndicator> <HashVariable /> <HashType>None</HashType> <CanBeShared>true</CanBeShared> <ShareApplication>true</ShareApplication> <ExclusiveDownload>false</ExclusiveDownload> <HttpReferer /> <SetupInstructions /> <Variables> <item> <key> <string>appcat</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>Textual</VariableType> <Regex /> <TextualContent>{appname:regexreplace: \(.*\):}</TextualContent> <Name>appcat</Name> </UrlVariable> </value> </item> <item> <key> <string>appfile</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>Textual</VariableType> <Regex /> <TextualContent>{appname:multireplace:|:(|)| :|_|_}</TextualContent> <Name>appfile</Name> </UrlVariable> </value> </item> <item> <key> <string>version</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>RegularExpression</VariableType> <Regex>(?&lt;=Latest stable version: Inkscape )[0-9.]{2,}</Regex> <Url>https://inkscape.org/en/download/windows/</Url> <TextualContent /> <Name>version</Name> </UrlVariable> </value> </item> <item> <key> <string>url</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>Textual</VariableType> <Regex /> <Url /> <TextualContent>{download}</TextualContent> <Name>url</Name> </UrlVariable> </value> </item> <item> <key> <string>download</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>RegularExpression</VariableType> <Regex>(https[^"]*x64.msi)</Regex> <PostData>r=http%3a%2f%2fsourceforge.net%2fprojects%2finkscape%2ffiles%2flatest%2fdownload%3f_test%3dgoal</PostData> <Url>http://inkscape.org/en/download/windows/</Url> <TextualContent>{ts:urldecode:replace:7z:exe}</TextualContent> <Name>download</Name> </UrlVariable> </value> </item> </Variables> <ExecuteCommand>echo %date% - %time% // {appname} v{version} &gt;&gt; "{file:directory}"\history.txt</ExecuteCommand> <ExecutePreCommand /> <ExecuteCommandType>Batch</ExecuteCommandType> <ExecutePreCommandType>Batch</ExecutePreCommandType> <SourceType>FixedUrl</SourceType> <PreviousLocation>P:\KETARIN\Downloads\Graphic Tools\Inkscape\Inkscape_Setup_64-bit_v0.92.1.msi</PreviousLocation> <DeletePreviousFile>true</DeletePreviousFile> <Enabled>true</Enabled> <FileHippoId /> <LastUpdated>2017-02-16T19:12:10.03125</LastUpdated> <TargetPath>{downloads}\{category}\{appcat}\{appfile}v{version}.{url:ext}</TargetPath> <FixedDownloadUrl>{url}</FixedDownloadUrl> <Name>Inkscape (Setup 64-bit)</Name> </ApplicationJob> </Jobs>
  7. Inkscape and all Inkscape PlugIns for example. The download attempt terminates with the message: During the download attempt, the CPU usage increases continuously and drops immediately as soon as Ketarin jumps to the next app.
  8. What kind of details do you need? I had this problem last night while performing an update of my applications. The processor had a load of 95% over a period of about 30 seconds during the full update. After that, the processor load was normal again. I've tested it on two other computers. The problem with the high processor load also occurred on my second Windows 7 system. On my Windows 10 system everything works without problems.
  9. Wow! Thank you for all of your efforts! It looks good! I'm curious to see how the spammers behave in the future.
  10. This works for me without problems. <?xml version='1.0' encoding='utf-8'?> <Jobs> <ApplicationJob xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xsd="http://www.w3.org/2001/XMLSchema" Guid="d745e5b3-a30e-47dc-9733-bdc624921044"> <Category>Security</Category> <WebsiteUrl>https://toolslib.net/downloads/viewdownload/1-adwcleaner/</WebsiteUrl> <UserAgent>{mozilla}</UserAgent> <UserNotes /> <LastFileSize>4089296</LastFileSize> <LastFileDate>2017-03-29T14:46:02.1947732</LastFileDate> <IgnoreFileInformation>false</IgnoreFileInformation> <DownloadBeta>Default</DownloadBeta> <DownloadDate xsi:nil="true" /> <CheckForUpdatesOnly>false</CheckForUpdatesOnly> <VariableChangeIndicator>version</VariableChangeIndicator> <HashVariable /> <HashType>None</HashType> <CanBeShared>true</CanBeShared> <ShareApplication>true</ShareApplication> <ExclusiveDownload>false</ExclusiveDownload> <HttpReferer>{referer}</HttpReferer> <SetupInstructions /> <Variables> <item> <key> <string>appcat</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>Textual</VariableType> <Regex /> <TextualContent>{appname:regexreplace: \(.*\):}</TextualContent> <Name>appcat</Name> </UrlVariable> </value> </item> <item> <key> <string>appfile</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>Textual</VariableType> <Regex /> <TextualContent>{appname:multireplace:||)| :|_|_}</TextualContent> <Name>appfile</Name> </UrlVariable> </value> </item> <item> <key> <string>version</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>Textual</VariableType> <Regex /> <Url /> <TextualContent>{dirtyversion:regexreplace:\&period\;:.}</TextualContent> <Name>version</Name> </UrlVariable> </value> </item> <item> <key> <string>url</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>Textual</VariableType> <Regex /> <Url /> <TextualContent>{dirtyurl}</TextualContent> <Name>url</Name> </UrlVariable> </value> </item> <item> <key> <string>dirtyversion</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>RegularExpression</VariableType> <Regex>(?<=//////// .*?v)[0-9.&period;]{2,}</Regex> <Url>http://toolslib.net/downloads/viewdownload/1-adwcleaner/history/</Url> <Name>dirtyversion</Name> </UrlVariable> </value> </item> <item> <key> <string>dirtyurl</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>RegularExpression</VariableType> <Regex>It does not work.*?href="(.+?)"</Regex> <Url>http://toolslib.net/downloads/finish/1/</Url> <Name>dirtyurl</Name> </UrlVariable> </value> </item> <item> <key> <string>referer</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>Textual</VariableType> <Regex /> <TextualContent>http://toolslib.net/downloads/viewdownload/1-adwcleaner/</TextualContent> <Name>referer</Name> </UrlVariable> </value> </item> </Variables> <ExecuteCommand>echo %date% - %time% // {appname} v{version} >> "{file:directory}"\history.txt</ExecuteCommand> <ExecutePreCommand /> <ExecuteCommandType>Batch</ExecuteCommandType> <ExecutePreCommandType>Batch</ExecutePreCommandType> <SourceType>FixedUrl</SourceType> <PreviousLocation>P:\KETARIN\Downloads\Security\AdwCleaner\AdwCleaner_Portable_v6.045.exe</PreviousLocation> <DeletePreviousFile>true</DeletePreviousFile> <Enabled>true</Enabled> <FileHippoId /> <LastUpdated>2017-03-29T14:46:02.1947732</LastUpdated> <TargetPath>{downloads}\{category}\{appcat}\{appfile}v{version}.{url:ext}</TargetPath> <FixedDownloadUrl>{url}</FixedDownloadUrl> <Name>AdwCleaner (Portable)</Name> </ApplicationJob> </Jobs> AdwCleaner.xml
  11. I already noticed that. I have not yet figured out what the problem is. But as workaround you can use HTTP instead of HTTPS.
  12. Error 414 means your URL is too long. I think your regex match of your URL variable is wrong.
  13. IPBoard upgrade? Would it be possible to install/enable some spam protection plugins too? How to prevent spam in IPBoard Forum IPBoard Anti Spam Enhancements
  14. You're welcome! The tools I use most often from the Web Developer Tools are the console, the debugger and the network analysis tool. You don't really need a defined referrer variable as shown in the example above. I have some templates using that variable for a specific groups of apps. That's the reason there is one for FreeFileSync :-) You can also use global referrers. As an example: for downloads from Sourceforge.net I have specified the global variable {sf} with the value https://sourceforge.net.
  15. It seems that the FreeFileSync guys have changed the download behavior. You still need a referer, but as opposed to earlier, you now have to use the download page itself as a referer. So the new referer is now http://www.freefilesync.org/download.php instead of http://www.freefilesync.org/download.php?{download} The funny thing is that both work flawlessly. Nevertheless, I have edited the above post. Back to your last request: The Network Monitor from the Web Developer Tools in Mozilla Firefox are quite useful for this. Here is a short video of how to find out the referer for FreeFileSync. I hope the quality is good enough. :-) Some references: Mozilla Firefox Web Developer Tools Network Monitor Network Monitor - Network request details Common Shortcuts Developer Tools Shortcuts