Jump to content
Ketarin forum

necrox

Moderators
  • Posts

    265
  • Joined

  • Last visited

Everything posted by necrox

  1. I encountered this problem early this morning and had to check and modify some entries in my database. Thank you for the clarification here in the forum. By the way, the AddOn pages have also changed. So I had to adapt all my AddOn templates.
  2. There is an option to set the number of parallel downloads and the timeout time. Open your settings by pressing CTRL+T, switch to Connection and modify the connection timeout delay and the max. number of parallel downloads according to your wishes.
  3. Aloha! Would it be possible to post the contents of the log file? Is $ Remote Tools an existing directory? Add a backslash \ to the end of your folder names and try it again. COPY /V /Y "D:\Haole Boy\$USB files and folders\$ Tools\Process Explorer\procexp64.exe" "D:\Haole Boy\$USB files and folders\$ Tools\$ Remote Tools\" COPY /V /Y "D:\Haole Boy\$USB files and folders\$ Tools\Process Explorer\procexpl.reg" "D:\Haole Boy\$USB files and folders\$ Tools\" COPY /V /Y "D:\Haole Boy\$USB files and folders\$ Tools\Process Explorer\procexp64.exe" "C:\Tools\" If the file path never changes and to keep the script area clean, you can use global variables. If you do not always want to write D:\Haole Boy\$USB files and folders\, you can shorten it to something like {haoleboy}. Open your settings (CTRL + T), switch to Global variables, create a variable called haoleboy, for example. Add D:\Haole Boy\$USB files and folders as value. If you want to use a script the next time, you can shorten it. COPY /V /Y "{haoleboy}\$ Tools\Process Explorer\procexp64.exe" "{haoleboy}\$ Tools\$ Remote Tools\" COPY /V /Y "{haoleboy}\$ Tools\Process Explorer\procexpl.reg" "{haoleboy}\$ Tools\" COPY /V /Y "{haoleboy}\$ Tools\Process Explorer\procexp64.exe" "C:\Tools\" Same for 7zip. Create a variable called 7z for example and set the value to C:\Program Files\7-Zip\7z.exe If you want to use 7zip the next time, then you can do it like this: "{7z}" x "{file}" -o"{file:directory}" -y
  4. It looks like this is a server-side limitation. I have the same problem with your imported XML. As soon as the downloads from this server are limited to a single download (see picture) everything works without problems.
  5. The first command opens Ketarin, performs a database export as XML and closes Ketarin. The second command starts Ketarin with the specified database. Regarding your problem. Where is your database file located? Is your database in the same folder as the EXE? Does another database exist in %AppData%?
  6. This one of my old scripts but still working. Try this: @ECHO OFF cd /d %~dp0 SET CURHOUR=%CURHOUR: =0% set year=%date:~6,4% set yr=%date:~8,2% set month=%date:~3,2% set day=%date:~0,2% set hour=%time:~0,2% set hour=%hour: =0% set min=%time:~3,2% set sec=%time:~6,2% ECHO . ECHO STARTING KETARIN... START ketarin.exe /database=home_apps.db /export=home_apps-%year%-%month%-%day%_%hour%%min%%sec%.xml PING -n 5 localhost > NUL START ketarin.exe /database=home_apps.db /log=log-%year%-%month%-%day%_%hour%%min%%sec%.log PING -n 5 localhost > NUL REN home_apps.db_*.bak home_apps.db_%year%-%month%-%day%_%hour%%min%%sec%.bak EXIT
  7. Does my script work? You have exported the app from Ketarin as XML and copied the content here into the forum, right? Or have you tried to edit your XML file externally and re-import it to Ketarin? I guess that the standard encoding was not set correctly. Would it be possible to add your exported XML file as attachment?
  8. I have tried to import your XML file, but this didn't work. Is this the exported XML file or did you edit it in an editor before? I've solved the problem by removing some mispelled characters. Here is the newly created (now working) file. <?xml version='1.0' encoding='utf-8'?> <Jobs> <ApplicationJob xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xsd="http://www.w3.org/2001/XMLSchema" Guid="0cd003ed-a552-432e-9adb-a31fb34a98ef"> <Category>TotalCommander</Category> <WebsiteUrl /> <UserAgent /> <UserNotes /> <LastFileSize>52931944</LastFileSize> <LastFileDate>2017-07-01T11:14:04.9876837</LastFileDate> <IgnoreFileInformation>true</IgnoreFileInformation> <DownloadBeta>Default</DownloadBeta> <DownloadDate>2016-11-19T15:38:23</DownloadDate> <CheckForUpdatesOnly>false</CheckForUpdatesOnly> <VariableChangeIndicator>version</VariableChangeIndicator> <HashVariable /> <HashType>None</HashType> <CanBeShared>true</CanBeShared> <ShareApplication>false</ShareApplication> <ExclusiveDownload>false</ExclusiveDownload> <HttpReferer /> <SetupInstructions /> <Variables> <item> <key> <string>version</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>RegularExpression</VariableType> <Regex>(?&lt;=Latest version: )[0-9.]{2,}</Regex> <Url>https://www.den4b.com/products/renamer</Url> <Name>version</Name> </UrlVariable> </value> </item> <item> <key> <string>url</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>Textual</VariableType> <Regex /> <Url /> <TextualContent>https://www.den4b.com{download}</TextualContent> <Name>url</Name> </UrlVariable> </value> </item> <item> <key> <string>download</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>RegularExpression</VariableType> <Regex>(/download/renamer/portable?[^"]*)</Regex> <Url>https://www.den4b.com/download/renamer/portable</Url> <TextualContent /> <Name>download</Name> </UrlVariable> </value> </item> </Variables> <ExecuteCommand /> <ExecutePreCommand /> <ExecuteCommandType>Batch</ExecuteCommandType> <ExecutePreCommandType>Batch</ExecutePreCommandType> <SourceType>FixedUrl</SourceType> <PreviousLocation /> <DeletePreviousFile>true</DeletePreviousFile> <Enabled>true</Enabled> <FileHippoId /> <LastUpdated>2017-07-01T11:14:04.9876837</LastUpdated> <TargetPath>{dir}\{category}\</TargetPath> <FixedDownloadUrl>{url}</FixedDownloadUrl> <Name>ReNamer</Name> </ApplicationJob> </Jobs>
  9. I think this thread may help: https://ketarin.org/forum/topic/3955-update-install-doesnt-recognize-check-for-updates-only-was-run-without-actual-download/
  10. Thank you for the fix! It all works as desired!
  11. Instead of specifying the complete installation path, I would use "{startuppath}log.txt" This makes it more flexible if you want to use Ketarin from a external hard disk for example.
  12. Some background info: Two commonly used methods for request/response communication between clients and servers are GET and POST. GET requests data and POST submits data. (For a more detailed explanation: W3Schools - HTTP Methods) Regarding Onetastic: In this case, you can reach your goal in two different ways. Method 1: Add &agree=1 to your download link and that's it! For the 32-bit version: https://getonetastic.com/downloadFile&fv=0&file=OnetasticInstaller.x86.zip&agree=1 For the 64-bit version: https://getonetastic.com/downloadFile&fv=0&file=OnetasticInstaller.x64.zip&agree=1 Method 2: Currently, downloading via ketarin only works via method 1, because there are probably also on this page problems with the TLS 1.2 protocol. I hope, floele can fix this issue. But it would work like this: First of all, we need to check which POST variables must be passed in order for the download to start. There are two ways to this. You can take a look at the source code of the web site or you can use web developer tools (like the Firefox Developer Tools, as described here). The first way: We need the web page to which the variable is passed and, of course, the variables. For this we look in the source code for the form with the variable to be passed. In this case, our required data is in line 37 and 38. In line 37 we have the page to which the variables are sent and in line 38 the variable itself (in this case by using checkboxes, which means checked=1 unchecked=0). They called the variable agree. So the value for the checked checkbox called 'agree' will be 1. In the next step we use this data in Ketarin. You can also use the main downloadpage https://getonetastic.com/downloadFile as download url to pass all the other variables instead. Which looks like this: But in this case there is no need to do this. This is just another variation for this website. The second way: The source code (and much more) can also be analyzed with the Firefox developer tools. We need the referer, and all the POST variables submitted. Here is a short video of how to do this for Onetastic.
  13. For each app, you can choose whether the template is submitted to the database or not. The database is a global collection of all apps that have been uploaded AND have been updated so far - if the 'shared' option was activated.
  14. You don't need the mediafire thing. Here is my last version (Updated on 10 April 2017 in the online database). If an app doesn't work anymore, it's best to have a look at the online database regularly for an updated version. <?xml version='1.0' encoding='utf-8'?> <Jobs> <ApplicationJob xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xsd="http://www.w3.org/2001/XMLSchema" Guid="7bb5b4f4-2376-4e38-b0b6-b14768e98027"> <Category>Utilities</Category> <WebsiteUrl>https://www.freefilesync.org/download.php</WebsiteUrl> <UserAgent>{mozilla}</UserAgent> <UserNotes /> <LastFileSize>12620128</LastFileSize> <LastFileDate>2017-05-26T07:52:04.7088937</LastFileDate> <IgnoreFileInformation>false</IgnoreFileInformation> <DownloadBeta>Default</DownloadBeta> <DownloadDate xsi:nil="true" /> <CheckForUpdatesOnly>false</CheckForUpdatesOnly> <VariableChangeIndicator>version</VariableChangeIndicator> <HashVariable /> <HashType>None</HashType> <CanBeShared>true</CanBeShared> <ShareApplication>true</ShareApplication> <ExclusiveDownload>false</ExclusiveDownload> <HttpReferer>{referer}</HttpReferer> <SetupInstructions /> <Variables> <item> <key> <string>appcat</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>Textual</VariableType> <Regex /> <TextualContent>{appname:regexreplace: \(.*\):}</TextualContent> <Name>appcat</Name> </UrlVariable> </value> </item> <item> <key> <string>appfile</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>Textual</VariableType> <Regex /> <TextualContent>{appname:multireplace:|:(|)| :|_|_}</TextualContent> <Name>appfile</Name> </UrlVariable> </value> </item> <item> <key> <string>version</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>RegularExpression</VariableType> <Regex>(?&lt;=Changelog.*?FreeFileSync )[0-9.]{2,}</Regex> <Url>http://freefilesync.sourceforge.net/download.php</Url> <Name>version</Name> </UrlVariable> </value> </item> <item> <key> <string>url</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>Textual</VariableType> <Regex>Problems with the download.*?href="(.+?)"</Regex> <Url>http://www.fosshub.com/FreeFileSync.html/FreeFileSync_{version}_Windows_Setup.exe</Url> <TextualContent>http://www.freefilesync.org{download}</TextualContent> <Name>url</Name> </UrlVariable> </value> </item> <item> <key> <string>download</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>RegularExpression</VariableType> <Regex>([^"]*Setup.exe)</Regex> <PostData /> <Url>http://www.freefilesync.org/download.php</Url> <Name>download</Name> </UrlVariable> </value> </item> <item> <key> <string>referer</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>Textual</VariableType> <Regex /> <TextualContent>https://www.freefilesync.org/download.php</TextualContent> <Name>referer</Name> </UrlVariable> </value> </item> </Variables> <ExecuteCommand>echo %date% - %time% // {appname} v{version} &gt;&gt; "{file:directory}"\history.txt</ExecuteCommand> <ExecutePreCommand /> <ExecuteCommandType>Batch</ExecuteCommandType> <ExecutePreCommandType>Batch</ExecutePreCommandType> <SourceType>FixedUrl</SourceType> <PreviousLocation>P:\KETARIN\Downloads\Utilities\FreeFileSync\FreeFileSync_Setup_v9.1.exe</PreviousLocation> <DeletePreviousFile>true</DeletePreviousFile> <Enabled>true</Enabled> <FileHippoId /> <LastUpdated>2017-05-26T07:52:04.7088937</LastUpdated> <TargetPath>{downloads}\{category}\{appcat}\{appfile}v{version}.{url:ext}</TargetPath> <FixedDownloadUrl>{url}</FixedDownloadUrl> <Name>FreeFileSync (Setup)</Name> </ApplicationJob> </Jobs>
  15. It all worked great, until the website switched to HTTPS.... <?xml version='1.0' encoding='utf-8'?> <Jobs> <ApplicationJob xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xsd="http://www.w3.org/2001/XMLSchema" Guid="5ac4c057-311c-4b51-8067-dd51ba993f15"> <Category>Graphic Tools</Category> <WebsiteUrl>http://www.inkscape.org/?lang=de</WebsiteUrl> <UserAgent>{mozilla}</UserAgent> <UserNotes /> <LastFileSize>75408268</LastFileSize> <LastFileDate>2017-02-16T19:12:10.03125</LastFileDate> <IgnoreFileInformation>false</IgnoreFileInformation> <DownloadBeta>Default</DownloadBeta> <DownloadDate xsi:nil="true" /> <CheckForUpdatesOnly>false</CheckForUpdatesOnly> <VariableChangeIndicator>version</VariableChangeIndicator> <HashVariable /> <HashType>None</HashType> <CanBeShared>true</CanBeShared> <ShareApplication>true</ShareApplication> <ExclusiveDownload>false</ExclusiveDownload> <HttpReferer /> <SetupInstructions /> <Variables> <item> <key> <string>appcat</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>Textual</VariableType> <Regex /> <TextualContent>{appname:regexreplace: \(.*\):}</TextualContent> <Name>appcat</Name> </UrlVariable> </value> </item> <item> <key> <string>appfile</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>Textual</VariableType> <Regex /> <TextualContent>{appname:multireplace:|:(|)| :|_|_}</TextualContent> <Name>appfile</Name> </UrlVariable> </value> </item> <item> <key> <string>version</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>RegularExpression</VariableType> <Regex>(?&lt;=Latest stable version: Inkscape )[0-9.]{2,}</Regex> <Url>https://inkscape.org/en/download/windows/</Url> <TextualContent /> <Name>version</Name> </UrlVariable> </value> </item> <item> <key> <string>url</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>Textual</VariableType> <Regex /> <Url /> <TextualContent>{download}</TextualContent> <Name>url</Name> </UrlVariable> </value> </item> <item> <key> <string>download</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>RegularExpression</VariableType> <Regex>(https[^"]*x64.msi)</Regex> <PostData>r=http%3a%2f%2fsourceforge.net%2fprojects%2finkscape%2ffiles%2flatest%2fdownload%3f_test%3dgoal</PostData> <Url>http://inkscape.org/en/download/windows/</Url> <TextualContent>{ts:urldecode:replace:7z:exe}</TextualContent> <Name>download</Name> </UrlVariable> </value> </item> </Variables> <ExecuteCommand>echo %date% - %time% // {appname} v{version} &gt;&gt; "{file:directory}"\history.txt</ExecuteCommand> <ExecutePreCommand /> <ExecuteCommandType>Batch</ExecuteCommandType> <ExecutePreCommandType>Batch</ExecutePreCommandType> <SourceType>FixedUrl</SourceType> <PreviousLocation>P:\KETARIN\Downloads\Graphic Tools\Inkscape\Inkscape_Setup_64-bit_v0.92.1.msi</PreviousLocation> <DeletePreviousFile>true</DeletePreviousFile> <Enabled>true</Enabled> <FileHippoId /> <LastUpdated>2017-02-16T19:12:10.03125</LastUpdated> <TargetPath>{downloads}\{category}\{appcat}\{appfile}v{version}.{url:ext}</TargetPath> <FixedDownloadUrl>{url}</FixedDownloadUrl> <Name>Inkscape (Setup 64-bit)</Name> </ApplicationJob> </Jobs>
  16. Inkscape and all Inkscape PlugIns for example. The download attempt terminates with the message: During the download attempt, the CPU usage increases continuously and drops immediately as soon as Ketarin jumps to the next app.
  17. What kind of details do you need? I had this problem last night while performing an update of my applications. The processor had a load of 95% over a period of about 30 seconds during the full update. After that, the processor load was normal again. I've tested it on two other computers. The problem with the high processor load also occurred on my second Windows 7 system. On my Windows 10 system everything works without problems.
  18. Wow! Thank you for all of your efforts! It looks good! I'm curious to see how the spammers behave in the future.
  19. This works for me without problems. <?xml version='1.0' encoding='utf-8'?> <Jobs> <ApplicationJob xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xsd="http://www.w3.org/2001/XMLSchema" Guid="d745e5b3-a30e-47dc-9733-bdc624921044"> <Category>Security</Category> <WebsiteUrl>https://toolslib.net/downloads/viewdownload/1-adwcleaner/</WebsiteUrl> <UserAgent>{mozilla}</UserAgent> <UserNotes /> <LastFileSize>4089296</LastFileSize> <LastFileDate>2017-03-29T14:46:02.1947732</LastFileDate> <IgnoreFileInformation>false</IgnoreFileInformation> <DownloadBeta>Default</DownloadBeta> <DownloadDate xsi:nil="true" /> <CheckForUpdatesOnly>false</CheckForUpdatesOnly> <VariableChangeIndicator>version</VariableChangeIndicator> <HashVariable /> <HashType>None</HashType> <CanBeShared>true</CanBeShared> <ShareApplication>true</ShareApplication> <ExclusiveDownload>false</ExclusiveDownload> <HttpReferer>{referer}</HttpReferer> <SetupInstructions /> <Variables> <item> <key> <string>appcat</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>Textual</VariableType> <Regex /> <TextualContent>{appname:regexreplace: \(.*\):}</TextualContent> <Name>appcat</Name> </UrlVariable> </value> </item> <item> <key> <string>appfile</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>Textual</VariableType> <Regex /> <TextualContent>{appname:multireplace:||)| :|_|_}</TextualContent> <Name>appfile</Name> </UrlVariable> </value> </item> <item> <key> <string>version</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>Textual</VariableType> <Regex /> <Url /> <TextualContent>{dirtyversion:regexreplace:\&period\;:.}</TextualContent> <Name>version</Name> </UrlVariable> </value> </item> <item> <key> <string>url</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>Textual</VariableType> <Regex /> <Url /> <TextualContent>{dirtyurl}</TextualContent> <Name>url</Name> </UrlVariable> </value> </item> <item> <key> <string>dirtyversion</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>RegularExpression</VariableType> <Regex>(?<=//////// .*?v)[0-9.&period;]{2,}</Regex> <Url>http://toolslib.net/downloads/viewdownload/1-adwcleaner/history/</Url> <Name>dirtyversion</Name> </UrlVariable> </value> </item> <item> <key> <string>dirtyurl</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>RegularExpression</VariableType> <Regex>It does not work.*?href="(.+?)"</Regex> <Url>http://toolslib.net/downloads/finish/1/</Url> <Name>dirtyurl</Name> </UrlVariable> </value> </item> <item> <key> <string>referer</string> </key> <value> <UrlVariable> <RegexRightToLeft>false</RegexRightToLeft> <VariableType>Textual</VariableType> <Regex /> <TextualContent>http://toolslib.net/downloads/viewdownload/1-adwcleaner/</TextualContent> <Name>referer</Name> </UrlVariable> </value> </item> </Variables> <ExecuteCommand>echo %date% - %time% // {appname} v{version} >> "{file:directory}"\history.txt</ExecuteCommand> <ExecutePreCommand /> <ExecuteCommandType>Batch</ExecuteCommandType> <ExecutePreCommandType>Batch</ExecutePreCommandType> <SourceType>FixedUrl</SourceType> <PreviousLocation>P:\KETARIN\Downloads\Security\AdwCleaner\AdwCleaner_Portable_v6.045.exe</PreviousLocation> <DeletePreviousFile>true</DeletePreviousFile> <Enabled>true</Enabled> <FileHippoId /> <LastUpdated>2017-03-29T14:46:02.1947732</LastUpdated> <TargetPath>{downloads}\{category}\{appcat}\{appfile}v{version}.{url:ext}</TargetPath> <FixedDownloadUrl>{url}</FixedDownloadUrl> <Name>AdwCleaner (Portable)</Name> </ApplicationJob> </Jobs> AdwCleaner.xml
  20. I already noticed that. I have not yet figured out what the problem is. But as workaround you can use HTTP instead of HTTPS.
  21. Error 414 means your URL is too long. I think your regex match of your URL variable is wrong.
  22. IPBoard upgrade? Would it be possible to install/enable some spam protection plugins too? How to prevent spam in IPBoard Forum IPBoard Anti Spam Enhancements
  23. You're welcome! The tools I use most often from the Web Developer Tools are the console, the debugger and the network analysis tool. You don't really need a defined referrer variable as shown in the example above. I have some templates using that variable for a specific groups of apps. That's the reason there is one for FreeFileSync :-) You can also use global referrers. As an example: for downloads from Sourceforge.net I have specified the global variable {sf} with the value https://sourceforge.net.
  24. It seems that the FreeFileSync guys have changed the download behavior. You still need a referer, but as opposed to earlier, you now have to use the download page itself as a referer. So the new referer is now http://www.freefilesync.org/download.php instead of http://www.freefilesync.org/download.php?{download} The funny thing is that both work flawlessly. Nevertheless, I have edited the above post. Back to your last request: The Network Monitor from the Web Developer Tools in Mozilla Firefox are quite useful for this. Here is a short video of how to find out the referer for FreeFileSync. I hope the quality is good enough. :-) Some references: Mozilla Firefox Web Developer Tools Network Monitor Network Monitor - Network request details Common Shortcuts Developer Tools Shortcuts
×
×
  • Create New...

Important Information

We have placed cookies on your device to help make this website better. You can adjust your cookie settings, otherwise we'll assume you're okay to continue.