Leeghoofd 2418 Posted July 3, 2019 This will be the Official Support thread for Matt's BenchMate benchmark tool. This software will verify the Windows timer issue (known as the RTC bug) some users could run into when running older Intel or any AMD processor on Windows 8/10. Also it will check the security of the benchmark. Click the below link to see a quick grasp of BenchMate works: https://drive.google.com/file/d/1fJFi6MFmGtb46k_nHPiAiMdIor32WLu2/view Grab the benchMate tool here When you encounter a problem with the BenchMate sofware ( current version 10.05 ) plz leave a detailed description of your issue(s). !!!Geekbench 3 and 4 support have been dropped since version 0.9.3 so plz no longer report this!!! Donations This software will always be free for the benchmarking community around the globe. Therefore we rely on crowdfunding to be able to pay for ongoing certificate and licensing costs and to allow us to dedicate more time to bugfixes and development of brand-new features. With your help we can define a Future proof verification of benchmarking: PayPal Uploading scores by using the screenshot made by Benchmate If reporting something always include: motherboard & CPU used Operating System used ( 32/64bit, exact OS version, stripped or not) Drivers installed for chipset What you tried to solve the problem Uploading scores via Validation File is not yet implemented by HWBOT! You can up the scores in the old fashioned way by using the screenshot made by BenchMate application ( find it in the result folder) Benchmate Change Logs: Benchmate 0.10.5 Small bugfix release. Enhanced QPC skew warning dialog when the QPC Test detects skewed results. It will only appear if there is a possibility that QPC is used for the benchmark run and show customized solutions to circumvent this issue. Fixed a bug in CPUID detection and brand string parsing for engineering sample CPUs 19.12.2019 Benchmate 0.10.4 Minor improvements and bugfixes. Redefined workload for 7-Zip. Improvements Redefined the workload for 7-Zip so it's more compatible with older platforms due to memory limitations. It should also be more fun now, because you can tighten the memory accordingly. Minimum memory requirement depends on the number of cores though. Single-Core needs 111 MB, a 9900K with 16 threads about 1 GB, a run with 128 threads would need 7.5 GB. To improve score stability the benchmark is now configured to run six iterations, each with two dictionary sizes (2^22 and 2^23). Improved performance and memory management of the CLI wrapper Optimizations for the result dialog Removed the column titles from the result data list control, so the dialog can be smaller in height. Undo user row selections in the result data list to avoid selections inside the screenshot (the result dialog should always look the same for best recognition). Added a row with BenchMate's client and driver version, that the result was done with. Added "Timer Emulation" to the Options/Tweaks menu of all CINEBENCH and 3DMark versions. This does not change the quality of the timer and result verification, but it could be used to fix non-standard behaviour of special system/OS/BIOS combinations. In very rare cases it could lead to faster results, although it's unnecessary to use this like a tweak option. Change it by right-clicking the benchmark in the launchpad. The following options are possible: Auto: BenchMate decides. This is the default and should be the best option for you. This won't show skewed results unless BenchMate detects an irregularity on your system. Driver: All timer calls will be made by BenchMate's driver. This will never show skewed results, but it could have a negative impact on results! None: Use the original function call as decided by the benchmark and OS. Important: If this function is not safe or reliable, BenchMate will show a skew error after the run and the result can not be saved! QPC: Use the famous QueryPerformanceCounter() WIN32 API function for time measurement. Important: If this function is not safe or reliable, BenchMate will show a skew error after the run and the result can not be saved! Safer CPUID queries to avoid undefined behaviour for hardware-specific code paths in the driver. Bugfixes Fixed the automatically decided timer emulation mode for Windows 7 on Intel CPUs below Skylake. Several bugfixes for the Auto-Updater. I do hope very much that is now fully functional to distribute the next update automatically. Fixed a bug with output streaming of CLI workloads to the CLI wrapper. Special Thanks David Miller for testing the brand-new 7-Zip benchmark with Threadripper 3000. MrGenius on HWBOT for reporting QPC skewing issues on Windows 7 with Haswell. 18.12.2019 Benchmate 0.10.3 Important bugfix for Windows 7 as well as minor improvements. Improvements Moved "Analyze" function to view and compare scores into the context menu of the result list. Removed the "Analyze" button. This space is reserved for online submission of results in the future. Smaller enhancements for the Bug Reporter to improve the analysis of bugs. Improved the robustness of the client DLL detachment from a benchmark process. Bugfixes Fixed a bug in pifast on Windows 7 that prevented automatic result capturing. Fixed the formatting of memory modules where the vendor name is inside the part number. Fixed a number of bugs with the Auto-Updater. It is still in its testing phase, so no automatic updates for now. That hopefully changes soon! Special Thanks MrGenius on HWBOT for reporting the pifast bug. 14.12.2019 Benchmate 0.10.2 Bugfix release. Fixed the blocked scores in CINEBENCH due to wrong file integrity hash, which was actually a false positive. Fixed GPU detection in GPUPI CPU runs. Fixed lowercase "amd" vendor name. Special Thanks wergor on overclockers.at for reporting the integrity hash problems. 13.12.2019 Benchmate 0.10.01 Three new benchmarks, the benchmark integration was completely rewritten, improved Windows 7 compatibility, an auto-updater and lots more. Btw, version 0.10.0 was a prerelease version, that got leaked due to the necessity to properly bench wPrime on latest Threadrippers. We are taking this as a good thing! New Benchmarks pifast wPrime 7-Zip New Features ColdbugMate by Splave - fight Coldbugs by manually or automatically applied workloads with lots of different options! Press F8 to open the dialog. New command line benchmark wrapper (needed for pifast and 7-Zip, but will be available for any CLI-based benchmark in the future) Auto-Updater! New versions and support for additional benchmarks will be downloaded and installed automatically (if an internet connection is available) Tweaks & Options support for individual applications available by right click on the app in the Launchpad Support for custom resolutions (to upscale the desktop resolution on smaller monitors) Press F7 at any time to flush L1, L2 and L3 cache from the CPU. Try before you start the benchmark when your efficiency gets worse after some runs. New Tweaks/Options for Benchmarks Super PI Virtual RAMDisk: Faster Super PI scores, because it no longer uses the hard disk as a buffer for calculations Large Process Memory (LPM): Reserves ~500 MB for the process's working set size, should help with 32M Auto Minimize: Window is automatically minimized during run Run Confirmation: Enables/disables the dialog before the run. Defaults to "Disabled" because most benchers don't do subzero and even then just hit "Enter" on the settings dialog if you are cold enough to go. 3DMark03/05/06 LOD Bias/Adj: LOD settings for AMD & NVIDIA, automatically applied before the run and disabled afterwards (no executable renaming necessary for 3DMark06) GODLOD: Maximizes your LOD settings by utilizing textures up to 1x1 on every object Buffering: Single/Double/Triple and Quad Buffering. Removes the necessity to run D3DOverrider in the background, defaults to Double Buffering. Enable Triple or Quad Buffering if you bench NVIDIA cards. wPrime Apply Priority to Child Processes (CPP): Applies the currently set process priority to all child processes created during a run (might help for 1024M, can be too much overhead for 32M) Improvements The driver is now successfully attestation tested and therefore can be correctly executed on all machines (without the need to enable test signing) Improved support for Windows 7, 32 bit Rewrite of the whole benchmark integration code in latest C++ (easier integration with more control, less bugs and improved performance) Faster and more precise timer code for timeGetTime() and GetTickCount() Super PI: Settings dialog now defaults to 1M on first start and remembers the last selection CINEBENCH R11.5 and R15 integration: Unnecessary popups removed, OpenGL render test removed, "Keep Best Score" removed, "Run All Tests" removed, Checkboxes removed, Run aborted by ESC works now CINEBENCH R20 integration: Run aborted by ESC works now All benchmarks using DirectX 9 get their LOD Bias/Adj values correctly measured and displayed in the result dialog (if any value different than zero was applied) 3DMark05: You can't enable the benchmark setting "Disable Postprocessing" anymore. It is not allowed by the rules of HWBOT and neither wasn't by Futuremark's ORB. Result dialog: Revamped the design of the dialog. It's a validation stamp, so it should look as good as possible, right? Improved hotkey handling. Use F5 anywhere when the result dialog is open to take the screenshot. Use ESC to close. Improved overall workflow when working with the result dialog. Added Engineering Sample marking (ES) and moved enabled cores/threads next to the CPU name (to save space). The dialog no longer moves when the screenshot is taken, but shows the BenchMate logo instead. This is not only optics, but avoids ghosting due to very slow redrawing of the desktop background when there's no GPU driver installed. Added a new row to get better insight to the number of sensor measurements during a run (will be removed after beta stage) Compiled with Visual Studio 2019 and latest MSVC with Spectre patches statically linked (no impact on the benchmark's performance). Lots of cleanup work and small improvements to for example the threading classes, modeless dialogs and much more. Most memory leaks fixed. Added more driver initialization error messages including possible solutions. BenchMate's configuration file (config.json) is now populated with all preinstalled benchmarks automatically on first startup. Just remove the file if you want to reset your configuration. Bugfixes Fixed a system lockup for some older Intel CPUs with buggy HPET implementation on Windows 7 Fixed a bug with memory type storing and displaying (some types got truncated accidentally) Fixed validation problems with realtime priority Empty window titles will no longer receive the "guarded by BenchMate" postfix (happens on some some notification dialogs) Bugfixes and improvements for the bug reporter tool Fixed capturing of Super PI results when the window is minimized during the run Fixed wrong name detection of Threadripper 24-core model Fixed slow exit of 3DMark processes after closing the benchmark window Discontinued Support for Geekbench 3, 4 and 5 due to legal threats by Primate Labs Removed automatic restart of BenchMate when Windows is restarted while BenchMate is open (led to an error message after restart) Special Thanks Brady Deckert and Allen Golibersuch for their thorough bug reports on the realtime priority issue Allen Golibersuch for pointing out the previously undetected usage of 3DMark05's "Disable Postprocessing", which is against HWBOT rules 0.0 for his research into the Windows 7 lockup bug with HPET 32 bit to 64 bit switches Known bugs/issues 3DMark06: LOD on AMD graphics cards (at least Vega) is not applied, although that might seem like an unrelated problem to BenchMate itself. 3DMark05/06: GODLOD is currently not working with some AMD cards and displays an error message ("Device Lost"). I'm looking into it. Should be fine on NVIDIA cards though. CINEBENCH R20: If you enable the option "Keep best score" in the menu, BenchMate can not honor it. This can lead to lower benchmark scores detected and submitted by BenchMate than shown in the CB window. 04.09.2019 Benchmate 0.9.3 Version 0.9.3 removes all Geekbench versions from the Big Bundle. It is still supported though, but you have to install it yourselves. You can thank Primate Labs for this, its founder made it abundantly clear to me, that he doesn't care about having his vulnerabilities and poor choice of time measurement fixed. Oh, and I've fixed a bug in the Geekbench Compute test integration with AMD graphics cards. Why bother. All Geekbench versions removed from the Big Bundle as requested by Primate Labs itself. Some AMD graphics card could not be correctly detected within the Geekbench integration, which resulted in a failed result due to missing GPU core and memory clock detection. 3 Quote Share this post Link to post Share on other sites
doyousmellburning 11 Posted July 3, 2019 has geekbench 4 cuda been fixed yet ? its splitting the cuda scores into single and multicore scores and then fails to upload . Quote Share this post Link to post Share on other sites
Leeghoofd 2418 Posted July 3, 2019 Uploading is not yet supported, coders are on holiday… does taking the screenshot work via the BenchMate tool ? Quote Share this post Link to post Share on other sites
keeph8n 235 Posted July 3, 2019 X399 Creation and 2950X 1903 W10 11/14/18 drivers/bios for the mobo Ive tried reinstalling, new downloads, etc. basically I have gotten the software to open once with this setup to do some testing. Same OS but with my 990FXA-UD3/9370 combo and it pulls up just fine. Basically what happens when I open the program is the cmd prompt looking box opens, does it thing, closes and then nothing. Task Manager shows BenchMate running but I get no box to pop up. I don’t show anything in the task manager keeping it from opening. Quote Share this post Link to post Share on other sites
_mat_ 485 Posted July 3, 2019 (edited) 3 hours ago, doyousmellburning said: has geekbench 4 cuda been fixed yet ? its splitting the cuda scores into single and multicore scores and then fails to upload . The compute test of Geekbench 4 is now fully supported with version 0.8, coming asap. With 0.7.x the software could not distinguish between CPU and Compute score. As Leeghoofd said, uploading to HWBOT will not be possible until BenchMate is officially integrated into HWBOT. It's no biggie, the benchmark category just needs some configuration on the bot side. Edited July 3, 2019 by _mat_ 1 Quote Share this post Link to post Share on other sites
Digg_de 44 Posted July 3, 2019 (edited) On 7/3/2019 at 8:32 AM, Leeghoofd said: motherboard & CPU used Operating System used ( 32/64bit, exact OS version, stripped or not) Drivers installed for chipset What you tried to solve the problem No detection CB11.5 with: Z77 OC Formula & 2500k Win10 64 Pro All Drivers installed Nothing Edited July 7, 2019 by Leeghoofd Quote Share this post Link to post Share on other sites
Leeghoofd 2418 Posted July 7, 2019 I think Matt is working on the CBs Quote Share this post Link to post Share on other sites
keeph8n 235 Posted July 7, 2019 have tried installing and reinstalling and still can't get it to pull back up with X399. May do a fresh install of 1903 before the comp open up Wednesday to see what happens Quote Share this post Link to post Share on other sites
Leeghoofd 2418 Posted July 7, 2019 Thats the reason for the compo to get more people in and do debugging to get it smooth sailing for the future Quote Share this post Link to post Share on other sites
MrGenius 23 Posted July 7, 2019 (edited) I keep getting errors extracting it. I've tried on 2 different PCs, one with W10 one with W7. Both get the same errors. Tried 3 different file downloads so far. Same thing every time. So not likely bad downloads. Actually...W10 threw another similar error one time I tried extracting it. But the 2 above are consistent between 7 and 10. Happen every time I try extracting it. Even when I redownload it. App seems to work fine regardless. I have no idea why... EDIT: Tried manually submitting a SPI-1M score just now. "Invalid data file: Unable to decrypt the datafile" Screenshot works... Edited July 7, 2019 by MrGenius Quote Share this post Link to post Share on other sites
_mat_ 485 Posted July 7, 2019 The file you are getting an error from is just part of the normal Cinebench package. You can skip these files, they are just sample results shipping with the benchmark. You can only upload GPUPI results for now. HWBOT can't handle other benchmarks yet because they need to be integrated. Hopefully soon. 2 Quote Share this post Link to post Share on other sites
Leeghoofd 2418 Posted July 10, 2019 I installed my win10 (1903) Benchmate OS on Ryzen , testing went smooth (even the CB's) Afterwards switched to AM3 and got issues to launch BenchMate. Did a fresh install of Windows on the Crosshair V and all was fine again... So I assume no platform switching with the same SSD 1 Quote Share this post Link to post Share on other sites
Digg_de 44 Posted July 10, 2019 Screenshots via Benchmate works with all Benchmarks and Platforms we need for the Competition? Or do i have to install and bench some Systems multiple Times until it works and the Screens are valid? Quote Share this post Link to post Share on other sites
Leeghoofd 2418 Posted July 10, 2019 Submissions via the screenshot made by the Benchmate tool. Them screens need to be valid (standard rules), so no blocking of the rendered scene for the CBs , Only CPUZ CPU and mem is required and the BenchMate score too... The background is almost ready Again the concept is to have fun, but more important to provide solid feedback on how you experience working with the BenchMate, if you have issues/probs/rearks to report it there in the Official Support thread. 1 Quote Share this post Link to post Share on other sites
Digg_de 44 Posted July 10, 2019 (edited) Screenshot is hard to manage with FullHD Resolution. The Result Window is jumping to the right and blocking the rendered Scene. Is it a Win7 issue? I am just playing a bit.. later for Competition with Win10. Edited July 10, 2019 by Digg_de Quote Share this post Link to post Share on other sites
Leeghoofd 2418 Posted July 10, 2019 Nope reportesd this to Matt too, apparently it has a predefined spot so I had to juggle the rest around… aim from Matt is to limit the usage of CPUZ too, but atm I find it too early days Quote Share this post Link to post Share on other sites
keeph8n 235 Posted July 10, 2019 Tried a fresh install of 1903 last night. No dice on my TR4 setup. Tried turning HPET on and off and back on again. Hoping 0.8 fixes my issue(whatever it may be) Quote Share this post Link to post Share on other sites
Leeghoofd 2418 Posted July 10, 2019 Maybe video it, so Matt can have a closer look... I did a fresh install, no drivers whatsoever, just extracted the benchmate folder and run the Benchmate executable as administrator Quote Share this post Link to post Share on other sites
_mat_ 485 Posted July 10, 2019 2 hours ago, keeph8n said: Tried a fresh install of 1903 last night. No dice on my TR4 setup. Tried turning HPET on and off and back on again. Hoping 0.8 fixes my issue(whatever it may be) I'm currently testing the new version on several platforms. Successfully tested it on TR4 on my bench OS (for reviews): https://hwbot.org/submission/4191705__mat__cinebench___r20_with_benchmate_ryzen_threadripper_2990wx_10984_pts Don't be shocked about the world record, I've added a beta benchmark category that's called "Cinebench R20 with BenchMate" to make direct uploading to HWBOT possible. Nonetheless we will find your problem. BenchMate 0.8 brings a fresh new Bug Report Tool, so bugs can be easily but also thorougly reported just by a few clicks. Quote Share this post Link to post Share on other sites
_mat_ 485 Posted July 10, 2019 3 hours ago, Digg_de said: Screenshot is hard to manage with FullHD Resolution. The Result Window is jumping to the right and blocking the rendered Scene. Is it a Win7 issue? I am just playing a bit.. later for Competition with Win10. Interesting screenshot for sure. Seems like BenchMate wasn't able to wait for the invalidated, old dialog position before the screen was captured. I have changed the result dialog's behaviour now to always move back to the bottom right position of the screen. The position of the result dialog is fixed because I think it's bad design to search the screenshot each time for the same information. It's even worse of course when comparing multiple screens, which we all do very often I'm sure. Just reposition all other items, the result will be the same. Benchmark to the top left, CPU-Z windows to the right. Long term I think it's reasonable to remove the need for CPU-Z and GPU-Z windows on the screen. It's very time consuming and it shouldn't bring any extra information to the table. If it still does we should integrate it into the result window. So there will be much more space available in the future. Quote Share this post Link to post Share on other sites
keeph8n 235 Posted July 10, 2019 1 hour ago, _mat_ said: I'm currently testing the new version on several platforms. Successfully tested it on TR4 on my bench OS (for reviews): https://hwbot.org/submission/4191705__mat__cinebench___r20_with_benchmate_ryzen_threadripper_2990wx_10984_pts Don't be shocked about the world record, I've added a beta benchmark category that's called "Cinebench R20 with BenchMate" to make direct uploading to HWBOT possible. Nonetheless we will find your problem. BenchMate 0.8 brings a fresh new Bug Report Tool, so bugs can be easily but also thorougly reported just by a few clicks. That’s absolutely fantastic to hear. Really want to bench tonight on both DDR4 and DDR3. Will download newest update if it’s out when I get home. Quote Share this post Link to post Share on other sites
keeph8n 235 Posted July 10, 2019 Uploaded the current log files. Again it will open the cmd prompt and then close and nothing happens. Please advise. launcher32.log client.log bmservice32.log Quote Share this post Link to post Share on other sites
cbjaust 171 Posted July 11, 2019 (edited) Does Geekbench4 have to be the paid version for it to hook into the result? I don't have Geekbench4 paid and BenchMate 0.7.1 doesn't recognise any result once the GB has finished and uploaded the result to the Geekbench browser... By the way, I was changing the Bus Speed during the GB4 run with ASUS' TurboV Core and BenchMate didn't complain. Edit: Feature request - is it possible and/or likely to support saving the screenshots as .PNG? The .JPG is poor quality especially when it comes to CINEBENCH renders. Info: Motherboard & CPU used: C6H & Ryzen 7 1800X Operating System used ( 32/64bit, exact OS version, stripped or not): Windows 10 Version 1903 (OS Build 18362.239) Drivers installed for chipset: AMD Chipset Drivers Version 1.6.13.0400 What you tried to solve the problem : posted here 😋 Edited July 12, 2019 by cbjaust Quote Share this post Link to post Share on other sites
_mat_ 485 Posted July 12, 2019 No, free version is enough but 0.7.1 had a problem with capturing the scores. It has been fixed already in 0.8. Skew measurement is very different now on BenchMate, more precise and has less performance impact. I will go into details about it in the announcement post. Needs testing for sure. PNG, noted and no problem at all. Might need to be combined with Gzip compression so the result uploading won't take forever on slow connections. 1 Quote Share this post Link to post Share on other sites
cbjaust 171 Posted July 12, 2019 4 hours ago, _mat_ said: No, free version is enough but 0.7.1 had a problem with capturing the scores. It has been fixed already in 0.8. Skew measurement is very different now on BenchMate, more precise and has less performance impact. I will go into details about it in the announcement post. Needs testing for sure. PNG, noted and no problem at all. Might need to be combined with Gzip compression so the result uploading won't take forever on slow connections. haha, now you tell me! (USD$9.99 later - 4192919_cbjaust_geekbench4_multi_core_ryzen_7_1800x_30773_points/) Yeah PNG would be great. Thanks. Re: Skew, I found that CINEBENCH R15 would get a skew error warning quite a bit. Quote Share this post Link to post Share on other sites
