Jump to content
HWBOT Community Forums
Leeghoofd

Benchmate 0.9.3 is out, supporting Geekbench 5

Recommended Posts

Thank you, @Mysticial.

Your input on the integration is also very much appreciated, which is why I want to spend more time on y-cruncher, working on this together! I think there is a lot of unused potential in your benchmark and frankly it's one of the best, most optimized benchmark code out there.

It's time to get your benchmark points.

  • Like 7

Share this post


Link to post
Share on other sites

i cant beleive this, here we have mat and others trying to and indeed endeavouring to make BOT a safer and better place to bench in with calculated changes for the better for ALL and we then have the other that  come up with all the excuses under the sun as to the negativities of it all with no basis or facts of their ridiculous baseless statements

do you people walk around in life all day with your heads up your arses , or were you just born that way ??

  • Like 1

Share this post


Link to post
Share on other sites

@Mythical tech  I am being paranoid here but at the same time we've had legal threats for weirder things in the past so maybe the paranoia is justified!

@_mat_ FWIW removing the profiling code (which wasn't controlled via a setting) didn't change Rigid Body Physics performance on any of our ~150 test systems.  I don't expect this issue will affect the majority of our users.  It's trivial for us to filter out results that are potentially affected by the LAPIC timer bug -- we can exclude results gathered from Windows 10, or from systems that have a non-standard BCLK, or any one of the number of system metrics we collect.  What we can't do is filter out Benchmate results because there's no way for us to identify those results!

Again, I'll reiterate and say I understand that the community here is upset but I'm not comfortable with the Benchmate integration.  If that means Geekbench is removed from HWBot that's disappointing but it's most certainly not my call to make.

 

Share this post


Link to post
Share on other sites

Why not get all the “heads of state” involved and conference call this and see what can be done. Hash it out real time. 

 

Mat, Mr Poole, someone from HWBOT, and maybe a few of the top benchers. 

 

Conference call this shit and get it all out in the open. All the fears, questions, concerns, etc. 

 

i enjoy benching Geekbench. Clearly I spent some of the morning yesterday snagging the score I did. I enjoy using BenchMate as it secures different benches so that I don’t have to worry about issues. 

 

Cleary i I would love to see Primate Labs and Mat work together to get the integration hashed out and working together. It’s best for the community going forward imo. 

 

Just some ramblings from a random nobody bencher. 

  • Thanks 1

Share this post


Link to post
Share on other sites

It's pretty clear to me that this is all done.

Time to move on people.

Edited by Mr.Scott
  • Thanks 3

Share this post


Link to post
Share on other sites
17 minutes ago, keeph8n said:

Just some ramblings from a random nobody bencher. 

err ...wat. You go alright man, do nice scores :P A voice remains silent a voice never heard. 

______

No point to this now as Mr Scott says. Geek dead in the water.

... as for ycruncher ... it's a lot tougher bench to set up & run. More challenging then good for us 

Share this post


Link to post
Share on other sites
30 minutes ago, jfpoole said:

FWIW removing the profiling code (which wasn't controlled via a setting) didn't change Rigid Body Physics performance on any of our ~150 test systems. 

Try HPET enabled for the OS (useplatformclock) on Kaby Lake X, Skylake X and above as well as Ryzen and Threadripper. It will have a huge impact.

34 minutes ago, jfpoole said:

It's trivial for us to filter out results that are potentially affected by the LAPIC timer bug -- we can exclude results gathered from Windows 10, or from systems that have a non-standard BCLK, or any one of the number of system metrics we collect

This can be a marker for some scores, but in the end it's undetectable. Also what's a non-standard bclock? It can vary by itself due to fluctuations by mainboards and on several generations even some XMP settings can alter it. So you would get false negatives and false positives. Please don't downplay the issue, this is also about the sanctity of your result database and the trust in your (Windows) results.

 

40 minutes ago, jfpoole said:

What we can't do is filter out Benchmate results because there's no way for us to identify those results!

That can be easily arranged. But it needs cooperation.

  • Like 1

Share this post


Link to post
Share on other sites
21 minutes ago, keeph8n said:

Why not get all the “heads of state” involved and conference call this and see what can be done. Hash it out real time. 

 

Mat, Mr Poole, someone from HWBOT, and maybe a few of the top benchers. 

 

Conference call this shit and get it all out in the open. All the fears, questions, concerns, etc. 

 

i enjoy benching Geekbench. Clearly I spent some of the morning yesterday snagging the score I did. I enjoy using BenchMate as it secures different benches so that I don’t have to worry about issues. 

 

Cleary i I would love to see Primate Labs and Mat work together to get the integration hashed out and working together. It’s best for the community going forward imo. 

 

Just some ramblings from a random nobody bencher. 

 

My guess is that it's unlikely to happen unless someone sponsors it. There's no clear way to make a ton of money catering to HWBOT. As there is no benefit, it makes zero sense from a business perspective to take on any risks no matter how far-fetched they are.

Without a source of money to drive things, the only real support will be from benchmarks made by non-profit enthusiasts who don't care about the money. (Technically, y-cruncher isn't completely non-profit as I do require commercial licensing for the more extreme usecases which HWBOT currently does not fall under.) But the idea still stands. I wrote y-cruncher because it's a hobby, not because I'm trying to make money. I have a day job for that.

That said, generally speaking, these "non-profit" benchmarks aren't going to look or feel as professional as the for-profit stuff. For example, PiFast and y-cruncher lack GUIs. After all, these are single-person projects by someone who doesn't know or doesn't care enough about GUI. (Personally, I'm a backend programmer, not a GUI programmer.)

-----

As someone who loves mischievous thought experiments, an alternate (but childish) approach is to compromise all the big name benchmarks. For example, publicly release a hack application that DLL-injects the timers to compromise these big-name benchmarks. (IOW, make it very easy to cheat them.) Then have many people (botnet?) massively submit cheated benchmarks into the respective databases. Make them indistinguishable from real results. This will force a hand, but it obviously won't make you too many friends.

  • Haha 3

Share this post


Link to post
Share on other sites
4 minutes ago, Mysticial said:

As someone who loves mischievous thought experiments, an alternate (but childish) approach is to compromise all the big name benchmarks. For example, publicly release a hack application that DLL-injects the timers to compromise these big-name benchmarks. (IOW, make it very easy to cheat them.) Then have many people (botnet?) massively submit cheated benchmarks into the respective databases. Make them indistinguishable from real results. This will force a hand, but it obviously won't make you too many friends.

Have at it! You can already do this with Cheat Engine, but to crack 3DMark for example you need my TimerBench (menu -> Measure Process...).

I have reported this to Intel and UL/Futuremark 2 years ago and it changed nothing. That's where BenchMate actually started.

Share this post


Link to post
Share on other sites

mysticialmat@benchmark.com

Yeah if you could add gui ... that makes the benchmark more interesting for eye candy or run realtime as x265 does.

Start small make your own benches & gain popularity = dollars sponsorship.

Benchmate it's starting small steps ... but when it gets going, other big time software companies come to you to bundle theirs. :)

Share this post


Link to post
Share on other sites
11 minutes ago, _mat_ said:

Have at it! You can already do this with Cheat Engine, but to crack 3DMark for example you need my TimerBench (menu -> Measure Process...).

I have reported this to Intel and UL/Futuremark 2 years ago and it changed nothing. That's where BenchMate actually started.

Great! Part 1 done. Now we just need to advertise it and get everyone in the world to submit fraudulent scores!

 

4 minutes ago, avalanche said:

mysticialmat@benchmark.com

Yeah if you could add gui ... that makes the benchmark more interesting for eye candy or run realtime as x265 does.

While I have a vision for what such a GUI would look like, it's unlikely that I'm personally gonna ever do it. I have neither the expertise, time, nor interest to do it.

But there is a partially completed API layer that would allow 3rd parties to integrate with y-cruncher and become the GUI themselves. But realistically speaking, unless there's someone willing and able to volunteer that kind of time, it's not going to happen.

 

Quote

Start small make your own benches & gain popularity = dollars sponsorship.

Benchmate it's starting small steps ... but when it gets going, other big time software companies come to you to bundle theirs. :)

Yeah, been there done that in multiple ways (specifically with y-cruncher). It's not that simple.

 

Share this post


Link to post
Share on other sites

If things were easy we could all do it. That's not what is being gifted or talented. You work at it. :D

Effort is reward all things in life.

Share this post


Link to post
Share on other sites

To me I don't see this going any further.


I've noted more than once Mr. Poole has expressed concern/worry about getting sued and since he's running a business that's understandable, yet at the same time a solution could be worked out IF all parties involved were willing to.

That much I'm certain of.

However Mr. Poole has made is clear he has no desire to do such and doesn't matter whether it could be potentially good for the bench as in increasing exposure and interest in the bench..... Which would in turn mean more licenses for it sold. 

Clearly his mind is made up and I see that from what's been said along the way with the back and forth banter in the thread between himself and Mat along with other comments.

In short:

With all this, worrying about it is pointless - Drop it and move on, there will always be other benchies to take it's place later.

Edited by Bones
  • Like 4

Share this post


Link to post
Share on other sites
14 hours ago, Mysticial said:

@_mat_ Oh, if it isn't clear enough from our previous interactions already, you have my permission to integrate BenchMate with y-cruncher. Just keep me updated with what you have in mind.

I'm willing to make any minor changes that are needed if they would make the integration easier and/or more secure. I just won't have the time resources for anything significant. If it's useful, I can also give you access to the source code for the HWBOT submitter and verification algorithm for the stage 1 protection of the validation files. (which is all that's currently enforced for HWBOT anyway)

Sounds like we have found light at the end of the tunnel

  • Like 3

Share this post


Link to post
Share on other sites

So…let's just run it like we run 3 & 4. Like I said...it runs just fine on 7. What's the problem with that?

Other than the obvious problems. Like not being able to submit scores without a datafile(that can only be had via BM). And having the compute scores going under the processor used...instead of the graphics card. Simply....get over all your pissing and moaning, make a rules page, fix those things so we can submit scores properly...and let's play ball. :)

Oh...and do you want to know 1 good reason why GB should NOT be run with BM? Because that precludes all the 32-bit systems that can't run BM, but can run GB 3 & 4 just fine. Like systems running EVERY 32-bit processor ever made(maybe not all...but a HUGE number of them CAN run GB 3 & 4 but CANNOT run BM). And that's a stupid thing to do. Artificially limiting things so only modern hardware can be used that is. Which is exactly the case with BM and GB 3 & 4 anyway. I know it's a little off topic(since GB 5 is strictly 64-bit). But I feel it needs mentioned here.

Edited by MrGenius

Share this post


Link to post
Share on other sites

I know this might be really unpopular and slightly unrelated, but i liked Hwbprime and for sure would welcome a well integrated and safe version made/integrated by _mat_ :D

Just a random suggestion since we're looking for new benches :)

  • Like 4
  • Confused 1

Share this post


Link to post
Share on other sites
44 minutes ago, MrGenius said:

Oh...and do you want to know 1 good reason why GB should NOT be run with BM? Because that precludes all the 32-bit systems that can't run BM, but can run GB 3 & 4 just fine. Like systems running EVERY 32-bit processor ever made(maybe not all...but a HUGE number of them CAN run GB 3 & 4 but CANNOT run BM). And that's a stupid thing to do. Artificially limiting things so only modern hardware can be used that is. Which is exactly the case with BM and GB 3 & 4 anyway. I know it's a little off topic(since GB 5 is strictly 64-bit). But I feel it needs mentioned here.

No, Benchmate runs fine on 32 bit as well and Windows 7. I've tried a Core 2 Duo when testing 0.9 and it worked fine too.

Oh, I just noticed that I have no clue what you are talking about.

Edited by _mat_

Share this post


Link to post
Share on other sites
53 minutes ago, TAGG said:

I know this might be really unpopular and slightly unrelated, but i liked Hwbprime and for sure would welcome a well integrated and safe version made/integrated by _mat_ :D

Just a random suggestion since we're looking for new benches :)

Impossible with the current state of the HWBOT submission API. It took less than 5 minutes to get the encryption key and 5 more to roll my own data files.

Java is also an unwise choice to make benchmarks with.

Edited by _mat_
  • Thanks 1

Share this post


Link to post
Share on other sites
31 minutes ago, _mat_ said:

Impossible with the current state of the HWBOT submission API. I took less than 5 minutes to get the encryption key and 5 more to roll my own data files.

Java is also an unwise choice to make benchmarks with.

Is the key an unobfuscated plain text string or something? xD

(not saying mine is much better...)

Share this post


Link to post
Share on other sites
2 minutes ago, Mysticial said:

Is the key an unobfuscated plain text string or something? xD

(not saying mine is much better...)

Yes.

  • Haha 2

Share this post


Link to post
Share on other sites
3 hours ago, _mat_ said:

No, Benchmate runs fine on 32 bit as well and Windows 7. I've tried a Core 2 Duo when testing 0.9 and it worked fine too.

Oh, I just noticed that I have no clue what you are talking about.

I've been unable to get any version of BM to run on W7 Ultimate 32 and any s478 P4/M. So that's where I'm coming from. I suppose I'll send you a bug report or 2(pretty sure I already did). Maybe you can fix it...

And yeah...it's the coherent English I speak. Nobody understands that these days...:rolleyes:

Edited by MrGenius

Share this post


Link to post
Share on other sites

HWiNFO supports Pentium 4 as far as I know. That's about the minimum requirement that BenchMate needs.

Nevertheless, consider BenchMate to be more directed to modern platforms. I will fix bugs on old platforms if I can of course, but will focus more on heavily used hardware.

A bug report is always welcome!

Share this post


Link to post
Share on other sites

Bug report sent.

Pentium 4 1.8GHz Willamette 256

ASUS P4P800-VM

Tried...

bcdedit /set debug off

bcdedit /set testsigning on

Still won't run.

Share this post


Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.


×
×
  • Create New...