jpoole

@Splave Unfortunately I'm locked out of my account from 2008! I'm not sure how we move forward from here. I'm sure everyone's feelings are a bit raw right now. I know mine were after I read Matthias' initial comments about Geekbench 5 and the development team here at Primate Labs. Regarding the timer issues, I was only vaguely aware of them prior to this week, and assumed that since Geekbench was included in the HWBot leaderboards the issue had been resolved to HWBot's satisfaction. I know that's not the case now, and we're looking into ways to solve this inside Geekbench across all platforms we support. Regarding the 16 million timer calls, we've already fixed that issue in Geekbench 5.0.1. The underlying issue was that a third-party library used QueryPerformanceCounter() to profile individual function calls within the library. Disabling that profiling brings the number of timer calls back in line with Geekbench 4.

I'm John Poole, the founder of Primate Labs, the company that develops Geekbench. I'd like to clarify our position on Benchmate. I approached Matthias on Wednesday and asked him to remove Geekbench from the Benchmate bundle -- the way in which Benchmate included Geekbench created legal and logistical issues for us. This request was straightforward yet took significant back-and-forth to resolve. I also expressed my concern over how Benchmate integrates with Geekbench. Benchmate does more than change the timers Geekbench uses to measure performance. Benchmate "snoops" into Geekbench to fetch results and submit them directly to HWBot, and appears to be taking steps towards subverting Geekbench's licensing code. Matthias disagreed with our assessment and refused to remove the integration. We are concerned about an application built on top of ours without our permission because of methodological, statistical, business, and legal reasons. I'm disappointed in how this incident has unfolded, and I'm surprised to see comments that we're not taking these issues seriously, or that we're not supporting the community. I believe we can take these issues seriously while still disagreeing about whether Benchmate and the techniques it uses are the correct approaches to resolving these issues.