Jump to content
HWBOT Community Forums

Doubt about 3dmark Fire Strike>tessellation


zupernico

Recommended Posts

FM view is this; If you change something in driver/registry that changes the visuals of the test, you are changing the test and the score becomes fairly pointless.

 

Of course it boils down to "are we trying to get big numbers out of a piece of software?" or "are we trying to tweak hardware to perform a well-defined and repeatable workload as fast as possible?"

Link to comment
Share on other sites

It actually boils down to "can we enforce the rules we make?", rather than a philosophical debate. We all want the image quality maintained, but if you can't check if a certain IQ "optimisation" was used ... not possible to enforce.

 

Why don't Nvidia and AMD, two members of your BDP program, provide you with all the information to ensure image quality?

Link to comment
Share on other sites

It actually boils down to "can we enforce the rules we make?", rather than a philosophical debate. We all want the image quality maintained, but if you can't check if a certain IQ "optimisation" was used ... not possible to enforce.

 

Why don't Nvidia and AMD, two members of your BDP program, provide you with all the information to ensure image quality?

 

Most likely reason? Because our benchmarks are primarily tools for them and their customers and the press. None of these would even consider "cheating" with IQ-degrading tweaks when benchmarking hardware as it would pretty much defeat the whole point. From their perspective, this is a complete non-issue.

 

The only case where the problem raises its ugly head is when benchmarks are used for hobby/competitive benchmarking and the objective is no longer to compare hardware performance (or test system stability) but to get biggest possible numbers.

 

It definitely is a known use case for 3DMark and we've done a lot in that regard already (all the online submission validation code is there almost entirely to support this). The unfortunate problem is that without server side code doing validations, any such checks would be absolutely trivial to hack. And you guys seem to eminently dislike having a network connection while benchmarking.

 

The only theoretical option for such validations offline would be to have punkbuster-style monitoring processes running in the background, trying to figure out if someone is messing up with the benchmark but such system would be very complicated to code, hard to maintain and almost impossible to do without influencing benchmark results - something that would diminish the usefulness as a tool for BDP, OEM manufacturers and the press.

 

For 3DMark we added in-UI support for online result validation so you can see result validity for screenshot purposes without opening a browser. While there are no new checks (the checks are same as for 3DMark 11), it would be possible to expand this further, for example against the LOD tweaks. But again, it has to be server side or it is pretty much pointless. And since HWBot community seems to be against network connection requirement, it is hard to get through an argument inside FM that we should dedicate resources to do, for example, NVIDIA LOD setting checks for 3dmark.com result validation. Nobody else except competitive/hobby "record breaker" benchmakers have any need for it and notable competitive benchmarkers refuse to use it (because you must be online), so... why do it?

 

Just trying to explain the situation from our perspective...

Link to comment
Share on other sites

Network does not requied for online Validation. You can save the score, and open it on a other PC and can show it online. If you have buy the Benchmark. I think thats not a big problem.

Perhaps i have a solution for all ...AMD and Nvidia Fans:

I can live with the Option, Tessellation Tweak at 3DMark 11 to leave allowed.

 

At the new 3DMark 2013, Tessellation tweak disallowed, but to allow LOD Tweaks. It is a tweak that can use both sites, Nvidia and AMD.

At all other videocard Benchmark , there is a online validation anyway requiered, for the Top 20! I think this Rule remains at the 3DMark 2013 too.

It is only a little idea...

I dont know if that realizable... :)

Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

×
×
  • Create New...