PDA

View Full Version : [GUIDE] 3DMark Score Calculation - how to calculated your 3DMark Score -



Henkenator68NL
07-05-2013, 11:06 PM
3D Mark Scoring explained
Author : Henkenator68NL
Date : 1-july-2013
Source : Official Futuremark 3DMark Technical Guide


http://www.futuremark.com/downloads/3DMark_Technical_Guide.pdf (http://www.futuremark.com/downloads/3DMark_Technical_Guide.pdf)

Fellow ROG-ers and Benchers,

I have done some reading about 3DMark and the scoring system behind it, I will share my findings in this thread.


3DMark (2013 version that is) has been out for some time now, it is the latest in the Futuremark's 3D bench tests family. 3DMark is a cross platform bench program (Windows PCs, Windows RT, Android and iOS) which is quite unique.
The Benchmark Test contains 3 different Test suites: Ice Storm, Cloud Gate and Fire strike.

Ice Storm

Ice storm is targeted at mobile devices and entry level PCs. There a 2 predefined settings:


Ice Storm Default: resolution 1280x720, 128MB GPU memory, Low Texture quality, 1/8 Bloom resolution.
Ice Storm Extreme: graphic resolution: 1920x1080, Physics res: 1280x720, 256 MB GPU memory, High Texture quality, Bloom res.

Each setting contains the following tests:

Graphics Test 1
Stresses the GPU by processing lots of vertices with a light pixel load. Hardware (for this level) may have a fixed operation level for vertex and pixel processing. By stressing them separately its not hard to find hardware limitations.

Graphics Test 2
The GPU is pushed hard to process lots of pixels. Lower number of vertices and triangles than Graphic test 1.

Physics Test
This tests the CPUs capability to simulate gameplay physics. One thread per available CPU core is assigned to creating the simulations, while other threads are completing other tasks. The GPU load is kept as low as possible. The Bullet Open Source Library is used for this Physics Test.

Cloud Gate

Cloud Gate is test suite developed for notebooks and your average home computer. The benchmark utilizes a DirectX 11 engine dialled back to DX10 level for testing. The default settings are:

Rendering resolution 1280x720, 256MB GPU memory, Shadow Sample Count: 4, Shadow Map Res: 1024, Depth of Field Quality: low, 1/8 Bloom resolution.

The individual tests are:

Graphic test 1
Strong geometry processing with simple shaders and some particle effects. FFT based bloom and depth of field added during post processing.

Graphics test 2
Shaders with more complex math, but less geometric details than test 1. Post processing is the same.

Physics test
This test utilizes the cpu to simulate gameplay. GPU load is kept low to keep each CPU core busy. The simulations run on 1 thread per CPU core while other threads are completing other tasks.

Fire Strike
Fire Strike is designed for high-performance gaming PCs. It uses a multi-threaded DX11 engine.
There a 2 setting levels:


Fire Strike default: resolution: 1920x1080, GPU memory: 1 GB, Tessellation detail: medium, Surface shadow sample count: 8, Shadow map resolution 1024, Volume illumination quality, Particle illumination quality, Ambient occlusion quality and Depth of field quality: all at medium. Bloom resolution .

Fire Strike Extreme: resolution: 2560x1440, GPU memory: 1.5 GB, Tessellation detail: high, Surface shadow sample count: 16, Shadow map resolution: 2048. Volume illumination quality, Particle illumination quality, Ambient occlusion quality and Depth of field quality: all at High. Bloom resolution .


3DMark Fire Strike Extreme is aimed at multi-GPU systems and future hardware generations.

The tests in Fire Strike are:

Graphics Test 1
This test focusses on geometry and illumination. Particles are drawn at half resolution and dynamic particals are disabled. 100 spotlights cast shadows and 140 point lights that do not. Lower pixels processing than in test 2, since there is no depth of field.

Graphics Test 2
Now it is time to focus on the particles and the GPU simulations: Particles are drawn at full resolution and dynamic particle illumination is enabled. Two smoke fields are simulated by the GPU, 6 spotlights cast a shadow and 65 lights without shadows. Shaders are utilized for particle and fluid simulations and post processing (including depth of Field).

Physics Test
The CPU is being stressed by running gameplay physics simulations. The GPU is kept out of the wind to ensure that only the CPU is stressed. In the test there are 32 simulated worlds, 1 thread per available core is used to run the simulations.

Combined Test
Now the torture really starts: both CPU and GPU are pushed hard at the same time. The GPU load is a mix of Graphics test 1 and 2, using tessellation, volumetric illumination, fluid simulation, particle simulation, FFT based bloom and Depth of Field. The CPU is pushed by creating the rigid body physics of the breaking statues (background).
The test runs 32 world simulations running in separate threads each containing 1 statue crumbling into 113 parts. On top off that: 16 invisible rigid bodies (in all but one world). The simulations run on one thread per available CPU core.


Additional information:
Multithreading


Futuremark 3DMARK TECNICAL GUIDE: The multithreading model is based on DX11 deferred device contexts and command lists. The engine utilizes one thread per available CPU core. One of the threads is considered as the main thread, which uses both immediate device context and deferred device context. The other threads are worker threads, which use only deferred device contexts.

Rendering workload is distributed between the threads by distributing items (e.g. geometries and lights) in the rendered scene to the threads. Each thread is assigned roughly equal amount of scene items.
When rendering a frame, each thread does the work associated to items assigned to the thread. That includes, for example, computation of transformation matrix hierarchies, computation of shader parameters (constants buffer contents and dynamic vertex data) and recording of DX API calls to a command list. When the main thread is finished with the tasks associated to its own items, it executes the command lists recorded by worker threads.

Tesselation
The Engine supports rendering with or without Tessellation, supported techniques: PN Triangles, Phong and displacement map based Tessellation details. Both triangle and square tessellation is supported.

continued in next post:

Henkenator68NL
07-05-2013, 11:17 PM
Some information about the scoring in 3DMark

The overall score formula

3DMARK uses a formula to calculate your scores. The overall score is calculated by the following formula:

22908
Legend:
Wgraphics = Graphic Score Weight Sgraphics = Graphics Score
Wphysics = Physics Score Weight Sphysics = Physics Score
Wcombined = Combined Score Weight Scombined = Combined Score

Each individual score (graphics, physics and combined) is derived from the raw FPS score that is found while running the test. Through the individual scores the overall 3DMark score is calculated.

A weighted harmonic has been brought into the equation and also some constants (see table Weights and Constants further below). The Weights in fact determine the proportion of the GPU and CPU in the calculation of the individual and end result.

For a balanced system the weights show the ratio between the effect off the Graphics and Physics performance on the overall score. A balanced system is one where the Graphics and Physics are roughly of the same magnitude. For systems with a substantially higher Graphics or Physics sub-score, the harmonic mean rewards boosting the side where the lower score is.

This is in line with real life, for example: If you use an entry-level GPU and if you double the CPU speed: it has little or no improvement on your system performance when playing games. Because the systems gaming performance is limited by the GPU. The same applies on a system with a low-end CPU and an overpowered GPU.
With the following example, I will explain how this works

Your latest 3DMark Fire Strike bench test has the following results:


For this example the calculated scores are blurred out, so we can check them later with the calculations below.

22916

Graphic Test Scoring
Each test produces a raw result in frames per second (FPS). The harmonic mean of these Raw results is multiplied with its corresponding scaling constant. This leads to the graphics score (Sgraphics):

22911
Now take a look at the Graphics Test: Graphic Test 1 = 42.4 fps, in the formula this is Fgt1. Graphics Test 2 = 32.2 fps in the formula Fgt2.
The result of the formula: Sgraphics = 8847

Physics Test Scoring
The Physics score is easy to calculate, multiply the physics constant with the raw fps score (Fpyshics ).


22910
The fps score is 41,2 and the constant found in the table is 315.
The result of the formula: Spyshics 41,2 x 315 = 12978

Combined Test Scoring
The combined test score can be found with this formula:

22909
In the example the combined test scored 15,6 fps (Fcombined) the constant from the table is 215.
The combined score: Scombined 15,6 x 215 = 3354

Now with all the sub scores the Overall S3DMARK score can be calculated:

22914

Here is the same example, with the actual scores.

22915
As you will notice the results deviate a little bit, the is caused by rounding off in the formula. The actual results in frames per second are not shown by the benchmark test. But in general the score is pretty accurate.

Weights and Constants Table:

22912

3DMark score calculator
I have made a calculator in excel, and if it is completely finished I can make it available for download. For those who would like to check their own scores and or see the influence off each sub-test in the total score.


22913

Disclaimer: This represents my personal opinion or findings, by no means do I claim to be an authority on this subject, I am NOT tied to Futuremark in anyway.

I will try to add new information on the subject in this thread.

At the moment I am running a series of tests to see how the scores are affected by different settings like:
overclocking the CPU
Overclocking the GPU
Overclocking the DRAM
OS tweaks / versions
etc.

I will post my findings here in the near future!

nikosa43
07-06-2013, 12:17 AM
Henk, that's excellent! Congrats for your effort and all the info. Rep from me for your contribution and willness to share :)

Henkenator68NL
07-06-2013, 12:33 AM
Henk, that's excellent! Congrats for your effort and all the info. Rep from me for your contribution and willness to share :)

Ευχαριστώ πολύ, μου φίλος

Thank you m8!

nikosa43
07-06-2013, 12:50 AM
You continue to surprise me :D. Φιλε

Arne Saknussemm
07-06-2013, 06:57 AM
Nice one Henk! now you just have to work out how to add a couple of thousand points to the score ;)

Henkenator68NL
07-06-2013, 07:16 AM
Thanks Arne!

Well that is what I am running the test for as mentioned: compairing which overclock causes what end result in the score......
but I am not sure it will be thousends but improvements must be achievable !!! :cool:

unless you count the bugged runs .... that was about 7000 up :confused:

Zka17
07-06-2013, 07:22 AM
Nice one, Henk! :cool:

HiVizMan
07-06-2013, 09:10 AM
Looking good mate.

nikosa43
07-06-2013, 03:16 PM
I like your humble approach...(couple of thousands), what about 10 grand, that would be good for me :D

twisted1
07-07-2013, 07:36 PM
Wow, me is impressed.

:)

Henkenator68NL
07-08-2013, 02:01 AM
Thanks for the kind words guys! I am rounding off some testing that I have been doing, and will put the results and conclusions here.I got some more data from o.a. HiVizMan; concerning calculations off other 3Dmark bench programs.Would you guys be intereted in an Excel calculating sheet that covers most of 3DMarks bench tests?If so please let me know in a post showing hands :-P

Detleg
07-08-2013, 03:22 AM
Henk , awesome thanks much :)

nikosa43
07-08-2013, 09:18 AM
Thanks for the kind words guys! I am rounding off some testing that I have been doing, and will put the results and conclusions here.I got some more data from o.a. HiVizMan; concerning calculations off other 3Dmark bench programs.Would you guys be intereted in an Excel calculating sheet that covers most of 3DMarks bench tests?If so please let me know in a post showing hands :-P

Count me, Henk :)

23042

Zka17
07-08-2013, 11:08 AM
Thanks for the kind words guys! I am rounding off some testing that I have been doing, and will put the results and conclusions here.I got some more data from o.a. HiVizMan; concerning calculations off other 3Dmark bench programs.Would you guys be intereted in an Excel calculating sheet that covers most of 3DMarks bench tests?If so please let me know in a post showing hands :-P

That would be really interesting! :)

twisted1
07-08-2013, 11:46 AM
Hands!! Hands!!

Myk SilentShadow
07-08-2013, 12:24 PM
I tried to read through your stuff Henk, but, my brain exploded :cool: :p

Henkenator68NL
07-09-2013, 10:00 PM
LOL Mike,When I embarked on this mission I thought It would be easy reading, but the sheer amount of white papers I have been going through is making my head spin too!xI am almost done with figuring out all 3DMark tests, I even got some pcmark formulas now. I am trying to build a calculator with most futuremark bench tests in it. The only thing you need than is to put in the raw fps for each subtest and the scores will all be calculated. to be continued...

Henkenator68NL
07-25-2013, 05:07 AM
Hi Guys, as promised, I completed my score calculator, as off now it contains Futuremark 3D: The Score Calculator 3D Bench Mark Tests, I will add more tests (also PCMARK etc later on).

I created a separate thread for the Calculator, under the general forum area, to make it more easy to find and available for all forum members. You can find it here: http://rog.asus.com/forum/showthread.php?35181-Tool-Score-Calculator-for-3D-Benchmark-Tests-Calculate-your-Scores-!!

Let me know what you think of it!

HiVizMan
07-25-2013, 09:59 AM
Don't like the colour, want it more Rose or Pink please :D :D

Dr_Manhattan
02-15-2014, 11:52 PM
Hi Henk,

Have you monitored the CPU utilization during the Firestrike Physics test?

I have identified that CPU utilization in my i7 2600k @ 4.6Ghz won't pass 84% utilization.

My framerate when i used a ASUS Maximus IV Gene-Z was 37 FPS but after a problem i have replaced the mobo to a new Maximus V Gene and formated the PC with Win7 64bit and now the score never pass 33 fps, except....

During some tests i have discovered that enabling vsync specifically for firestrike physics my fps goes up to 36.7 fps (without any hardware change)

My gpu is an AMD R9 290 and i have tested all drivers from AMD but all of them has the same results.

Did you see the same behavior in your tests? (CPU utilization, vsync on/off)?

Henkenator68NL
02-17-2014, 06:18 PM
Hi Dr-Manhattan,

I did some testing to see if the CPU usage goes to 100% during the Physics test. I have done the tests with win 8.1 installed, the settings all to stock (-> in BIOS F5 loaded optimal settings). So no overclocking what so ever to keep the results clean.

The first results prove your point! The Physics test does indeed not use the CPU to its full potential, something I did not notice before. The highest (average) CPU usage I saw was 90%. However this is all done with all power saving options in the BIOS in place, so maybe the fact that the CPU has to ramp up, it doesn't reach the 100% usage. I will do some more testing.

As for Vsync, this setting is indeed know to cause differences in Benchmark Results, so its Always a good idea to try it with both Vsync on as off and see the results. For the Physics test this setting increased the score by about 900 points.

Here are the results from 6 independent 3DMark Firestrike Extreme Physics tests, all sensors are logged by AIDA64.

33466
33467

Dr_Manhattan
02-17-2014, 08:03 PM
Hi Henk,

Good to hear that im not the only one with this behavior.
I have analyzed the 3dmark process during the tests and i see a lot of ContextSwitch from the startup thread and the other threads.
This means that startup thread or mother thread need to wait the processing of all other threads to send the result to the output, this could be the problem of not fully utilizing the CPU during the test.
But the most weird behavior is the vsync on be faster than vsync off.
As vsync-on means the process wait for a specific screen refresh a vsync-off should be faster as the process dont need to wait for a screen refresh or at least the driver dont need.
Why this is happing?

Anyway, thanks for the tests!

Now will be a good idea to see if NVIDIA users has the same behavior. :-)

Dr_Manhattan
03-13-2014, 05:19 PM
Hi Henk,

Navigating i found some people with the same problems and they reported that disabling powerplay the have solved the problem.
What look like some problem related with the 2D clocks with AMD GPUs that when running Physics test can interfere with the results.
I have made some tests and really when the Physics test is running the GPU lower the clock to 300Mhz.
But now i need to configure the GPU to run the clock 947Mhz all the time and test again to see if the score increases.

This could be a bug in the AMD drivers that when running powersave mode the latency increases and this is impacting the results in Firestrike Physics.

Dr_Manhattan
03-26-2014, 01:09 PM
Hi Henk,

Futuremark has replyied my thread about this problem.
They got a programmer to deep dive into this bug.
If you are interested in participate in the tests, send an e-mail to info [at] futuremark.com and inform the thread Physics.
More info: http://community.futuremark.com/forum/showthread.php?179781-Physics&p=1815298#post1815298

Henkenator68NL
03-26-2014, 04:51 PM
Hey! Thanks for sharing I will have look. I was doing some testing, and indeed powerplay seems to help. But I am still testing some things.