PvPscene Benchmark Suite

[humvee28 10]

NP. ;)

It will be surely a little bit of everything what you´ve said plus the Fact that we don´t have all the same System + Configuration. And even if this would be the Case, some People would trying to do more than only start the Game by taking care of the Stuff around it, and some People would not, what would end in total different Results also, even with the same Hardware. Only my Thoughts. :)

[humvee28 10]

If someone get Problems with the Loadtimes of the Database like i had,

this could maybe an Option for you (scroll down to the last Article and follow the Instructions) :

http://blog.editgrid.com/tags/help

Solved my Problems.

[.kju 3240]

Good find. Helps a lot here too. Thanks!

Add results for all allocators for my system.

[humvee28 10]

I´m on it too. tbb3 & 4 finished, i´m on the new Allocators now. :)

[.kju 3240]

Updated the suite:

• You can specify CUSTOMMODS in _configureSettings.bat.
  
• Better rpt output for easier transfer to the online database.
  

Download link in the first post.

[Guest]

= PvPscene Benchmark Suite

1) Download the suite.

That link gives a 404, can you please fix it?

[.kju 3240]

done. thanks for the note

[.kju 3240]

Added results for 1.60.86873 with all allocators (that work for me). See line 143ff.

---------- Post added at 07:39 ---------- Previous post was at 07:31 ----------

Updated the suite:

• Added: BI SPE1 Benchmark mission and batch to test all allocators.
  
• Added: sample CUSTOMPARAMS.
  
• Added: batch to test all allocators on the full suite.
  

Download link in the first post.

[.kju 3240]

http://www.editgrid.com/user/kju/PvPscene_Benchmark_Suite

L163 added for latest betas for TBB4 (default).

with

PPAA=3;

PPAA_Level=3;

[Jigsor 175]

As per Kju's suggestion here, I've made some changes to try to this make mork with A3.

I've gotten it to run but only see a blank windowed A3 screen. I can hear ambient environment effects as normal.

_configureSettings.bat

rem ----------------------------------------------
rem - Only change the text after the equals sign -
rem ----------------------------------------------

rem BE CAREFUL: _NO_ trailing slash in the path.
set PATHTOARMA=c:\Program Files (x86)\Steam\SteamApps\common\Arma 3

rem User specific startup parameters
rem http://community.bistudio.com/wiki/Arma2:_Startup_Parameters

set CUSTOMPARAMS="-profiles=c:\Program Files (x86)\Steam\SteamApps\common\Arma 3" -window "-

name=autotest"

rem User specific modfolders
set CUSTOMMODS=@CBA_A3;@A3MP;@a3mp_ap

rem You can select the mission suite here.
set MISSIONS=autotestAll.cfg

rem autotestAll.cfg
rem autotestChernarus.cfg
rem autotestProvingGrounds.cfg
rem autotestTakistan.cfg
rem autotestZargabad.cfg
rem autotestVegetation.cfg

run.bat

CALL _configureSettings.bat

cd /D %PATHTOARMA%

"%PATHTOARMA%\arma3.exe" -nosplash -skipintro -world=empty -noFilePatching %CUSTOMPARAMS% -mod=%CUSTOMMODS% "-autotest=%PATHTOARMA%\autotest\PvPscene_BM\MissionSets\%MISSIONS%"

.rpt Download

Edited October 13, 2014 by Jigsor

[.kju 3240]

@ Jigsor

The rpt seems from a different session as this is the modlist from it:

@prpl_BenelliM4

@fallujah

@A3MP_AP

@VTS_WeaponResting

@UK_SFTG_A3

@Trixie_XM8

@Trixie_Rifles

@trixie_recon

@Trixie_Launchers

@rh_pistol_a3

@prpl_famas

@lsd_nvg

@kio_balaclava

@hlcmods_M60E4

@hlcmods_m14

@hlcmods_g3

@hlcmods_fal

@hlcmods_core

@hlc_ar15

@ASDG_JR

@USMC_A3

@NATO_Russian_SF_Weapons

@CBA_A3

@A3MP

Would be good if you report the errors of the custom mods to their authors:

Animation hlcweapons\newgestures\mp5sd_reload2.rtm not found or empty

Cannot find a sound file a3\sounds_f\weapons\other\dry6.wav

Cannot load sound 'a3\sounds_f\characters\human-sfx\p03\breath_mid_6.wss'

Cannot load sound 'a3\sounds_f\characters\human-sfx\p03\breath_mid_7.wss'

Cannot load sound 'a3\sounds_f\vehicles\soft\van_01\van_01_door.wss'

Cannot load sound 'a3\sounds_f\weapons\closure\closure_rifle_6.wav'

Cannot load sound 'a3\sounds_f\weapons\closure\closure_rifle_7.wav'

Cannot load sound 'a3\sounds_f\weapons\other\dry6.wav'

Cannot load sound 'a3\sounds_f\weapons\shells\5_56\asphlat_556_01.wav'

Cannot load sound 'a3\sounds_f\weapons\shells\5_56\asphlat_556_02.wav'

Cannot load sound 'a3\sounds_f\weapons\shells\5_56\asphlat_556_03.wav'

Cannot load sound 'a3\sounds_f\weapons\shells\5_56\asphlat_556_04.wav'

Cannot load sound 'a3\sounds_f\weapons\shells\5_56\grass_556_01.wav'

Cannot load sound 'a3\sounds_f\weapons\shells\5_56\grass_556_02.wav'

Cannot load sound 'a3\sounds_f\weapons\shells\5_56\grass_556_04.wav'

Cannot load sound 'a3\sounds_f_epb\tracked\noises\get_in_out.wss'

Cannot load sound 'a3\ui_f\data\sound\new1.wss'

Cannot load sound 'a3\ui_f\data\sound\onclick.wss'

Cannot load sound 'a3\ui_f\data\sound\onover.wss'

Cannot load sound 'rh_m4\sound\m4_reload.wss'

Cannot load sound 'rh_m4\sound\m4_selector.wav'

Warning Message: Cannot load texture hlc_wp_ak\tex\gp30\gp30_as.paa.

Warning Message: Cannot load texture hlc_wp_ak\tex\gp30\gp30_co.paa.

Warning Message: Cannot load texture hlc_wp_ak\tex\gp30\gp30_nohq.paa.

Warning Message: Cannot load texture hlc_wp_ak\tex\gp30\gp30_smdi.paa.

Warning Message: Error: creating magazine hlc_10rnd_12g_buck_S12 with scope=private

Warning Message: Error: creating weapon R3F_SILENCIEUX_FAMAS with scope=private

Warning Message: Error: creating weapon R3F_SILENCIEUX_FAMAS_DES with scope=private

Warning Message: Error: creating weapon RH_M16A4_m with scope=private

Warning Message: Error: creating weapon RH_SFM952V with scope=private

Warning Message: Error: creating weapon RH_ta31rco_2D with scope=private

Please locate the correct rpt and upload it (delete all first, before you do a run).

[Jigsor 175]

Appologies kju, .rpt download link corrected.

[.kju 3240]

@ Jigsor

No worries. :)

The problem is this:

Warning Message: autotest\PvPscene_BM\PvPscene_BM_City.Chernarus\mission.sqm/Mission/Groups/Item0/Vehicles/Item0.vehicle: Vehicle class USMC_Soldier no longer exists

Type USMC_Soldier is not VehicleType

Open all files in .\autotest\PvPscene_BM that contain USMC_Soldier and replace it with B_Soldier_F.

I would do it with PowerGrep or AgentRansack plus EditPadPro.

[Jigsor 175]

Thank You kju, all working now.

All instances of USMC_Soldier were found with Multifind and changed to B_Soldier_F.

The whole test is lengthy but very nice. After glancing over results. It does not seem to reflect my ingame experience. For example there are no tests of camera starring off into the sky, edge of map, or region which excludes map objects to be able to measure fps with little to no load. Also would be nice if some how all fps results from each test could be averaged for 1 final result.

results:

-mod=@CBA_A3;@A3MP;@a3mp_ap

.rpt

-mod=@CBA_A3;@AllInArmaTerrainPack

.rpt

[.kju 3240]

Thanks a lot Jigsor!

Quite interesting result. For some reason Chernarus in AiA seems to have 5-15% slower average FPS compared to A3MP.

The other terrains are more less on the same level. Best guess would be the A3 grass, SMD buildings, custom lighting.

The length is to ensure reliable and comprehensive results. The tests you describe are not really meaningful IMHO.

One result does not work for average FPS - you have too many different scenarios; it would skew the impression.

The online DB had percentages though and there also an average percentage.

Unfortunately it seems the site/company went bust.