-DirTyDeeDs--Ziggy- 0 Posted March 22, 2011 Added my results with the latest version (1.59.79122). It is actually considerably less FPS (10%) - even though I had PP disabled. PvPscene_Benchmark_Suite I assume it has something to do with your AA setting (normal) and the AToC: [77289] Improved: Vegetation rendering using AToC (require antialiasing enabled) Share this post Link to post Share on other sites
.kju 3240 Posted March 22, 2011 See the edit. AToC is not in for 1.57 full, yet there is also results for 1.58 betas and 1.58 RC in there. Share this post Link to post Share on other sites
ginger mcale 11 Posted March 23, 2011 Hey, outstanding work kju. Finally an excellent benchmark possibility where we can compare cause of identical graphic settings (if given). Thank you so much! I did setup my graphical settings as requested and did let run it through with the latest beta for 1.57 (1.57.78188) and render frames ahead 1. Results posted to the online database. Hopefully more people will post their results with the requested graphical settings so we can compare and see how much our hard earned money spend on hardware is making a difference in overall and average FPS in ArmA. Improvement ideas / suggestions: - shorter time needed for the benchmark (to make it more attractive to people, maybe a benchmark lite version) - automated script where you can paste your raw RPT data into. It will parse the results and enter it into a database - maybe one database for your requested graphical settings so we can compare easy different hardware specs and an extra one for custom graphical settings Raw RPT data ===================================================================== == C:\ArmA 2\Expansion\beta\arma2oa.exe == "C:\ArmA 2\Expansion\beta\arma2oa.exe" -nosplash -skipintro -world=empty -noFilePatching -mod=Expansion\beta;Expansion\beta\Expansion "-autotest=C:\ArmA 2\autotest\PvPscene_BM\MissionSets\autotestAll.cfg" ===================================================================== Exe timestamp: 2011/03/10 14:59:22 Current time: 2011/03/23 17:52:49 Version 1.57.78188 Item str_disp_server_control listed twice Updating base class ->ReammoBox, by ca\weapons\config.bin/CfgVehicles/WeaponHolder/ Warning: looped for animation: ca\wheeled\data\anim\uaz_cargo01_v0.rtm differs (looped now 1)! MoveName: uaz_cargo02 "Type avg fps avg min highest lowest" "Preloading 43 32 57 11 PvPscene_BM_City (Chernarus)" "Type avg fps avg min highest lowest" "Benchmark 52 41 78 13 PvPscene_BM_City (Chernarus)" "Type avg fps avg min highest lowest" "Preloading 54 45 82 11 PvPscene_BM_Coastline (Chernarus)" "Type avg fps avg min highest lowest" "Benchmark 55 49 85 11 PvPscene_BM_Coastline (Chernarus)" "Type avg fps avg min highest lowest" "Preloading 57 39 93 12 PvPscene_BM_OpenFields (Chernarus)" "Type avg fps avg min highest lowest" "Benchmark 61 52 101 12 PvPscene_BM_OpenFields (Chernarus)" "Type avg fps avg min highest lowest" "Preloading 56 44 76 11 PvPscene_BM_Woods (Chernarus)" "Type avg fps avg min highest lowest" "Benchmark 57 48 81 12 PvPscene_BM_Woods (Chernarus)" "Type avg fps avg min highest lowest" "Preloading 65 50 88 14 PvPscene_BM_City (takistan)" "Type avg fps avg min highest lowest" "Benchmark 71 54 91 12 PvPscene_BM_City (takistan)" "Type avg fps avg min highest lowest" "Preloading 56 47 82 11 PvPscene_BM_OpenFields (takistan)" "Type avg fps avg min highest lowest" "Benchmark 55 52 75 12 PvPscene_BM_OpenFields (takistan)" "Type avg fps avg min highest lowest" "Preloading 66 55 87 14 PvPscene_BM_Woods (takistan)" "Type avg fps avg min highest lowest" "Benchmark 66 61 87 19 PvPscene_BM_Woods (takistan)" "Type avg fps avg min highest lowest" "Preloading 58 47 64 15 PvPscene_BM_LongViewDistance (takistan)" "Type avg fps avg min highest lowest" "Benchmark 59 52 65 40 PvPscene_BM_LongViewDistance (takistan)" "Type avg fps avg min highest lowest" "Preloading 53 39 67 11 PvPscene_BM_City (Zargabad)" "Type avg fps avg min highest lowest" "Benchmark 57 39 72 9 PvPscene_BM_City (Zargabad)" "Type avg fps avg min highest lowest" "Preloading 47 37 77 12 PvPscene_BM_OpenFields (Zargabad)" "Type avg fps avg min highest lowest" "Benchmark 50 46 66 18 PvPscene_BM_OpenFields (Zargabad)" "Type avg fps avg min highest lowest" "Preloading 31 27 35 9 PvPscene_BM_LongViewDistance (Zargabad)" "Type avg fps avg min highest lowest" "Benchmark 31 27 36 16 PvPscene_BM_LongViewDistance (Zargabad)" "Type avg fps avg min highest lowest" "Preloading 44 31 52 13 PvPscene_BM_OpenFields (ProvingGrounds_PMC)" "Type avg fps avg min highest lowest" "Benchmark 45 39 54 10 PvPscene_BM_OpenFields (ProvingGrounds_PMC)" Share this post Link to post Share on other sites
kremator 1064 Posted March 23, 2011 I agree with Ginger in being able to parse the raw RPT data easily. A simple copy/paste regime and I'll do benchmarks all day :) I don't necessarily agree with having shorter test times however. A good test SHOULD take time. Share this post Link to post Share on other sites
.kju 3240 Posted March 24, 2011 I use EditPadPro to remove the duplicate lines and this regex to make it the format needed: Search: (\d+ \d+ \d+ \d+) (\d+ \d+ \d+ \d+) (\d+ \d+ \d+ \d+) (\d+ \d+ \d+ \d+) (\d+ \d+ \d+ \d+) (\d+ \d+ \d+ \d+) (\d+ \d+ \d+ \d+) (\d+ \d+ \d+ \d+) (\d+ \d+ \d+ \d+) (\d+ \d+ \d+ \d+) (\d+ \d+ \d+ \d+) (\d+ \d+ \d+ \d+) (\d+ \d+ \d+ \d+) (\d+ \d+ \d+ \d+) (\d+ \d+ \d+ \d+) (\d+ \d+ \d+ \d+) (\d+ \d+ \d+ \d+) (\d+ \d+ \d+ \d+) (\d+ \d+ \d+ \d+) (\d+ \d+ \d+ \d+) (\d+ \d+ \d+ \d+) (\d+ \d+ \d+ \d+) (\d+ \d+ \d+ \d+) (\d+ \d+ \d+ \d+) Replace: \1 \3 \5 \7 \9 \11 \13 \15 \17 \19 \21 \23 \2 \4 \6 \8 \10 \12 \14 \16 \18 \20 \22 \24 Sure it should be more automated - however you need to find someone up to the task. Unfortunately Mac has lots of work at this job and no motivation for arma coding these days. So again it should be rather easy for someone to write a script that formats the rpt output to make it simply copy and paste to the online sheet. Share this post Link to post Share on other sites
gambla 10 Posted March 30, 2011 (edited) Hi, nice benchmark, good work. What i'm missing is "Terrain Detail" and "Visibility" ? And i don't know where to find "MFtRA" and "AToC". Thanks! Edited March 30, 2011 by gambla Share this post Link to post Share on other sites
.kju 3240 Posted March 30, 2011 TD and visibility are set in the mission itself to ensure same conditions for everyone. MFtRA (Max Frames to Render Ahead) AToC: http://community.bistudio.com/wiki/arma2.cfg#Example And use the forum search in here. A couple of people explained it really well. Share this post Link to post Share on other sites
.kju 3240 Posted April 6, 2011 Added three more - with latest beta of 1.59 with all three different HDR settings. Normal and high seems the same here, while very high (32 bit) reduces FPS by 5-10%. http://www.editgrid.com/user/kju/PvPscene_Benchmark_Suite Share this post Link to post Share on other sites
.kju 3240 Posted July 15, 2011 (edited) Added 1.59.82604. Interesting observation is while average FPS remains the same 1.59 release, the average minimum FPS is up 10% for me. Edited July 15, 2011 by .kju [PvPscene] Share this post Link to post Share on other sites
kremator 1064 Posted July 15, 2011 Interesting indeed. Something to do with predictive positioning for AI? Can't be that surely as that is just in MP. Good find though. Share this post Link to post Share on other sites
.kju 3240 Posted July 15, 2011 The benchmark suite contains NO AI test mission so far. :) Share this post Link to post Share on other sites
kremator 1064 Posted July 15, 2011 DOH.... you are right. Can't be that then. Sorry, brain not working right! Share this post Link to post Share on other sites
MavericK96 0 Posted September 17, 2011 Crossposting from the beta thread: I tried running your benchmarking tool, and as soon as the game loads up it says "PLEASE WAIT" and I see white and black lines scrolling endlessly down the screen. I assume this is not correct? I even did a shorter test run (just Vegetation) and waited for a long time, and it never disappeared or changed in any way. Share this post Link to post Share on other sites
.kju 3240 Posted September 17, 2011 You need CO to run the full suite. Either remove all Chernarus test classes from the autotestAll.cfg, or set an OA only cfg in the _configureSettings.bat. autotestVegetation.cfg uses both A2 and OA - so again it requires CO. Share this post Link to post Share on other sites
MavericK96 0 Posted September 18, 2011 I do have CO... Share this post Link to post Share on other sites
MavericK96 0 Posted September 19, 2011 I checked the rpt and it does seem like it's not loading CO, even though I do have it. The problem appears to be that, despite requiring CO, it does not attempt to load it in the .bat files provided with the benchmarking tool. I will try adding custom command lines to enable CO, but you might want to edit the default .bat files to do it automatically. Kind of confusing. Share this post Link to post Share on other sites
.kju 3240 Posted September 19, 2011 You can add the absolute path to your arma2 folder in the modline like: -mod=c:\path\to\arma2;expansion Share this post Link to post Share on other sites
MavericK96 0 Posted September 19, 2011 Yeah, what I ended up doing is just adding the "-mod:C:\arma 2;EXPANSION;ca" to the custom parameters of the benchmarking tool. Anyway, after doing that I ran the Vegetation test on 1.59 stock and the latest beta (84628). Results were...not that varied. Basically the beta has 0-1 fps increase over 1.59, but the most noticeable result was that the minimum FPS in the beta was 0-2 FPS lower than 1.59. Could account for some of the extra lag that seems to be noticeable in the beta (for me at least). Share this post Link to post Share on other sites
.kju 3240 Posted October 31, 2011 Added my results for latest 1.60 beta (85876) and the different memory allocators: http://www.editgrid.com/user/kju/PvPscene_Benchmark_Suite (Line 93ff) Share this post Link to post Share on other sites
humvee28 10 Posted November 1, 2011 I don´t get a clue how to use the DB right. I have read all related Posts, but i still don´t get it. Share this post Link to post Share on other sites
.kju 3240 Posted November 1, 2011 Just copy a block of four lines of an existing entry to the end of the sheet. Now you copy and paste your results from the rpt into the data fields. Share this post Link to post Share on other sites
humvee28 10 Posted November 1, 2011 TY :) First Bench up. Further Benching. :) Share this post Link to post Share on other sites
humvee28 10 Posted November 2, 2011 Added my Benchmarks on 85889 (tbb4 with Catalyst 11.9 + 11.10, tbb3) and the comparsion with them against 85680. http://www.editgrid.com/user/kju/PvPscene_Benchmark_Suite (Line 213 - 231) Share this post Link to post Share on other sites
.kju 3240 Posted November 2, 2011 Thanks Humvee28! Always good to see consistent result. The catalyst update does not change much - as to be expected. The more interesting part is that you also get basically the same performance with TBB3 and TBB4. Either it is very OS/system related, or these benchmark mission do not measure the differences well/at all, or the people claiming to see huge differences are only believing to see improvements without it being true. Share this post Link to post Share on other sites
