constantly increasing memory usage

[dlegion 98]

yes!
i reproduce it now, and upoload it to..."pastebin" (didnt knew about it....googling it now, will do it!)
gimme 5 minutes!
thanks man !

[dlegion 98]

ok i think here is pastebin:
https://pastebin.com/0w49KLcS
thanks man !!

[das attorney 858]

Ok I think I know what's up.

 

You're launching the 32 bit server executable (arma3server.exe) and it hits it's memory limit then runs out of memory.

 

You can use the 64bit version (arma3server_x64.exe) which will be able to address more than 2 or 3GB of memory.

 

You can do that in tadst on the server file parameter (look at the picture on that link)

 

 

[dlegion 98]

man you're really a genious!
a simply solution but i would never had thinked in that direction!!
ULTRA-HUGE-TERA-THANKS!!!

i'm gonna test it as soon as i get back to my main PC!!  thanksssssssss!

[Grumpy Old Man 3546]

This could have been solved after the first post.

Please add as much info as you can the next time you post something, as das attorney said, running a 32bit server app when there's a 64bit one available is the reason for your "choking".

 

Most interesting I just discovered that I've been using the 32bit file all the time with TADST to test my missions, never experienced any performance issues.

Using the 64bit dedi server the idle RAM usage has increased to 2.6gb, now that's more like it.

 

Cheers

 

[dlegion 98]

ok you right, sorry Grumpy!
i've just tested, it keeps increasing also with x64! (starts from way higher values).
i made also screenshot of my desktop with taskmanager open :

Spoiler

https://ibb.co/gz80XF
https://ibb.co/ng2usF
https://ibb.co/g8husF
https://ibb.co/gwC5zv

the relevant ones are the 3rd and 4th screenshot (mission was running)
PS: in the time i writed the post, it reached 3.268.306kb now. its still lowly increasing.
 

[Grumpy Old Man 3546]

Should be fine now, while 12gb ram isn't all that much, especially since you seem to play on the same machine on top of running a dedi on it.

 

Cheers

[dlegion 98]

hem...sorry but its not fine at all!
sure the test mission increase at a very low rate, so it will probably run for more than a day without choke even on 32bit.
but my mission spawn and de-spawn units based on player distance, depending by situation it can last less than 1 hour even with x64 !
EDIT:
i'm re-writing all useful info....will update first post soon...
 

[das attorney 858]

If it isn't crashing and levels off at some point, then that's ok.

 

Arma loves RAM and can use as much as 7GB (That I've personally seen), maybe more.

 

If it's still crashing, then you might be better off opening a ticket on the tracker, including a test mission and crashlogs/rpt.

[dlegion 98]

yep, i think i will have to open a ticket :(
i ask to you guys a last favour about this tragic problem: can you please do 2 tests and report the exact results (so i can post them in the ticket)?
TEST 1 : test described "test" mission on dedicated server
TEST 2 : test my mission on dedicated server: https://mega.nz/#!KtZ2GLiQ!-PxDcaPxXqjeuAaSeUEk2YT1e-UDZf22TXr0dhrVS5E

i updated all the info i have in the first post, here's a copy:

Spoiler

PROBLEM DESCRIPTION:
dedicated server memory usage keeps increasing at a variable rate apparently influenced by number of AI in mission.
it keeps increasing more or less constantly and endlessly. on 32bit "arma3server.exe" when over 2000MB it start to choke, decreasing down to 2 FPS,
and ultimately crashing with htis error:   https://ibb.co/k30HBa

3D EDEN CREATED TEST MISSION from NEW (empty):
(lets ignore my mission for now, and focus on standard test): Altis, 6 WEST rifle quads (8 men each) 4 WEST combined tank platoon (4 tanks each), 3 playable units,
 all with a move waypoint and a cycle waypoint. (can double the numbers to accelerate the process).

WHAT I DID EXACTLY STEP BY STEP TO REPRODUCE THE PROBLEM:
launch TADST v3.0.0, leave default settings (for testing purposes) checked box "persistent battlefield" and "auto-init",
selected "arma3server.exe" and tried also with "arma3server_x64.exe". (different starting memory usage, but both were increasing).
selected previously created TEST mission. Launched the server. Opened the windows task manager.
keeps monitoring the "arma3server.exe" process memory usage. Notice slow, but pretty constant increase in memory usage.

WHAT OTHER TEST I DID:
i tested my mission with all my scripts (and they are many) except the ones spawning AI. in my mission all AI is spawned by script, so there were 0 AI.
server did not had increasing memory usage.
i tested an old mission version (more than 6 months ago), that i'm sure it was running fine for at least 24 hours
(i remember playing on it with friends one night, then forgetting server up, then the following evening playing again on it with friends).
the test now showed a memory usage increasing.
i tested other missions made in the past, i dont have any documented previous check on them about memory usage, but now its increasing at various rate,
apparently related to numbers of AI.

MY HARDWARE / SOFTWARE / CONFIG ecc...
i5 4440 3.10ghz, 12Gb ram, 64bit, NO-SSD, connection: ADSL 7Mb upload 0.4Mb download.
(its the same configuration i had at the time of the 24 hours server running with no problem)
i always used 32bit "arma3server.exe" except for the very latest test.

-------------- T E S T S -----------------------------------------
DWAR 20/07/2017 NO SCRIPTS                   = 848 MB seems stable
DWAR 20/07/2017 with R3F_LOG & MAG_REPACK    = 849 MB seems stable
DWAR 20/07/2017  +   minedetector            = 849 MB seems stable
DWAR 20/07/2017  +   Dfps                    = 849 MB seems stable
DWAR 20/07/2017  + Dclean & mineMarker       = 850 MB seems stable    // another test : 888.260 at 12:58 -- 895.288 at 13:11 -- 897.788 at 13:58 -- 897.884 at 14:06 -- 897.760 at 14:14 -- 897.836 at 14:25

DWAR 20/07/2017  +   GMOhostages             = 875 MB slowly increased to 912 in 15 minutes (spawned 9 units + 1 tank)....when deleted (by script after 30 minutes) memory stays at 910Mb
DWAR 20/07/2017  +   HQBtroops+HQRtroops     = 928 MB increasing 3MB every 1 minute (spawned 4 APC with crew)
DWAR 20/07/2017  +   GMOreset                = 1000 MB increasing 1Mb every 10 seconds (spawned 51 soldiers + 1 tank + 1 helicopter)
DWAR 20/07/2017  +   Dvehspawner.sqf         = 1110 MB constantly increasing 1 Mb every 1-3 seconds (spawned 2 helicopters, 2 airplanes, 8 civs on foot, 8 civs in cars, 2 apc, 2 soldiers, 2 boats)

 

 

TEST MISSION WITH FEW AI PLACED FROM EDITOR (48 AI + 16 tanks):
908 MB at 08:16
919 MB at 08:50
921 MB at 09:00
924 MB at 09:36

------------------------------------------------------
DLEGION DWAR mission (MORE UNITS AND THEY RESPAWN):
1080 MB at 12:03 (in game time)   
1250 MB at 12:13
---2----------
1100 MB at 12:03
1256 MB at 12:13
1264 MB at 12:15
1490 MB at 13:12
1536 MB at 13:26
1611 MB at 13:41
-------3-----------
1240 MB at 00:24
1501 MB at 00:58
1546 MB at 01:03
1621 MB at 01:24
1662 MB at 01:35
-------4------------
1150 MB at 00:33
1208 MB at 00:38
1283 MB at 00:47
1349 MB at 01:00
... 6 hours later (or less), server crashed with "out of memory" error

----------------------------------------------------

AN OLD XENO DOMINATION mission (FEW AI COMPARED TO THE OTHERS, BUT STILL PRESENT):
1684 MB at 09:54
1759 MB at 10:03
1786 MB at 10.13
1800 MB at 10.40
1853 MB at 14:45

 

 

thanks guys! i'm really desperate...all the work on my mission i made in last 2 years is getting wasted...its really tragic for me!

[dlegion 98]

...here it is the test made with arma3server_ x64.exe :

3248000 at 14:54
3579000 at 14.57
3934000 at 15:18
4175000 at 15:50
4499000 at 17:45
4577000 at 18:02
4613000 at 18:10
4864000 at 20:20

....still increasing...

[dlegion 98]

well i got answer from a friend, he did TEST 1...memory usage increases also for him

he has an i7, 16GB ram, and a 100MBdownload  20mb upload connection.
we can say its not related to connections!

[dlegion 98]

@das attorney man... following your suggestion i posted on tracker. So i just noticed i was already registered at tracker....i had an issue with desync from 19 June 2016, still assigned to "none".
i got to lose my hope?

[kremator 1065]

I would search to see if there are posts already on memory usage increasing. I bet there are! 

[dlegion 98]

yep, using keywords "memory" and "leak" a huge amount of posts come out.
seems this game is beyond the no-return line....plagued by so many problems...and devs keeps trying to sell us DLC.
really sad.
at least i found a fun video:

 

[dlegion 98]

...noone else has tested and can confirm the problem / has not the problem ?

[Grumpy Old Man 3546]

22 hours ago, dlegion said:

yep, using keywords "memory" and "leak" a huge amount of posts come out.
seems this game is beyond the no-return line....plagued by so many problems...and devs keeps trying to sell us DLC.
really sad.
at least i found a fun video:

 

 

You do realize that this issue has long been resolved?

 

What was the result of your test?

Memory increased? That's not really surprising for a mission that's been running for hours.

As das attorney said, as long as the server keeps running without any fps drops or crashes it should be fine.

Using memory isn't a bad thing.

 

Cheers

[dlegion 98]

mah ... i think we dont understand eachother....afterall i think i explained it quite well at this point.

for sure 9 months ago (can be 6 , but i dont remember the exact date, so lets say 9) it was working perfectly (and i always used 32bit).
now same "old" mission does not. (crash in less than 7 hours)
so..something wrong. it can be a problem on my side (my RAM, my PC, my connection ecc...) but probably is not, because a trysty friend tested and had same result.

cant understand why try to deny the problem, but it exist (at least here on my PC). and its not "standard" because if you try to let the mission run, you will discover that soon or later it will crash.
its ok not being able to solve it, you are all here in your free time, and i appreciate anyway.
if you want to help more, just do the test (maybe double the numbers if you have a powerful PC, something like 12 rifle squads and 8 tank platoons) and post the detailed result. that will be very useful information not just for me, but for devs too if they decide to take a look at that trouble (honestly i think they will ignore also this problem, but i can t do anything else).
thats all, thanks anyway!

[kremator 1065]

Have you tried running the mission in 32 bit and see what happens ?  If there isn't a problem with 32bit then devs need to look at the issue.

[dlegion 98]

yep, all my tests were made in 32 bit except the last 3 tests (i didnt knew about x64 bit at the time). in fact i can ask my friend to test the 32 bit too, because he is way more techy than me and was already using x64!
good idea! thanks!

[pierremgi 4888]

20 hours ago, dlegion said:

mah ... i think we dont understand eachother....afterall i think i explained it quite well at this point.

for sure 9 months ago (can be 6 , but i dont remember the exact date, so lets say 9) it was working perfectly (and i always used 32bit).
now same "old" mission does not. (crash in less than 7 hours)
so..something wrong. it can be a problem on my side (my RAM, my PC, my connection ecc...) but probably is not, because a trysty friend tested and had same result.

cant understand why try to deny the problem, but it exist (at least here on my PC). and its not "standard" because if you try to let the mission run, you will discover that soon or later it will crash.
its ok not being able to solve it, you are all here in your free time, and i appreciate anyway.
if you want to help more, just do the test (maybe double the numbers if you have a powerful PC, something like 12 rifle squads and 8 tank platoons) and post the detailed result. that will be very useful information not just for me, but for devs too if they decide to take a look at that trouble (honestly i think they will ignore also this problem, but i can t do anything else).
thats all, thanks anyway!

 

 

Or, perhaps, you just garble your own message with lot of tests, speaking about old homemade missions. If you want to demonstrate something, may I suggest you to avoid test with R3F logistics or any mod (see your last link) ?

I guess BI will do something if there is something new on Arma vanilla + arma3server. Not sure TADST is a brand new 64bit tool, but sure you can't ask BI to test something else than BI tools.

Perhaps, you're speaking about vanilla basic scenarios and arma3server.... but it's totally garbled by too much aside considerations,IMHO.

[dlegion 98]

heh...ok english is not my first language, and i explained problem at my best, supported with as much information as i could, posted also on tracker, and at this point i really dont know what else do.
so... dont worry, for sure its my fault, maybe its just me having bad luck, and probably on all your PC everything works fine. Grumpy saied it works for him, didnt posted any detailed spec, but i want to belive him.
my friend say it has increasing memory usage, maybe he is just another unlucky guy, wished to hear more feedback, but seems noone else really tried.
just to be clear, its written quite clearly in tests, that removing only all my scripts generating AI, and keeping all the others (like R3F_logistic) and running the server, did NOT increased memory usage, but at this point doesnt really matters.

after 16 years of OFP, i know that if something is wrong, it will stay wrong. if something works, will probably be screwed in a future patch. so thats my stop for ARMA3. i already did it for resistance and for ARMA1.
dunno if i can go back ARMA2, but i have to try.

i really wish to THANK YOU guys for all your help in the time, i really appreciated and i really admire your dedication!   ...maybe we will shoot eachother in ARMA4 someday !


PS: yesterday, i tried to play on an official server....its a really boring video, but if you're curious, here's what happened to not just me, but many other players...

 

[Grumpy Old Man 3546]

1 hour ago, dlegion said:

heh...ok english is not my first language, and i explained problem at my best, supported with as much information as i could, posted also on tracker, and at this point i really dont know what else do.
so... dont worry, for sure its my fault, maybe its just me having bad luck, and probably on all your PC everything works fine. Grumpy saied it works for him, didnt posted any detailed spec, but i want to belive him.

 

English isn't my first language either.

My current specs are i7 4770k @4.6ghz, 16GB RAM, gtx 1080 on an asus p8b mainboard and windows 10 x64.

 

You're just talking around a dozen corners, cut to the chase.

Did your PC/your friends PC crash with the 64 bit server exe? Did you try a fresh install?

With all these random unrelated videos you're just derailing your own thread, all that lamenting isn't helping either.

 

Cheers

 

[engima 328]

Hi dlegion

 

I made a vanilla MP mission and added a tank platoon, an infantry platoon, a mechanized infantry platoon and a single tank and gave them all cycle waypoints. I created a description.ext and started up an x64 dedi. Here is the mission file:

https://1drv.ms/u/s!AghoX-F5MMIR43uBoOnhb9zzoquG

 

And here is the result:

0 min:  2744 MB
5 min:  2757 MB
10 min: 2766 MB
15 min: 2769 MB
20 min: 2770 MB

 

It is clearly leveling off. Du you get the same result? One difference is that this is not started with "Persistent Battlefield". Is that option the problem?

[dlegion 98]

huge thanks man!!
i'm going to test this mission right now with and without "persistant battlefield" !
will update here with results!
thanks !