ArmA3Sync - launcher and addons synchronization software for ArmA 3

[JustCarl 10]

Not really a bug report but a question....How can i prevent this from happening when i update my repo?

[major_shepard 82]

I guess your server does not accept MIME type pbo file.

Just remove MIME filter on the repository url from your server conf.

[JustCarl 10]

ok but this happened when i delete the files on my host machine, add the new/updated files then build the repo with the updated files and upload the files to my server. I know that you said a while back that A3S dosent support the uploading route for repos, so is this cause i build the repo on my pc then upload them to my hosting server? im just tring to figure out there there was an issue on my end.

[major_shepard 82]

I have no problem to sync with your server here. Are you the only concerned?

Edited May 27, 2014 by Major_Shepard

[JustCarl 10]

Well its just the only fix for is to go in and delete the files manually and having to tell a good bit of people that they either need to delete the files that were removed/updated or just delete the entire mod folder and recheck for addons.

---------- Post added at 23:06 ---------- Previous post was at 22:53 ----------

I have no problem to sync with your server here. Are you the only concerned?

I guess that i should say that the issue occues when people try to update the mods. Syncing isnt the issue its just the updating part. Ex.- i have @Xmod and some files were removed/updated when i try to updated the 406 error pops up and halts the download. Then the only way i can update @Xmod is to either delete the entire mod or go in and remove xmod.pbo, xmod.pbo.bisign so that when i do the check for addons i can get the updated .pbo files.

[major_shepard 82]

I would need a file (addon whatever) that reproduce the issue when sync with your server.

406 error may be a problem from your server with Ranges request.

[JustCarl 10]

ok ill pm you the needed info

[major_shepard 82]

ok so I was able to reproduce the issue using @RMCC_Utils_v2 you gave me by PM against your Repo.

I also take @RMCC_Utils_v2 from your repo and put on my HTTP repo and build the repo. Then I sync @RMCC_Utils_v2 from MP against my repo -> no error.

So it seams that issue is on your server. You should investigate what happens in the server console log when trying to sync.

[JustCarl 10]

Ok i'll check it out thank you for you help.

---------- Post added at 00:10 ---------- Previous post was at 23:52 ----------

So i have no idea what im looking at... maybe you can tell me what is going on. (I replaced my ip with IP so i could post this)

IP - - [27/May/2014:18:02:49 -0600] "GET /Arma3Sync/RMCC/.a3s/sync HTTP/1.1" 200 20850 "-" "Java/1.7.0_51"

IP - - [27/May/2014:18:02:49 -0600] "GET /Arma3Sync/RMCC/.a3s/serverinfo HTTP/1.1" 200 524 "-" "Java/1.7.0_51"

IP - - [27/May/2014:18:02:49 -0600] "GET /Arma3Sync/RMCC/.a3s/changelogs HTTP/1.1" 200 618 "-" "Java/1.7.0_51"

IP - - [27/May/2014:18:02:50 -0600] "GET /Arma3Sync/RMCC/.a3s/events HTTP/1.1" 404 606 "-" "Java/1.7.0_51"

IP - - [27/May/2014:18:02:54 -0600] "GET /Arma3Sync/RMCC/.a3s/sync HTTP/1.1" 200 20850 "-" "Java/1.7.0_51"

IP - - [27/May/2014:18:02:54 -0600] "GET /Arma3Sync/RMCC/.a3s/serverinfo HTTP/1.1" 200 524 "-" "Java/1.7.0_51"

IP - - [27/May/2014:18:02:54 -0600] "GET /Arma3Sync/RMCC/.a3s/changelogs HTTP/1.1" 200 618 "-" "Java/1.7.0_51"

IP - - [27/May/2014:18:03:03 -0600] "GET /Arma3Sync/RMCC/@RMCC_Utils_v2/addons/cba_ai.pbo.zsync HTTP/1.1" 200 543 "-" "jazsync"

IP - - [27/May/2014:18:03:03 -0600] "GET /Arma3Sync/RMCC/@RMCC_Utils_v2/addons/cba_ai.pbo HTTP/1.1" 200 34527 "-" "Java/1.7.0_51"

IP - - [27/May/2014:18:03:03 -0600] "GET /Arma3Sync/RMCC/@RMCC_Utils_v2/addons/cba_ai.pbo.cba_a3_rc1.bisign.zsync HTTP/1.1" 200 553 "-" "jazsync"

IP - - [27/May/2014:18:03:03 -0600] "GET /Arma3Sync/RMCC/@RMCC_Utils_v2/addons/cba_ai.pbo.cba_a3_rc1.bisign HTTP/1.1" 200 830 "-" "Java/1.7.0_51"

IP - - [27/May/2014:18:03:03 -0600] "GET /Arma3Sync/RMCC/@RMCC_Utils_v2/addons/cba_arrays.pbo.zsync HTTP/1.1" 200 557 "-" "jazsync"

IP - - [27/May/2014:18:03:03 -0600] "GET /Arma3Sync/RMCC/@RMCC_Utils_v2/addons/cba_arrays.pbo HTTP/1.1" 200 43436 "-" "Java/1.7.0_51"

IP - - [27/May/2014:18:03:03 -0600] "GET /Arma3Sync/RMCC/@RMCC_Utils_v2/addons/cba_arrays.pbo.cba_a3_rc1.bisign.zsync HTTP/1.1" 200 561 "-" "jazsync"

IP - - [27/May/2014:18:03:03 -0600] "GET /Arma3Sync/RMCC/@RMCC_Utils_v2/addons/cba_arrays.pbo.cba_a3_rc1.bisign HTTP/1.1" 200 830 "-" "Java/1.7.0_51"

IP - - [27/May/2014:18:03:04 -0600] "GET /Arma3Sync/RMCC/@RMCC_Utils_v2/addons/cba_common.pbo.zsync HTTP/1.1" 200 739 "-" "jazsync"

IP - - [27/May/2014:18:03:04 -0600] "GET /Arma3Sync/RMCC/@RMCC_Utils_v2/addons/cba_common.pbo HTTP/1.1" 406 433 "-" "jazsync"

IP - - [27/May/2014:18:03:09 -0600] "GET /Arma3Sync/RMCC/.a3s/sync HTTP/1.1" 200 20850 "-" "Java/1.7.0_51"

IP - - [27/May/2014:18:03:09 -0600] "GET /Arma3Sync/RMCC/.a3s/serverinfo HTTP/1.1" 200 524 "-" "Java/1.7.0_51"

IP - - [27/May/2014:18:03:09 -0600] "GET /Arma3Sync/RMCC/.a3s/changelogs HTTP/1.1" 200 618 "-" "Java/1.7.0_51"

IP- - [27/May/2014:18:03:04 -0600] "GET /Arma3Sync/RMCC/@RMCC_Utils_v2/addons/cba_common.pbo HTTP/1.1" 200 147460 "-" "Java/1.7.0_51"

[major_shepard 82]

What kind of http server is it? Do you have access on the host machine and manage the server conf? You may have a server conf that reject Ranges request (i.e do not allow downling part of a file).

[lawilm 10]

Major_shepard, I am going to give Carl a hand here and jump in.. I am the owner of the server Carl is using and a member of the same clan. I spoke with the tech support by chat and ran this by them , the transcript of our convo is below.

(9:52) [Derek] I think what would be best is to share this link with you. the user "just carl" is a friend who is asking the dev about an error we are getting. the devs response is here and I don't fully understand what he is asking

(9:53) [Derek] http://forums.bistudio.com/showthread.php?162236-ArmA3Sync-launcher-and-addons-synchronization-software-for-ArmA-3&p=2698798&viewfull=1#post2698798

(9:53) [Derek] the last post by the user "major shepard" is the developer and that is his question

(9:55) [Tyrell T.] Its a shared hosting environment so our access to the servers configuration is limited but let me look into this a bit for you

(9:56) [Derek] ok

(9:59) [Tyrell T.] So the server does accept byte-range requests by default. IM having trouble identifying the issue your working through with this limited info though

(9:59) [Derek] let me see if there is something on the previous page that will help

(10:0) [Derek] http://forums.bistudio.com/showthread.php?162236-ArmA3Sync-launcher-and-addons-synchronization-software-for-ArmA-3/page58

(10:0) [Derek] midway down you will see from justcarl at 21:28 a screen shot of the error we get

(10:1) [Derek] basically this program, what we do is create a repository on our end... when we update the files.. that program checks what we have on the server side to the client side...

(10:2) [Tyrell T.] how large is the repository?

(10:3) [Tyrell T.] Im thinking that the download may just be timing out.

(10:3) [Derek] in total 2 gigs

(10:3) [Derek] but it seems to target a specific file

(10:4) [Derek] in that software we can choose to download one specific file which will only be a MB perhaps and it times out... its always files that have been updated

(10:4) [Derek] in their original format they are good

(10:4) [Derek] Infact the work around we discovered is if I delete the file that is getting the error on my local machine then it will download the file... its a matter of replacing the file

(10:6) [Tyrell T.] is it every mod or just on in specific>

(10:7) [Derek] well we have a few mods but it happens to one of each... after they are updated

(10:8) [Tyrell T.] This is a tough one to troubleshoot without the client side in front of me as well

(10:9) [Derek] yeah i understand ... what I will probably do is summarize our conversation thus far to the dev and see if they come up with more specific questions that you guys may be able to answer

(10:14) [Tyrell T.] OK so the byte-range requests is active I have confirmed this, the file permissions are accurate, the runtime is set to 5 min so I'm not sure what else to check

(10:15) [Derek] Thank you for all your help I will work withe the devs and get back with you guys when we have more information or questions. take care!

[lawilm 10]

No other ideas ?

[major_shepard 82]

I have made a try with /@RMCC_Utils_v2/addons/cba_common.pbo file which make issue with your server

Here is the Range bit request sent with HTTP GET by ArmA3Sync for this file:

0-8192,8192-16384,16384-24576,24576-32768,32768-40960,40960-49152,49152-57344,57344-65536,65536-73728,90112-98304,114688-122880,155648-163840,163840-172032,172032-180224,196608-204800,204800-212992,212992-221184,221184-229376,229376-237568,237568-245760,245760-253952

Now this is the HTTP server header response from my server (Apache wamp v2.2.22):

{null=[HTTP/1.1 206 Partial Content], ETag=["2000000019f04-3d159-4fa9e241020f3"], Date=[Fri, 30 May 2014 13:45:21 GMT], Content-Length=[170208], Last-Modified=[Fri, 30 May 2014 13:37:03 GMT], Keep-Alive=[timeout=5, max=100], Content-Type=[multipart/byteranges; boundary=4fa9e41bb59c9c], Connection=[Keep-Alive], Accept-Ranges=[bytes], Server=[Apache/2.2.22 (Win64) DAV/2 mod_ssl/2.2.22 OpenSSL/1.0.1c PHP/5.4.3]}

This is yours:

{null=[HTTP/1.1 406 Not Acceptable], Date=[Fri, 30 May 2014 13:26:56 GMT], Content-Length=[226], Keep-Alive=[timeout=10, max=500], Content-Type=[text/html; charset=iso-8859-1], Connection=[Keep-Alive], Server=[Apache]}

Edited May 30, 2014 by Major_Shepard

[TheConen 78]

Hey guys,

I got the following problem: the repo itself works fine, but it shows warnings for .cpp, .hpp. and .txt files when updating. When activating the option "auto discover", most of the .cpp-warnings disappear, but the .hsr-warnings, the .txt-warnings and - strangely - the .cpp-warning for CBA_A3 remain. Any ideas?

As I don't already have the rights to post links/images (god knows why), here are the scrambled links to the screenshots:

http : // i.imgur. com /xVFogiv.png

http : // i.imgur. com /xVFogiv.png

[major_shepard 82]

Checkout your targeted @CBA location on the disk, I expect you have several of them.

[TheConen 78]

That's a negative, I only have one target location for the CBA... here's a screenshot of my target location configuration.

http : // i.imgur. com/wkUlazg.png

The addons all work fine (inlcuding CBA) and A3S also downloads all the .cpp and .hpp files, but it still shows those warnings - and as we intend to use A3S with new ARMA users to provide them an easier entrance into the ARMA world, that's - well, suboptimal.

[major_shepard 82]

Could you give me your repo info by pm as well as the @CBA you have on your hard drive, thanks.

[TheConen 78]

As the FTP on which the repo is stored is not mine, I have to ask for that.... in the meanwhile I got the tip to upload all the mods in binary mode as it seems that .cpp, .hpp and .txt files are automatically transferred in ASCII mode. Gonna try that now and see if anything changes.

---------- Post added at 17:09 ---------- Previous post was at 15:51 ----------

Ok, this seems to have fixed the problem... after transferring everything again in binary mode, all warnings were gone.

[major_shepard 82]

Nice. I guess this is a Linux host machine that's why.

Anyway next update of ArmA3Sync will comes with repository upload capability through FTP.

[lawilm 10]

Major Shepard,

This is the response we got from Hostmonster:

looks like there is a connection being rejected here over the http. They could be right on the .conf could be rejecting that. That would not surprise me. The bigger issue being that there is not a way to go into that .conf on the shared servers to allow for that, that would have to be done on a VPS server.

Do you have any recommendations on some free locations we could put our repo? I have a VPS separate that we host our teamspeak server on , but I only have a 1TB a month limit and not sure how much of that I would use up .. so a little iffy about that.

[major_shepard 82]

It depends on how many guys your are, the size of the repo and how much you update the repo content each month.

Let say you are 10 guys, 10 GB repo size and you change 1 GB of the content repo every month.

This would required 10*10 = 100 GB for each one at first time then 10*1 GB max every month.

Edited May 30, 2014 by Major_Shepard

[lawilm 10]

It depends on how many guys your are, the size of the repo and how much you update the repo content each month.

Let say you are 10 guys, 10 GB repo size and you change 1 GB of the content repo every month.

This would required 10*10 = 100 GB for each one at first time then 10*1 GB max every month.

We are a lot more than that.. but didn't know if there was a place we could stick it just for the update purposes.. like some free resource I was unaware of... would you be able to host it on the game server? Like on our HFB or FPS players account?

[major_shepard 82]

ArmA3Sync v1.3

Download

Check from update from the help menu.

Changelog

- Added: Repository upload through configurable dedicated FTP connection. Only new and changed files against remote repository are transferred during upload.

- Added: Events upload through configurable dedicated FTP connection.

- Added: Favourite servers list attached to a repository is now automatically updated at ArmA3Sync start and repository connection.

- Added: TFAR and ACRE installer now automatically prompt to update installation on repository synchronisation.

- Added: Console mode: user can now set files to exclude from build and folders content to exclude extra local content when sync.

- Added: Donation by Papal.

- Changed: Addon synchronisation: folder colouring is back!

- Fixed: Switching between default destination folders does not automatically check for addons.

Edited August 3, 2014 by Major_Shepard

[Guest]

Thanks again for always keeping us up to date and sending us your latest version :cool:

New release frontpaged on the Armaholic homepage.

ArmA3Sync - launcher and addons synchronization software v1.3



Java Runtime Environment 7

===================================================

We have also "connected" these pages to your account (Major_Shepard) on Armaholic.

This means in the future you will be able to maintain these pages yourself if you wish to do so. Once this new feature is ready we will contact you about it and explain how things work and what options you have.

When you have any questions already feel free to PM or email me!

** Note: since this is a project on which more people are working we will contact you in the future to discuss how you want this to be setup on Armaholic.

[der_eismann 10]

I think I am not the first one to notice that, but A3S has some kind of problems with AllInArma I guess. The reason should be the missiong .cpp files of AiA. The result is that AiA is not put in the modset and we can't launch ArmA with A3S. Maybe there will be a solution in the future :)

And I also have a - more logical - problem. The repository is stored on a Win 2012 R2 server and due to some router issues I can't open the external address from the server.

Example: The server address is xxxxx.no-ip.biz, but I can't connect to this repository on the server itself, so I have to use 127.0.0.1. When I share the autoconfig URL it uses 127.... as the address for the repository what, of course, doesn't work for other users.

Maybe you can tell us how A3S should be set up, since I think I made it way too complicated :D I copied my ArmA 3 addons to a separate folder on the server to sync them.

By the way: Great work! Your tool makes life easier. Thanks for opening it to everyone... there is also JustSync by some Germany, but they won't let their tool be used by everyone :)