It will be interesting to see the results. Good luck
| SpecialAttack.net https://forum.specialattack.net/ |
|
| Server troubleshooting https://forum.specialattack.net/viewtopic.php?t=11588 |
Page 1 of 1 |
| Author: | [SpA]SaintK [ 17 Aug 2011, 19:49 ] |
| Post subject: | Server troubleshooting |
Before I start I shall say sorry to banana for breaking things already 2 days after he left As you undoubtedly have noticed, our TF2 servers, like many others, are still experimenting crashing issues. These crashing issues roughly started to occur after the "pew pew / starwars" update introducing the laser weapons. The servers have suffered several different bugs causing them to crash. So far VALVe has found 5 bugs causing crashes and fixed them. However, there is still one, and perhaps 2 bugs unidentified, and thus not fixed. The crashes: One crash occurs mid game and we suspect it still has to do with the laser weapons as we've had several reports from people that the crash occurred exactly at the moment someone would change from a class to soldier with the laser weapons equipped. However, the last time we've seen this crash was the 15th at 09:53CET, a day later an update was released. We suspect the bug might have involved the steam backend as we had crashes with the exact timestamp, on different machines. Nothing was said either about fixing a bug in the TF2 server software with the last update. There is no way telling without official word from VALVe if this fixed, but currently it looks like it. The second crash always occurs right after a map change when all the clients are connecting again to join the game. The server doesn't really crash, the process simply freezes up and all clients receive a time-out disconnect message. On the console, as far as we can currently see, no error messages are displayed. The last line is simply cut off (always a client connecting). This crash is the one that is currently still bugging us and you as player. To try and help VALVe out in locating the issue we're going to run a series of test today and tomorrow to try and gather some extra information. The first test is running tonight. Ditch specially wrote some software for us to monitor our servers. Rather then checking if the process is still alive, we actually query the gameserver to see if it responds. If it fails to respond over a period of time, the process is killed and restarted. This feature ensures our TF2 servers will always be available, also in case of freeze ups instead of actual crashes. We will shut this script down tonight so we can examine the state of the servers when they freeze up. This will have as result that servers after a crash won't directly be available again. The second test will be ran tomorrow. This test will be much more impacting, as we will disable all the custom mods and plugins(metamod source/sourcemod) on the majority of the servers. This will mean that tomorrow during the entire day stuff such as SpA-points, calladmin, stats, custom maprotation etc. won't be working at all. This is required that we can proof with a 100% certainty the crashes are not caused by any of the plugins running. |
|
| Author: | annarack [ 18 Aug 2011, 15:33 ] |
| Post subject: | Re: Server troubleshooting |
It will be interesting to see the results. Good luck
|
|
| Author: | [SpA]SaintK [ 19 Aug 2011, 09:00 ] |
| Post subject: | Re: Server troubleshooting |
To my displeasure the servers have been running rock solid stable. This means the root cause of the freezecrashes are somewhere in Sourcemod(base), or one of our plugins (spapoints, dynamic map rotations, etc.). During the next few day's we'll be doing a lot more troubleshooting to find the cause. Plan of attack: - Upgrade sourcemod, monitor servers In case of further crashing: - Remove all custom plugins from Sourcemod, only run stock plugins, if server still crashes, we'll need sourcemod to find/fix the issue If the server doesn't crash: - Bring back our custom plugins one by one till the servers become unstable again Once we've located the exact source of the issue we can start debugging that specific add-on. |
|
| Author: | ProtectMyBalls [ 19 Aug 2011, 11:02 ] |
| Post subject: | Re: Server troubleshooting |
Shout if you need a hand or anything mate. |
|
| Author: | [SpA]SaintK [ 19 Aug 2011, 11:17 ] |
| Post subject: | Re: Server troubleshooting |
[SpA]ProtectMyBalls wrote: Shout if you need a hand or anything mate.
Please fix it 
|
|
| Author: | ProtectMyBalls [ 19 Aug 2011, 11:28 ] |
| Post subject: | Re: Server troubleshooting |
Done. Have you tried an unexpected manual reboot? 
|
|
| Author: | annarack [ 19 Aug 2011, 11:36 ] |
| Post subject: | Re: Server troubleshooting |
Haha yeah, good luck with that Balls......  I'll give you a hand Saint, when I'm on top of the Mountain, I'll give you a birds eye view Oh und gute idee, mach nichts kaputt
|
|
| Author: | [SpA]SaintK [ 19 Aug 2011, 11:45 ] |
| Post subject: | Re: Server troubleshooting |
[SpA]annarack wrote: Haha yeah, good luck with that Balls......
Der ganzen welt ist KAPUT, JA!
I'll give you a hand Saint, when I'm on top of the Mountain, I'll give you a birds eye view Oh und gute idee, mach nichts kaputt |
|
| Author: | [SpA]SaintK [ 19 Aug 2011, 11:47 ] |
| Post subject: | Re: Server troubleshooting |
I'll be rebooting servers through out the day to get the new sourcemod version going. The servers on MrWhite will remain running modless as verification cases. (Servers sometimes crashed in sync on both machines, so it's interesting to see that *if* servers on MrBlonde crash with mods, it also crashes on the modless servers on MrWhite) |
|
| Author: | ProtectMyBalls [ 19 Aug 2011, 11:48 ] |
| Post subject: | Re: Server troubleshooting |
was a joke anna 
|
|
| Author: | annarack [ 19 Aug 2011, 11:48 ] |
| Post subject: | Re: Server troubleshooting |
Die ganze Welt ist voller Idioten! |
|
| Author: | [SpA]SaintK [ 19 Aug 2011, 11:52 ] |
| Post subject: | Re: Server troubleshooting |
[SpA]annarack wrote: Die ganze Welt ist voller Idioten!
das ist richtig! verdammt noch mal.
|
|
| Author: | [SpA]ZombieStalin [ 19 Aug 2011, 11:56 ] |
| Post subject: | Re: Server troubleshooting |
If you require a lab rat, give me a shout, i'm sure i could break more things for you 
|
|
| Author: | ProtectMyBalls [ 19 Aug 2011, 11:56 ] |
| Post subject: | Re: Server troubleshooting |
[SpA]annarack wrote: Die ganze Welt ist voller Idioten!
Ain't that the truth.
|
|
| Author: | [SpA]SaintK [ 22 Aug 2011, 23:36 ] |
| Post subject: | Re: Server troubleshooting |
Servers are more stable now. I have seen 2 or so crashes the last couple of days. Not sure if the change to Sourcemod, or the TF2 update coming in between fixed it (more or less). |
|
| Author: | [SpA]Blackhawk [ 24 Aug 2011, 16:25 ] |
| Post subject: | Re: Server troubleshooting |
Da ist man mal ein paar Tage nicht da... ... ...
|
|
| Page 1 of 1 | All times are UTC+02:00 |
|
Powered by phpBB® Forum Software © phpBB Limited |
|