Monit requests causing error on FSConnection ?

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Monit requests causing error on FSConnection ?

GLASS mailing list
Hi guys,

I have monit tool monitoring my gems so that if they get down, they are restarted. I suddenly started to have this error below printed on my seaside gems logs ever 1 or 2 minutes:

-----------  Unreportable ERROR Encountered: 2017-06-08T07:45:57.08100605010986-04:00a ImproperOperation occurred (error 2089), reason:rtErrBadCopyFromTo, An invalid index range was specified for a sequenceable collection starting index ByteArray withAll: #(0 0 0 0 0 00 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 00 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 00 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ...), ending index 0.-----------


After I found that, noticed that FSConnection  >> handleError:  was storing the good/necessary information into a stream into a UserGlobals....mmmm... anyway, I changed that so that the stuff gets printed into the stdout (much more logical to me). And so, I was able to obtain he following info:



-----------  Unreportable ERROR Encountered: 2017-06-08T10:29:07.553728103637695-04:00Entering handle error -----------
-----------  Unreportable ERROR Encountered: 2017-06-08T10:29:07.554210901260376-04:00Data: a ImproperOperation occurred (error 2089), reason:rtErrBadCopyFromTo, An invalid index range was specified for a sequenceable collection starting index ByteArray withAll: #(0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ...), ending index 0.-----------
-----------  Unreportable ERROR Encountered: 2017-06-08T10:29:07.554938077926636-04:00Contents: a ImproperOperation occurred (error 2089), reason:rtErrBadCopyFromTo, An invalid index range was specified for a sequenceable collection starting index ByteArray withAll: #(0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ...), ending index 0.-----------
-----------  Unreportable ERROR Encountered: 2017-06-08T10:29:07.555368900299072-04:00Stack: 1 [] in  ExecBlock0 (FSConnection) >> handleError: @32 line 24  [GsNMethod 32344851713]
2 ExecBlock0 (ExecBlock) >> on:do: @3 line 44  [GsNMethod 19132399361]
3 FSConnection >> handleError: @3 line 27  [GsNMethod 32344853505]
4 [] in  ExecBlock1 (FSConnection) >> safeServe @23 line 13  [GsNMethod 56211350785]
5 ImproperOperation (AbstractException) >> _executeHandler: @4 line 8  [GsNMethod 19134335489]
6 ImproperOperation (AbstractException) >> _signalWith: @1 line 1  [GsNMethod 19134336001]
7 ImproperOperation (AbstractException) >> signal @2 line 47  [GsNMethod 19134336257]
8 ByteArray (Object) >> _error:args: @16 line 11  [GsNMethod 19470906625]
9 ByteArray (SequenceableCollection) >> copyFrom:to:into:startingAt: @5 line 13  [GsNMethod 18768860417]
10 FSGsSocket >> next: @38 line 30  [GsNMethod 37855416065]
11 FSGsSocket >> next @2 line 5  [GsNMethod 37855417089]
12 FSRecordStruct >> readFromStream: @3 line 5  [GsNMethod 37855456513]
13 FSRecordStruct class >> readFromStream: @3 line 2  [GsNMethod 37855460353]
14 FSGsSocket >> nextRecordStruct @2 line 6  [GsNMethod 37855414785]
15 FSConnection >> nextAppRecordStruct @3 line 6  [GsNMethod 37855379969]
16 FSConnection >> nextAppRecord @3 line 7  [GsNMethod 37855378689]
17 FSConnection >> makeActive @3 line 6  [GsNMethod 37855381505]
18 FSConnection >> unsafeServe @4 line 7  [GsNMethod 37855375105]
19 [] in  ExecBlock0 (FSConnection) >> safeServe @15 line 8  [GsNMethod 56276117761]
20 ExecBlock0 (ExecBlock) >> on:do: @3 line 44  [GsNMethod 19132399361]
21 [] in  ExecBlock0 (FSConnection) >> safeServe @11 line 9  [GsNMethod 56211351041]
22 ExecBlock0 (ExecBlock) >> on:do: @3 line 44  [GsNMethod 19132399361]
23 [] in  ExecBlock0 (FSConnection) >> safeServe @7 line 12  [GsNMethod 50842477057]
24 ExecBlock0 (ExecBlock) >> ensure: @2 line 12  [GsNMethod 19132413953]
25 FSConnection >> safeServe @3 line 15  [GsNMethod 37855377153]
26 FSConnection >> serve @2 line 4  [GsNMethod 37855376641]
27 [] in  ExecBlock (FSSocketServer) >> listen: @15 line 15  [GsNMethod 50843215361]
28 ExecBlock >> valueWithArguments: @1 line 1  [GsNMethod 19132413697]
29 GsProcess >> _start @8 line 16  [GsNMethod 19132995841]
30 <Reenter marker>
-----------
-----------  Unreportable ERROR Encountered: 2017-06-08T10:29:07.555640935897827-04:00 XXXXXXXXXXX FLOR a ImproperOperation occurred (error 2089), reason:rtErrBadCopyFromTo, An invalid index range was specified for a sequenceable collection starting index ByteArray withAll: #(0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ...), ending index 0.-----------


-----


From my monit, what I do to monitor Gems is this:


check process fastcgi_40212_debrisDemo_333 with pidfile /home/quuve/GsDevKit_home/server/stones/debrisDemo_333/extents/FastCGI_server-40212.pid
        start program = "/bin/bash -c 'export GS_HOME=/home/quuve/GsDevKit_home; $GS_HOME/sys/local/bin/seaside/startSeasideGems debrisDemo_333 -p 40212'" as uid debrisdemo and gid debrisdemo
        stop program = "/bin/bash -c 'export GS_HOME=/home/quuve/GsDevKit_home; $GS_HOME/sys/local/bin/seaside/stopSeasideGems debrisDemo_333 -p 40212'" as uid debrisdemo and gid debrisdemo
                GROUP debrisDemo_333
                # Empty FastCGI request
                if failed port 40212
                  # Send FastCGI packet: version 1 (0x01), cmd FCGI_GET_VALUES (0x09)
                  # padding 8 bytes (0x08), followed by 8xNULLs padding
                  send "\0x01\0x09\0x00\0x00\0x00\0x00\0x08\0x00\0x00\0x00\0x00\0x00\0x00\0x00\0x00\0x00"
                  # Expect FastCGI packet: version 1 (0x01), resp FCGI_GET_VALUES_RESULT (0x0A)
                  expect "\0x01\0x0A"
                  timeout 600 seconds
                then restart


So...I don't know but it looks something is wrong with what Monit is sending or .. ?

BTW, now that I know I can change FSConnection  >> handleError:  I can also generate a continuation and store the exception into the object log for proper debugging (if string stack is not enough). 

Any advice?

Thanks in advance,


--

_______________________________________________
Glass mailing list
[hidden email]
http://lists.gemtalksystems.com/mailman/listinfo/glass