severe problems

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|

severe problems

NorbertHartl
Hi,

today it appeared again that accesing gemstone just showed a 500 http error and no chance to connect the stone. Multiple restarts didn't help. I took the backup from yesterday but whatever I try the stoned is runnig at 100% cpu and nothing happens. A topaz login just hangs.  The stone logfile logs good to me. On startup it tells that it needs to recover some stuff and then it starts the other gems and finally the admin gem.

What will be the easiest way to recover my machine? I have other backups that were made through the gemtools client admin menu. What is the minimum I have to set up in order to be able to connect to the stone and recover one of the backups? Or even bette what can I try to recover the current extent? Do I need to let run the stone for some time until it relaxes again?

Any help is welcomed,

Norbert

Reply | Threaded
Open this post in threaded view
|

Re: severe problems

NorbertHartl
I tried to start without tranlogs, in retore mode but didn't get anything running. A fresh extent and a restore from backup finally did it. But I don't have glue what could have happened. Not very satisfying.

Norbert

On 22.03.2010, at 21:37, Norbert Hartl wrote:

> Hi,
>
> today it appeared again that accesing gemstone just showed a 500 http error and no chance to connect the stone. Multiple restarts didn't help. I took the backup from yesterday but whatever I try the stoned is runnig at 100% cpu and nothing happens. A topaz login just hangs.  The stone logfile logs good to me. On startup it tells that it needs to recover some stuff and then it starts the other gems and finally the admin gem.
>
> What will be the easiest way to recover my machine? I have other backups that were made through the gemtools client admin menu. What is the minimum I have to set up in order to be able to connect to the stone and recover one of the backups? Or even bette what can I try to recover the current extent? Do I need to let run the stone for some time until it relaxes again?
>
> Any help is welcomed,
>
> Norbert
>

Reply | Threaded
Open this post in threaded view
|

Re: severe problems

Dale
In these situations, we would like to see the logs from all of the processes ... if there is a process running hot a series of pstacks would give us an idea what the hot process is doing ... so if this happens again, collect the logs, take several pstacks of the hot process (or processes) and then mail them in for analysis.

Dale
----- "Norbert Hartl" <[hidden email]> wrote:

| I tried to start without tranlogs, in retore mode but didn't get
| anything running. A fresh extent and a restore from backup finally did
| it. But I don't have glue what could have happened. Not very
| satisfying.
|
| Norbert
|
| On 22.03.2010, at 21:37, Norbert Hartl wrote:
|
| > Hi,
| >
| > today it appeared again that accesing gemstone just showed a 500
| http error and no chance to connect the stone. Multiple restarts
| didn't help. I took the backup from yesterday but whatever I try the
| stoned is runnig at 100% cpu and nothing happens. A topaz login just
| hangs.  The stone logfile logs good to me. On startup it tells that it
| needs to recover some stuff and then it starts the other gems and
| finally the admin gem.
| >
| > What will be the easiest way to recover my machine? I have other
| backups that were made through the gemtools client admin menu. What is
| the minimum I have to set up in order to be able to connect to the
| stone and recover one of the backups? Or even bette what can I try to
| recover the current extent? Do I need to let run the stone for some
| time until it relaxes again?
| >
| > Any help is welcomed,
| >
| > Norbert
| >
Reply | Threaded
Open this post in threaded view
|

Re: severe problems

NorbertHartl
Ok, I'll do but what are pstacks? Are this process stacks emitted by sending some signal? What was it? HUP USR1?

Norbert

On 22.03.2010, at 23:47, Dale Henrichs wrote:

> In these situations, we would like to see the logs from all of the processes ... if there is a process running hot a series of pstacks would give us an idea what the hot process is doing ... so if this happens again, collect the logs, take several pstacks of the hot process (or processes) and then mail them in for analysis.
>
> Dale
> ----- "Norbert Hartl" <[hidden email]> wrote:
>
> | I tried to start without tranlogs, in retore mode but didn't get
> | anything running. A fresh extent and a restore from backup finally did
> | it. But I don't have glue what could have happened. Not very
> | satisfying.
> |
> | Norbert
> |
> | On 22.03.2010, at 21:37, Norbert Hartl wrote:
> |
> | > Hi,
> | >
> | > today it appeared again that accesing gemstone just showed a 500
> | http error and no chance to connect the stone. Multiple restarts
> | didn't help. I took the backup from yesterday but whatever I try the
> | stoned is runnig at 100% cpu and nothing happens. A topaz login just
> | hangs.  The stone logfile logs good to me. On startup it tells that it
> | needs to recover some stuff and then it starts the other gems and
> | finally the admin gem.
> | >
> | > What will be the easiest way to recover my machine? I have other
> | backups that were made through the gemtools client admin menu. What is
> | the minimum I have to set up in order to be able to connect to the
> | stone and recover one of the backups? Or even bette what can I try to
> | recover the current extent? Do I need to let run the stone for some
> | time until it relaxes again?
> | >
> | > Any help is welcomed,
> | >
> | > Norbert
> | >

Reply | Threaded
Open this post in threaded view
|

Re: severe problems

Dale
Sorry, pstack was the old name ... use gstack ... it's in $GEMSTONE/bin and it will sample the c-stack for a running process:

  $GEMSTONE/bin/gstack <pid>

USR1 is useful for getting a smalltalk stack from a topaz or gem... but for the stone and even hung topaz/gem processes a gstack is useful.

Dale
----- "Norbert Hartl" <[hidden email]> wrote:

| Ok, I'll do but what are pstacks? Are this process stacks emitted by
| sending some signal? What was it? HUP USR1?
|
| Norbert
|
| On 22.03.2010, at 23:47, Dale Henrichs wrote:
|
| > In these situations, we would like to see the logs from all of the
| processes ... if there is a process running hot a series of pstacks
| would give us an idea what the hot process is doing ... so if this
| happens again, collect the logs, take several pstacks of the hot
| process (or processes) and then mail them in for analysis.
| >
| > Dale
| > ----- "Norbert Hartl" <[hidden email]> wrote:
| >
| > | I tried to start without tranlogs, in retore mode but didn't get
| > | anything running. A fresh extent and a restore from backup finally
| did
| > | it. But I don't have glue what could have happened. Not very
| > | satisfying.
| > |
| > | Norbert
| > |
| > | On 22.03.2010, at 21:37, Norbert Hartl wrote:
| > |
| > | > Hi,
| > | >
| > | > today it appeared again that accesing gemstone just showed a
| 500
| > | http error and no chance to connect the stone. Multiple restarts
| > | didn't help. I took the backup from yesterday but whatever I try
| the
| > | stoned is runnig at 100% cpu and nothing happens. A topaz login
| just
| > | hangs.  The stone logfile logs good to me. On startup it tells
| that it
| > | needs to recover some stuff and then it starts the other gems and
| > | finally the admin gem.
| > | >
| > | > What will be the easiest way to recover my machine? I have
| other
| > | backups that were made through the gemtools client admin menu.
| What is
| > | the minimum I have to set up in order to be able to connect to
| the
| > | stone and recover one of the backups? Or even bette what can I try
| to
| > | recover the current extent? Do I need to let run the stone for
| some
| > | time until it relaxes again?
| > | >
| > | > Any help is welcomed,
| > | >
| > | > Norbert
| > | >