Back-ends for Monticello?

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
13 messages Options
Reply | Threaded
Open this post in threaded view
|

Back-ends for Monticello?

brad fowlow
Howdy...

Looking for recent experiences/opinions.

We're using Monticello for a lot of source that gets a fair bit of  
update
(maybe a dozen checkins a day,
into a set of maybe 50 packages in 5 or 6 repositories.)

We've been using squeak source as the backend, on a Linux box.

Every few days, the 'lost it, spin out of control at 99% CPU' problem  
strikes
the source server, and someone has to ssh to it, kick it over,
and then e-mail everyone to check that their recent checkins made,
reminding the recalcitrant to 'Flush Cache Versions', and so on.

This causes some of the grumpy gray-bearded men
to become exceedingly grumpy indeed.
Especially upsetting to the old guard is the unfortunate fact that
you may not find out right away that your checkin has gone astray.
(It's only the next refresh in Monticello, not the checkin itself, that
reveals the situation to the user.)

Sneering has been seen.
Unfavorable comparisons with SVN have been heard.
Projects based on languages whose names contain J, or even C,
have been recalled fondly.

So... we're looking for a more reliable back end.
The alternatives seem to be FTP and WebDav.

Anyone have experience/advice/guidance about using
either an ftpd, or some WebDav enablement in an Apache on Linux,
as the server for a Monticello package repository?

Thanks!

-brad


Reply | Threaded
Open this post in threaded view
|

Re: Back-ends for Monticello?

Philippe Marschall
2007/4/7, brad fowlow <[hidden email]>:

> Howdy...
>
> Looking for recent experiences/opinions.
>
> We're using Monticello for a lot of source that gets a fair bit of
> update
> (maybe a dozen checkins a day,
> into a set of maybe 50 packages in 5 or 6 repositories.)
>
> We've been using squeak source as the backend, on a Linux box.
>
> Every few days, the 'lost it, spin out of control at 99% CPU' problem
> strikes
> the source server, and someone has to ssh to it, kick it over,
> and then e-mail everyone to check that their recent checkins made,
> reminding the recalcitrant to 'Flush Cache Versions', and so on.
>
> This causes some of the grumpy gray-bearded men
> to become exceedingly grumpy indeed.
> Especially upsetting to the old guard is the unfortunate fact that
> you may not find out right away that your checkin has gone astray.
> (It's only the next refresh in Monticello, not the checkin itself, that
> reveals the situation to the user.)
>
> Sneering has been seen.
> Unfavorable comparisons with SVN have been heard.
> Projects based on languages whose names contain J, or even C,
> have been recalled fondly.
>
> So... we're looking for a more reliable back end.
> The alternatives seem to be FTP and WebDav.
>
> Anyone have experience/advice/guidance about using
> either an ftpd, or some WebDav enablement in an Apache on Linux,
> as the server for a Monticello package repository?

WebDav (actually HTTP, but anyway) + Apache + Linux
no problems at all

If you want to get fancy you can even use SSL via cUrl but this not
seen that much testing but it doesn't use HTTPSocket.

Philippe

> Thanks!
>
> -brad
>
>
>

Reply | Threaded
Open this post in threaded view
|

Re: Back-ends for Monticello?

johnmci
In reply to this post by brad fowlow

On Apr 7, 2007, at 11:06 AM, brad fowlow wrote:

> Howdy...
>
> Looking for recent experiences/opinions.
>
> We're using Monticello for a lot of source that gets a fair bit of  
> update
> (maybe a dozen checkins a day,
> into a set of maybe 50 packages in 5 or 6 repositories.)
>
> We've been using squeak source as the backend, on a Linux box.
>
> Every few days, the 'lost it, spin out of control at 99% CPU'  
> problem strikes
> the source server, and someone has to ssh to it, kick it over,
> and then e-mail everyone to check that their recent checkins made,
> reminding the recalcitrant to 'Flush Cache Versions', and so on.


Gee that would be like the Sophie Project.
Gee one of our grumpy gray-bearded men guys offered one Million Euro  
to have someone fix it.
Gee there where no takers.
Gee he didn't have one million euros anyway.

Gee the Unix Socket code has some sort of problem that needs fixing.  
There are some fixes proposed
to accept processing queuing problems, but  they've never made the  
main source tree.

--
========================================================================
===
John M. McIntosh <[hidden email]>
Corporate Smalltalk Consulting Ltd.  http://www.smalltalkconsulting.com
========================================================================
===



Reply | Threaded
Open this post in threaded view
|

Re: Back-ends for Monticello?

Bert Freudenberg
On Apr 7, 2007, at 22:53 , John M McIntosh wrote:

> On Apr 7, 2007, at 11:06 AM, brad fowlow wrote:
>
>> Howdy...
>>
>> Looking for recent experiences/opinions.
>>
>> We're using Monticello for a lot of source that gets a fair bit of  
>> update
>> (maybe a dozen checkins a day,
>> into a set of maybe 50 packages in 5 or 6 repositories.)
>>
>> We've been using squeak source as the backend, on a Linux box.
>>
>> Every few days, the 'lost it, spin out of control at 99% CPU'  
>> problem strikes
>> the source server, and someone has to ssh to it, kick it over,
>> and then e-mail everyone to check that their recent checkins made,
>> reminding the recalcitrant to 'Flush Cache Versions', and so on.
>
>
> Gee that would be like the Sophie Project.
> Gee one of our grumpy gray-bearded men guys offered one Million  
> Euro to have someone fix it.
> Gee there where no takers.
> Gee he didn't have one million euros anyway.
>
> Gee the Unix Socket code has some sort of problem that needs  
> fixing. There are some fixes proposed
> to accept processing queuing problems, but  they've never made the  
> main source tree.

Gee, at least we have an intern who can wiggle the mouse which makes  
the server responsive again without loosing anything :)

- Bert -



Reply | Threaded
Open this post in threaded view
|

Re: Back-ends for Monticello?

johnmci

On Apr 7, 2007, at 2:41 PM, Bert Freudenberg wrote:

>
> Gee, at least we have an intern who can wiggle the mouse which  
> makes the server responsive again without loosing anything :)
>
> - Bert -

Brilliant solution, could we share him? With three of them they could  
wiggle mice across many many MC servers  across multiple projects  
around the
world  24x7, to keep us gray-bearded men from digging up the  
passwords, convincing SSH and VNC we're valid and wiggling said mouse.

Well that or someone fix or replace the unix socket or AIO code.  
Which btw is not only used by MC, Seaside comes to mind...

--
========================================================================
===
John M. McIntosh <[hidden email]>
Corporate Smalltalk Consulting Ltd.  http://www.smalltalkconsulting.com
========================================================================
===



Reply | Threaded
Open this post in threaded view
|

Re: Back-ends for Monticello?

Colin Putney-2
In reply to this post by Philippe Marschall

On Apr 7, 2007, at 11:21 AM, Philippe Marschall wrote:

> WebDav (actually HTTP, but anyway) + Apache + Linux
> no problems at all

Yes, Apache is relatively easy to configure as a Monticello server,  
and very stable in my experience.

> If you want to get fancy you can even use SSL via cUrl but this not
> seen that much testing but it doesn't use HTTPSocket.

I use it all the time. Works great.

I did have to make a few tweaks - if you give me write access to the  
squeaksource repository, I'll commit the version I'm using there.


Colin

Reply | Threaded
Open this post in threaded view
|

Re: Back-ends for Monticello?

Andreas.Raab
In reply to this post by Bert Freudenberg
Bert Freudenberg wrote:
> Gee, at least we have an intern who can wiggle the mouse which makes the
> server responsive again without loosing anything :)

Not in my experience. If the server sits there with 99% CPU consumption
there is usually no way to get in there with VNC and wiggle anything. It
also seems to be directly related to commits - usually the lock up
occurs right after a check-in; probably while SS is trying to write
whatever it writes to disk. And usually you loose that last check-in.

In short, it sucks and loosing a commit every couple of days is simply
not acceptable.

Cheers,
   - Andreas

Reply | Threaded
Open this post in threaded view
|

Re: Back-ends for Monticello?

keith1y
In reply to this post by brad fowlow

Anyone have experience/advice/guidance about using
> either an ftpd, or some WebDav enablement in an Apache on Linux,
> as the server for a Monticello package repository?
>
> Thanks!
>
> -brad
>
Try running your server with a 3.6-3 vm, this made all the difference for me

Keith

Reply | Threaded
Open this post in threaded view
|

Re: Back-ends for Monticello?

Philippe Marschall
In reply to this post by Colin Putney-2
2007/4/8, Colin Putney <[hidden email]>:

>
> On Apr 7, 2007, at 11:21 AM, Philippe Marschall wrote:
>
> > WebDav (actually HTTP, but anyway) + Apache + Linux
> > no problems at all
>
> Yes, Apache is relatively easy to configure as a Monticello server,
> and very stable in my experience.
>
> > If you want to get fancy you can even use SSL via cUrl but this not
> > seen that much testing but it doesn't use HTTPSocket.
>
> I use it all the time. Works great.

This is good to know

> I did have to make a few tweaks - if you give me write access to the
> squeaksource repository, I'll commit the version I'm using there.

Done

Philippe

> Colin
>
>

Reply | Threaded
Open this post in threaded view
|

Re: Back-ends for Monticello?

Bert Freudenberg
In reply to this post by Andreas.Raab

On Apr 8, 2007, at 1:50 , Andreas Raab wrote:

> Bert Freudenberg wrote:
>> Gee, at least we have an intern who can wiggle the mouse which  
>> makes the server responsive again without loosing anything :)
>
> Not in my experience. If the server sits there with 99% CPU  
> consumption there is usually no way to get in there with VNC and  
> wiggle anything. It also seems to be directly related to commits -  
> usually the lock up occurs right after a check-in; probably while  
> SS is trying to write whatever it writes to disk. And usually you  
> loose that last check-in.

We were running the image headful inside an Xvnc session. The lockup  
always occured while saving the database - I added a colored frame to  
indicate whether a save or load is in progress. But wiggling the  
mouse always let the save continue successfully.

> In short, it sucks and loosing a commit every couple of days is  
> simply not acceptable.

Agreed.

- Bert -



Reply | Threaded
Open this post in threaded view
|

Re: Back-ends for Monticello?

J J-6
In reply to this post by Philippe Marschall
>From: "Philippe Marschall" <[hidden email]>
>Reply-To: The general-purpose Squeak developers
>list<[hidden email]>
>To: "The general-purpose Squeak developers
>list"<[hidden email]>
>Subject: Re: Back-ends for Monticello?
>Date: Sat, 7 Apr 2007 20:21:38 +0200
>>
>>Unfavorable comparisons with SVN have been heard.

The situation is pretty bad if you end up on the bad side of a comparison
with SVN.  That system is awful.

_________________________________________________________________
The average US Credit Score is 675. The cost to see yours: $0 by Experian.
http://www.freecreditreport.com/pm/default.aspx?sc=660600&bcd=EMAILFOOTERAVERAGE


Reply | Threaded
Open this post in threaded view
|

Re: Back-ends for Monticello?

J J-6
In reply to this post by Bert Freudenberg
>From: Bert Freudenberg <[hidden email]>
>Reply-To: The general-purpose Squeak developers
>list<[hidden email]>
>To: The general-purpose Squeak developers
>list<[hidden email]>
>Subject: Re: Back-ends for Monticello?
>Date: Sat, 7 Apr 2007 23:41:33 +0200
>
>>Gee the Unix Socket code has some sort of problem that needs  fixing.
>>There are some fixes proposed
>>to accept processing queuing problems, but  they've never made the  main
>>source tree.

Probably a stupid question, but are the fixes in Mantis?  If so, is the 3.10
team going to pick them up?

_________________________________________________________________
Exercise your brain! Try Flexicon.
http://games.msn.com/en/flexicon/default.htm?icid=flexicon_hmemailtaglineapril07


Reply | Threaded
Open this post in threaded view
|

Re: Back-ends for Monticello?

brad fowlow
In reply to this post by Bert Freudenberg

Thanks everyone for the remarks and suggestions.

We tried the 3.6-vintage VM suggestion
(attractive, since it meant minimal change to the world.)
That held up for 3 days before the next spin-out.
(Hard to say if that's an improvement,
or just a lull in checkin frequency,
but it hardly matters.)

HTTP (web-dav) it is.

-brad