Smalltalk › Squeak › Squeak - Dev

SM (was OCompletion in 4.3?)

_‹ Previous Topic Next Topic _›

Classic

List

Threaded

5 messages Options

Chris Cunnington

SM (was OCompletion in 4.3?)

I've been reading these posts about plans for improving SqueakMap. The
real deal maker is to mirror SqueakSource. If you could go to SM and
know you were getting access to everything at SqueakSource and other
things. Then it'd be compelling.

Andreas was saying that SM was useful because it could be searched by
Google. You know, he's got a point. SqS is awful for finding things.
Truly. Unless you know what you're looking for, forget it. And it'd be
easy to add a Google search window.

But how to siphon all the data about projects out of SqS? I mean, Google
can't crawl it, and there's a reason for that. Does anybody have an idea?

Chris

Hannes Hirzel

Re: SM (was OCompletion in 4.3?)

On 3/6/12, Chris Cunnington <[hidden email]> wrote:
....
>
> But how to siphon all the data about projects out of SqS? I mean, Google
> can't crawl it, and there's a reason for that. Does anybody have an idea?

One option would be to to write a robot which regularily visits
SqueakSource and other repositories and then use a screen scraper to
extract the data and feed it into SqueakMap.

-- Hannes

Frank Shearar-3

Re: SM (was OCompletion in 4.3?)

On 6 March 2012 09:18, H. Hirzel <[hidden email]> wrote:

> On 3/6/12, Chris Cunnington <[hidden email]> wrote:
> ....
>>
>> But how to siphon all the data about projects out of SqS? I mean, Google
>> can't crawl it, and there's a reason for that. Does anybody have an idea?
>
> One option would be to to write a robot which regularily visits
> SqueakSource and other repositories and then use a screen scraper to
> extract the data and feed it into SqueakMap.
>
> -- Hannes

While we're scraping things, a lot of folk (myself included) are
either mirroring their packages on ss3.gemstone.com, or simply
abandoning ss for ss3.

Also, the ss3 folk might be amenable to exposing an introspection API,
or adding RESTful URLs?

But as a counterpoint, the project front pages _are_ indexable:
googling "shift reset" shows http://www.squeaksource.com/Control/ as
the 8th hit. But certainly nothing beyond those landing pages is
indexable.

frank

Göran Krampe

Re: SM (was OCompletion in 4.3?)

Hi all!

On 03/06/2012 11:27 AM, Frank Shearar wrote:

> On 6 March 2012 09:18, H. Hirzel<[hidden email]> wrote:
>> On 3/6/12, Chris Cunnington<[hidden email]> wrote:
>> ....
>>>
>>> But how to siphon all the data about projects out of SqS? I mean, Google
>>> can't crawl it, and there's a reason for that. Does anybody have an idea?
>>
>> One option would be to to write a robot which regularily visits
>> SqueakSource and other repositories and then use a screen scraper to
>> extract the data and feed it into SqueakMap.
>>
>> -- Hannes
>
> While we're scraping things, a lot of folk (myself included) are
> either mirroring their packages on ss3.gemstone.com, or simply
> abandoning ss for ss3.
>
> Also, the ss3 folk might be amenable to exposing an introspection API,
> or adding RESTful URLs?

I don't want to stifle any effort (*any* effort is good IMHO) but I
think that the upcoming SmalltalkHub (that Nicolas is working on, and
possibly with a bit of help from me if I ever get free time to spend)
will offer a compelling new platform for all of SS and SM etc.

It would give all our communities (Squeak, Pharo and others) a chance to
converge in a single much more powerful and fresh platform.

regards, Göran

Bert Freudenberg

Re: SM (was OCompletion in 4.3?)

On 06.03.2012, at 21:13, Göran Krampe wrote:

> Hi all!
>
> On 03/06/2012 11:27 AM, Frank Shearar wrote:
>> On 6 March 2012 09:18, H. Hirzel<[hidden email]> wrote:
>>> On 3/6/12, Chris Cunnington<[hidden email]> wrote:
>>> ....
>>>>
>>>> But how to siphon all the data about projects out of SqS? I mean, Google
>>>> can't crawl it, and there's a reason for that. Does anybody have an idea?
>>>
>>> One option would be to to write a robot which regularily visits
>>> SqueakSource and other repositories and then use a screen scraper to
>>> extract the data and feed it into SqueakMap.
>>>
>>> -- Hannes
>>
>> While we're scraping things, a lot of folk (myself included) are
>> either mirroring their packages on ss3.gemstone.com, or simply
>> abandoning ss for ss3.
>>
>> Also, the ss3 folk might be amenable to exposing an introspection API,
>> or adding RESTful URLs?
>
> I don't want to stifle any effort (*any* effort is good IMHO) but I think that the upcoming SmalltalkHub (that Nicolas is working on, and possibly with a bit of help from me if I ever get free time to spend) will offer a compelling new platform for all of SS and SM etc.
>
> It would give all our communities (Squeak, Pharo and others) a chance to converge in a single much more powerful and fresh platform.
>
> regards, Göran

Many squeaksource urls are still in use. Squeaksource3 is similar enough to squeaksource so we can keep things working. The plan is to migrate everything from squeaksource to squeaksource3 and then just switch the url to point to the new ss3 server.

SmalltalkHub may become the first choice for new projects, when it is finished. For now, squeaksource3 is a fine successor to squeaksource that will be more stable but otherwise pretty similar.

- Bert -