Hubcap questions

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

Hubcap questions

hernanmd
Hi all,

My goal is to search the contents of the Description form field in SmalltalkHub. I don't know if matches the design and idea of Hubcap (really nice package BTW).

I wonder if anyone (Torsten?) tried to download all package metadata first and perform off-line search?

Someone posted time ago a list of all repositories, can you share how to do it?

Cheers,

Hernán

Reply | Threaded
Open this post in threaded view
|

Re: Hubcap questions

Stephan Eggermont-3
Hernán wrote:
>My goal is to search the contents of the Description form field in SmalltalkHub.
>I don't know if matches the design and idea of Hubcap (really nice package BTW).
>I wonder if anyone (Torsten?) tried to download all package metadata first and perform off-line search?

What I did was take a look at mcx history and try to derive the latest one, and then use the
Moose mczimporter to derive a list of signatures of (possibly) sent messages.
The idea was to find out when packages change in a non-compatible way.
 
>Someone posted time ago a list of all repositories, can you share how to do it?

The code for that is in
  http://smalltalkhub.com/mc/StephanEggermont/DeprecationFinder/main

The code is deliberately slowed down to not bring down smalltalkhub.

Stephan
Reply | Threaded
Open this post in threaded view
|

Re: Hubcap questions

hernanmd

2015-01-19 15:07 GMT-03:00 Stephan Eggermont <[hidden email]>:
Hernán wrote:
>My goal is to search the contents of the Description form field in SmalltalkHub.
>I don't know if matches the design and idea of Hubcap (really nice package BTW).
>I wonder if anyone (Torsten?) tried to download all package metadata first and perform off-line search?

What I did was take a look at mcx history and try to derive the latest one, and then use the
Moose mczimporter to derive a list of signatures of (possibly) sent messages.
The idea was to find out when packages change in a non-compatible way.


Sorry Stephan, I wasn't clear enough. I want to search over SmalltalkHub projects metadata, not the Monticello metadata.

When you click "Edit infos" in SmalltalkHub you see a web form with a "Description" field.
That's the data I want to gather.
I know it could be done with web scraping, the question is if someone tried to do it before.

Hernán


Reply | Threaded
Open this post in threaded view
|

Re: Hubcap questions

Ben Coman
I wonder if it would be easier to modify the SmalltalkHub source to produce a JSON or STON file you could download.
cheers -ben

On Tue, Jan 20, 2015 at 3:04 AM, Hernán Morales Durand <[hidden email]> wrote:

2015-01-19 15:07 GMT-03:00 Stephan Eggermont <[hidden email]>:
Hernán wrote:
>My goal is to search the contents of the Description form field in SmalltalkHub.
>I don't know if matches the design and idea of Hubcap (really nice package BTW).
>I wonder if anyone (Torsten?) tried to download all package metadata first and perform off-line search?

What I did was take a look at mcx history and try to derive the latest one, and then use the
Moose mczimporter to derive a list of signatures of (possibly) sent messages.
The idea was to find out when packages change in a non-compatible way.


Sorry Stephan, I wasn't clear enough. I want to search over SmalltalkHub projects metadata, not the Monticello metadata.

When you click "Edit infos" in SmalltalkHub you see a web form with a "Description" field.
That's the data I want to gather.
I know it could be done with web scraping, the question is if someone tried to do it before.

Hernán