Smalltalk › Frameworks & Tools › Moose

Getting access to the _whole_ smalltalkhub?

_‹ Previous Topic Next Topic _›

Classic

List

6 messages Options

Options

abergel

Getting access to the _whole_ smalltalkhub?

Hi!

As you know, the moose team is full of passionated and happy people willing to analyze software.
We have great platforms to carry out analysis that are robust enough to compete with state-of-the-Art software analysis platforms out there.

It would be great to have software to feed our wonderful tools. There are 123 873 packages on Smalltalkhub (!). Can we have easily access to them? I mean, a big big big .zip file would be fantastic with all the public software.

Cheers,
Alexandre

--
_,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:
Alexandre Bergel http://www.bergel.eu
^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;.

_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

Re: [Pharo-dev] Getting access to the _whole_ smalltalkhub?

I support that idea :)

Doru

On Fri, May 23, 2014 at 3:43 PM, Alexandre Bergel <[hidden email]> wrote:

Hi!

As you know, the moose team is full of passionated and happy people willing to analyze software.
We have great platforms to carry out analysis that are robust enough to compete with state-of-the-Art software analysis platforms out there.

It would be great to have software to feed our wonderful tools. There are 123 873 packages on Smalltalkhub (!). Can we have easily access to them? I mean, a big big big .zip file would be fantastic with all the public software.

Cheers,
Alexandre

--
_,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:
Alexandre Bergel http://www.bergel.eu
^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;.

--

www.tudorgirba.com

"Every thing has its own flow"

_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

Marcus Denker-4

Re: [Pharo-dev] Getting access to the _whole_ smalltalkhub?

In reply to this post by abergel

On 23 May 2014, at 15:43, Alexandre Bergel <[hidden email]> wrote:

> Hi!
>
> As you know, the moose team is full of passionated and happy people willing to analyze software.
> We have great platforms to carry out analysis that are robust enough to compete with state-of-the-Art software analysis platforms out there.
>
> It would be great to have software to feed our wonderful tools. There are 123 873 packages on Smalltalkhub (!).
Package versions. This is the number of .mcz files.

> Can we have easily access to them? I mean, a big big big .zip file would be fantastic with all the public software.
>

Would be nice the have an api…

Marcus

_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

Stephan Eggermont-3

Re: Getting access to the _whole_ smalltalkhub?

In reply to this post by abergel

On 23 mei 2014, at 15:43, Alexandre Bergel <[hidden email]> wrote:
> As you know, the moose team is full of passionated and happy people willing to analyze software.
> We have great platforms to carry out analysis that are robust enough to compete with state-of-the-Art software analysis platforms out there.
>
> It would be great to have software to feed our wonderful tools. There are 123 873 packages on Smalltalkhub (!). Can we have easily access to them? I mean, a big big big .zip file would be fantastic with all the public software.

Well yes. DeprecationFinder on smalltalkhub has most of what you need. It is missing the teams as an entry point, though.
If you want to find out the interface to smalltalkhub, there is the smalltalkhub ci image on pharo-contributions.
DeprecationFinder only loads the latest versions of packages, but that is a trivial extension.

I'm not sure how much rate-limiting is needed, but you should *not* run without rate-limiting. You touch the whole
database, so not only is there copying from mongo to pharo input buffer to pharo output buffer going on,
but most of the pages containing older versions of packages will be swapped out to disk.

You might want to consider just creating a local mirror of smalltalkhub. It seems to be easy to set up.

Stephan
_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

Sam Adams-2

Re: [Pharo-dev] Getting access to the _whole_ smalltalkhub?

In reply to this post by Marcus Denker-4

+1 on API.
Or even a web interface to browse the entire list.

Regards,
Sam

Sam S. Adams, Cognitive Knowledge Systems
IBM Distinguished Engineer, IBM Research
Mobile: 919-696-6064, email: [hidden email]
Assistant: Tonja Ross, 404-348-9086, Tie-Line: 824-9086, [hidden email]
<<Hebrews 11:6, Proverbs 3:5-6, Romans 1:16-17, 1 Corinthians 1:10>>

Marcus Denker ---05/23/2014 09:54:12 AM---On 23 May 2014, at 15:43, Alexandre Bergel <[hidden email]> wrote: > Hi!

From: Marcus Denker <[hidden email]>
To: Pharo Development List <[hidden email]>
Cc: Moose-related development <[hidden email]>
Date: 05/23/2014 09:54 AM
Subject: [Moose-dev] Re: [Pharo-dev] Getting access to the _whole_ smalltalkhub?
Sent by: [hidden email]

On 23 May 2014, at 15:43, Alexandre Bergel <[hidden email]> wrote: > Hi! > > As you know, the moose team is full of passionated and happy people willing to analyze software. > We have great platforms to carry out analysis that are robust enough to compete with state-of-the-Art software analysis platforms out there. > > It would be great to have software to feed our wonderful tools. There are 123 873 packages on Smalltalkhub (!). Package versions. This is the number of .mcz files. > Can we have easily access to them? I mean, a big big big .zip file would be fantastic with all the public software. > Would be nice the have an api… Marcus _______________________________________________ Moose-dev mailing list [hidden email]https://www.iam.unibe.ch/mailman/listinfo/moose-dev

_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

abergel

Re: Getting access to the _whole_ smalltalkhub?

In reply to this post by Stephan Eggermont-3

Thanks!

We will have a look at it!

Cheers,
Alexandre
--
_,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:
Alexandre Bergel http://www.bergel.eu
^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;.

On May 23, 2014, at 9:54 AM, Stephan Eggermont <[hidden email]> wrote:

>
> On 23 mei 2014, at 15:43, Alexandre Bergel <[hidden email]> wrote:
>> As you know, the moose team is full of passionated and happy people willing to analyze software.
>> We have great platforms to carry out analysis that are robust enough to compete with state-of-the-Art software analysis platforms out there.
>>
>> It would be great to have software to feed our wonderful tools. There are 123 873 packages on Smalltalkhub (!). Can we have easily access to them? I mean, a big big big .zip file would be fantastic with all the public software.
>
> Well yes. DeprecationFinder on smalltalkhub has most of what you need. It is missing the teams as an entry point, though.
> If you want to find out the interface to smalltalkhub, there is the smalltalkhub ci image on pharo-contributions.
> DeprecationFinder only loads the latest versions of packages, but that is a trivial extension.
>
> I'm not sure how much rate-limiting is needed, but you should *not* run without rate-limiting. You touch the whole
> database, so not only is there copying from mongo to pharo input buffer to pharo output buffer going on,
> but most of the pages containing older versions of packages will be swapped out to disk.
>
> You might want to consider just creating a local mirror of smalltalkhub. It seems to be easy to set up.
>
> Stephan
> _______________________________________________
> Moose-dev mailing list
> [hidden email]
> https://www.iam.unibe.ch/mailman/listinfo/moose-dev

_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev