Re: [Pharo-project] experience with large images?
Locked
Re: [Pharo-project] experience with large images?
 
|
Alex
two remarks: - what is the level of reification because we reify a lot and it can be discarded. - did you check the orion model because with orion you only represent the delta and this is a big difference. Stef On Nov 24, 2011, at 2:05 PM, Alexandre Bergel wrote: > Having a reification in Moose of 100 versions of Mondrian for example :-) > > Just answering the question 'Which classes and methods of Mondrian have changed more than 10 times since the day Mondrian was born?' cannot be easily done without a lot of memory > > Alexandre > > > On 24 Nov 2011, at 03:27, Francois Stephany wrote: > >> I'm wondering: how big is a dataset > 500MB ? I've no idea how big it is. >> Alex, what is your use case (in practice!) for more than 500MB? >> >> On 23/11/11 18:25, Igor Stasenko wrote: >>> It is problematic, and requires different memory management than we >>> currently have. >>> I think if you need really big data sets, then use gemstone, which is >>> developed to deal with that specifically. >> > > -- > _,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;: > Alexandre Bergel http://www.bergel.eu > ^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;. > > > > > > _______________________________________________ Moose-dev mailing list [hidden email] https://www.iam.unibe.ch/mailman/listinfo/moose-dev |
|
|
> - what is the level of reification because we reify a lot and it can be discarded.
We are actually measuring the dependencies a method has. We therefore need invocations, access to attributes, ... Close to the maximum level of import then. > - did you check the orion model > because with orion you only represent the delta and this is a big difference. We haven't checked. Do you know whether Orion is integrated with Hismo? Can hismo be transparently used with Orion? Alexandre > > > > On Nov 24, 2011, at 2:05 PM, Alexandre Bergel wrote: > >> Having a reification in Moose of 100 versions of Mondrian for example :-) >> >> Just answering the question 'Which classes and methods of Mondrian have changed more than 10 times since the day Mondrian was born?' cannot be easily done without a lot of memory >> >> Alexandre >> >> >> On 24 Nov 2011, at 03:27, Francois Stephany wrote: >> >>> I'm wondering: how big is a dataset > 500MB ? I've no idea how big it is. >>> Alex, what is your use case (in practice!) for more than 500MB? >>> >>> On 23/11/11 18:25, Igor Stasenko wrote: >>>> It is problematic, and requires different memory management than we >>>> currently have. >>>> I think if you need really big data sets, then use gemstone, which is >>>> developed to deal with that specifically. >>> >> >> -- >> _,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;: >> Alexandre Bergel http://www.bergel.eu >> ^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;. >> >> >> >> >> >> > > -- _,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;: Alexandre Bergel http://www.bergel.eu ^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;. _______________________________________________ Moose-dev mailing list [hidden email] https://www.iam.unibe.ch/mailman/listinfo/moose-dev |
Re: [Pharo-project] experience with large images?
|
|
Hi Alex,
On Nov 24, 2011, at 21:08 , Alexandre Bergel wrote: >> - what is the level of reification because we reify a lot and it can be discarded. > > We are actually measuring the dependencies a method has. We therefore need invocations, access to attributes, ... Close to the maximum level of import then. > >> - did you check the orion model >> because with orion you only represent the delta and this is a big difference. > > We haven't checked. Do you know whether Orion is integrated with Hismo? Can hismo be transparently used with Orion? I do not know how work Hismo, but Orion work like a Famix model, if it can help you :) Jannik > > Alexandre > >> >> >> >> On Nov 24, 2011, at 2:05 PM, Alexandre Bergel wrote: >> >>> Having a reification in Moose of 100 versions of Mondrian for example :-) >>> >>> Just answering the question 'Which classes and methods of Mondrian have changed more than 10 times since the day Mondrian was born?' cannot be easily done without a lot of memory >>> >>> Alexandre >>> >>> >>> On 24 Nov 2011, at 03:27, Francois Stephany wrote: >>> >>>> I'm wondering: how big is a dataset > 500MB ? I've no idea how big it is. >>>> Alex, what is your use case (in practice!) for more than 500MB? >>>> >>>> On 23/11/11 18:25, Igor Stasenko wrote: >>>>> It is problematic, and requires different memory management than we >>>>> currently have. >>>>> I think if you need really big data sets, then use gemstone, which is >>>>> developed to deal with that specifically. >>>> >>> >>> -- >>> _,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;: >>> Alexandre Bergel http://www.bergel.eu >>> ^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;. >>> >>> >>> >>> >>> >>> >> >> > > -- > _,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;: > Alexandre Bergel http://www.bergel.eu > ^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;. > > > > > --- Jannik Laval _______________________________________________ Moose-dev mailing list [hidden email] https://www.iam.unibe.ch/mailman/listinfo/moose-dev |
|
|
>
> I do not know how work Hismo, > but Orion work like a Famix model, if it can help you :) Hismo provides many facilities to query the history, which is pretty cool We should indeed have a look at Orion. We will Alexandre >> >>> >>> >>> >>> On Nov 24, 2011, at 2:05 PM, Alexandre Bergel wrote: >>> >>>> Having a reification in Moose of 100 versions of Mondrian for example :-) >>>> >>>> Just answering the question 'Which classes and methods of Mondrian have changed more than 10 times since the day Mondrian was born?' cannot be easily done without a lot of memory >>>> >>>> Alexandre >>>> >>>> >>>> On 24 Nov 2011, at 03:27, Francois Stephany wrote: >>>> >>>>> I'm wondering: how big is a dataset > 500MB ? I've no idea how big it is. >>>>> Alex, what is your use case (in practice!) for more than 500MB? >>>>> >>>>> On 23/11/11 18:25, Igor Stasenko wrote: >>>>>> It is problematic, and requires different memory management than we >>>>>> currently have. >>>>>> I think if you need really big data sets, then use gemstone, which is >>>>>> developed to deal with that specifically. >>>>> >>>> >>>> -- >>>> _,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;: >>>> Alexandre Bergel http://www.bergel.eu >>>> ^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;. >>>> >>>> >>>> >>>> >>>> >>>> >>> >>> >> >> -- >> _,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;: >> Alexandre Bergel http://www.bergel.eu >> ^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;. >> >> >> >> >> > > --- > Jannik Laval > -- _,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;: Alexandre Bergel http://www.bergel.eu ^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;. _______________________________________________ Moose-dev mailing list [hidden email] https://www.iam.unibe.ch/mailman/listinfo/moose-dev |
Re: [Pharo-project] experience with large images?
|
|
In reply to this post by abergel
On Nov 24, 2011, at 9:08 PM, Alexandre Bergel wrote: >> - what is the level of reification because we reify a lot and it can be discarded. > > We are actually measuring the dependencies a method has. We therefore need invocations, access to attributes, ... Close to the maximum level of import then. you do not need temp, comment > >> - did you check the orion model >> because with orion you only represent the delta and this is a big difference. > > We haven't checked. Do you know whether Orion is integrated with Hismo? Can hismo be transparently used with Orion? Not that I know but orion is the way to go if you want to have a lot of data. > > Alexandre > >> >> >> >> On Nov 24, 2011, at 2:05 PM, Alexandre Bergel wrote: >> >>> Having a reification in Moose of 100 versions of Mondrian for example :-) >>> >>> Just answering the question 'Which classes and methods of Mondrian have changed more than 10 times since the day Mondrian was born?' cannot be easily done without a lot of memory >>> >>> Alexandre >>> >>> >>> On 24 Nov 2011, at 03:27, Francois Stephany wrote: >>> >>>> I'm wondering: how big is a dataset > 500MB ? I've no idea how big it is. >>>> Alex, what is your use case (in practice!) for more than 500MB? >>>> >>>> On 23/11/11 18:25, Igor Stasenko wrote: >>>>> It is problematic, and requires different memory management than we >>>>> currently have. >>>>> I think if you need really big data sets, then use gemstone, which is >>>>> developed to deal with that specifically. >>>> >>> >>> -- >>> _,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;: >>> Alexandre Bergel http://www.bergel.eu >>> ^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;. >>> >>> >>> >>> >>> >>> >> >> > > -- > _,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;: > Alexandre Bergel http://www.bergel.eu > ^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;. > > > > > > _______________________________________________ > Moose-dev mailing list > [hidden email] > https://www.iam.unibe.ch/mailman/listinfo/moose-dev _______________________________________________ Moose-dev mailing list [hidden email] https://www.iam.unibe.ch/mailman/listinfo/moose-dev |
Re: [Pharo-project] experience with large images?
|
|
source anchors can also take space
nicolas ----- Mail original ----- > De: "Stéphane Ducasse" <[hidden email]> > À: "Moose-related development" <[hidden email]> > Envoyé: Samedi 26 Novembre 2011 09:38:54 > Objet: [Moose-dev] Re: [Pharo-project] experience with large images? > On Nov 24, 2011, at 9:08 PM, Alexandre Bergel wrote: > > >> - what is the level of reification because we reify a lot and it > >> can be discarded. > > > > We are actually measuring the dependencies a method has. We > > therefore need invocations, access to attributes, ... Close to the > > maximum level of import then. > > you do not need temp, comment > > > > >> - did you check the orion model > >> because with orion you only represent the delta and this is a big > >> difference. > > > > We haven't checked. Do you know whether Orion is integrated with > > Hismo? Can hismo be transparently used with Orion? > > Not that I know but orion is the way to go if you want to have a lot > of data. > > > > > Alexandre > > > >> > >> > >> > >> On Nov 24, 2011, at 2:05 PM, Alexandre Bergel wrote: > >> > >>> Having a reification in Moose of 100 versions of Mondrian for > >>> example :-) > >>> > >>> Just answering the question 'Which classes and methods of Mondrian > >>> have changed more than 10 times since the day Mondrian was born?' > >>> cannot be easily done without a lot of memory > >>> > >>> Alexandre > >>> > >>> > >>> On 24 Nov 2011, at 03:27, Francois Stephany wrote: > >>> > >>>> I'm wondering: how big is a dataset > 500MB ? I've no idea how > >>>> big it is. > >>>> Alex, what is your use case (in practice!) for more than 500MB? > >>>> > >>>> On 23/11/11 18:25, Igor Stasenko wrote: > >>>>> It is problematic, and requires different memory management than > >>>>> we > >>>>> currently have. > >>>>> I think if you need really big data sets, then use gemstone, > >>>>> which is > >>>>> developed to deal with that specifically. > >>>> > >>> > >>> -- > >>> _,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;: > >>> Alexandre Bergel http://www.bergel.eu > >>> ^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;. > >>> > >>> > >>> > >>> > >>> > >>> > >> > >> > > > > -- > > _,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;: > > Alexandre Bergel http://www.bergel.eu > > ^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;. > > > > > > > > > > > > _______________________________________________ > > Moose-dev mailing list > > [hidden email] > > https://www.iam.unibe.ch/mailman/listinfo/moose-dev > > > _______________________________________________ > Moose-dev mailing list > [hidden email] > https://www.iam.unibe.ch/mailman/listinfo/moose-dev _______________________________________________ Moose-dev mailing list [hidden email] https://www.iam.unibe.ch/mailman/listinfo/moose-dev |
«
Return to Moose
|
1 view|%1 views
| Free forum by Nabble | Edit this page |