Smalltalk › Frameworks & Tools › Moose

Adding memory to image

_‹ Previous Topic Next Topic _›

Classic

List

Threaded

12 messages Options

Natalia Tymchuk

Adding memory to image

Hello.

I want to load mse file (238 MB) into Moose image and I want to download even bigger files in the future. But the image crashed during the loading.

I tried to increase the size of image by adding the memory from command line ( --memory 4092; and even --memory 4190208), however the amount of “Space left” didn’t change.

Is there any way to solve this?

Best regards,

Natalia

_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

Sven Van Caekenberghe-2

Re: Adding memory to image

The practical limit is about 1Gb of data.

Pharo is currently 32-bit.

The Spur VM will start to change this.

> On 16 Apr 2015, at 17:03, Natalia Tymchuk <[hidden email]> wrote:
>
> Hello.
> I want to load mse file (238 MB) into Moose image and I want to download even bigger files in the future. But the image crashed during the loading.
> I tried to increase the size of image by adding the memory from command line ( --memory 4092; and even --memory 4190208), however the amount of “Space left” didn’t change.
> Is there any way to solve this?
>
> Best regards,
> Natalia
> _______________________________________________
> Moose-dev mailing list
> [hidden email]
> https://www.iam.unibe.ch/mailman/listinfo/moose-dev

_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

Sebastian Heidbrink-2

Re: Adding memory to image

In reply to this post by Natalia Tymchuk

Hi Natalia,

add this into your Pharo.ini

AddressSpaceLimit=2048

On Windows you will reach at least 1,6GB of image size. The problem is that this could also crash at 1.2GB since zou computer must have "ONE block" of memory available for the PharoVM. So for the beginning it might be a good idea to have other application that are not really needed closed.

And check your implementations and the garbage collection!
I find that I had trouble to load data since e.g. the Playground does not really free the memory once you close a pane. So close playgrounds that are not used, too.

I was able to load a 600Mb GIS shape file the other day and visualize it with Roassal.... but in that case there is not much space for processing anything left
the image becomes very unstable.

I currently try to use Gemstone and tODE onServerDo: blocks to find a way around this.
As well as spwaning additional Pharo images, but I can't share anything yet.

Sebastian

Am 16.04.2015 um 08:03 schrieb Natalia Tymchuk:

Hello.
I want to load mse file (238 MB) into Moose image and I want to download even bigger files in the future. But the image crashed during the loading.

I tried to increase the size of image by adding the memory from command line ( --memory 4092; and even --memory 4190208), however the amount of “Space left” didn’t change.

Is there any way to solve this?

Best regards,

Natalia
_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

abergel

Re: Adding memory to image

Yuuu!!!!

Any screenshots you can share? :-)

Alexandre

--
_,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:
Alexandre Bergel http://www.bergel.eu
^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;.

On Apr 16, 2015, at 12:26 PM, Sebastian Heidbrink <[hidden email]> wrote:

I was able to load a 600Mb GIS shape file the other day and visualize it with Roassal.... but in that case there is not much space for processing anything left
the image becomes very unstable.

_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

Stephan Eggermont-3

Re: Adding memory to image

In reply to this post by Natalia Tymchuk

Another problem is the structure of the FAMIX model.
The deep inheritance leads to leaf elements having too many instVars,
and the storage not being very memory efficient.
That leads to the model size blowing up.

Stephan

On 16-04-15 17:03, Natalia Tymchuk wrote:

Hello.
I want to load mse file (238 MB) into Moose image and I want to download even bigger files in the future. But the image crashed during the loading.

I tried to increase the size of image by adding the memory from command line ( --memory 4092; and even --memory 4190208), however the amount of “Space left” didn’t change.

Is there any way to solve this?

Best regards,

Natalia
_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

Sebastian Heidbrink-2

Re: Adding memory to image

In reply to this post by abergel

Unfortunately that is not possible. Sorry.

Am 16.04.2015 um 08:49 schrieb Alexandre Bergel:

Yuuu!!!!
Any screenshots you can share? :-)

Alexandre

--
_,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:
Alexandre Bergel http://www.bergel.eu
^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;.

On Apr 16, 2015, at 12:26 PM, Sebastian Heidbrink <[hidden email]> wrote:

I was able to load a 600Mb GIS shape file the other day and visualize it with Roassal.... but in that case there is not much space for processing anything left
the image becomes very unstable.
_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

Natalia Tymchuk

Re: Adding memory to image

In reply to this post by Sebastian Heidbrink-2

Hi.

On 16 Apr 2015, at 17:26, Sebastian Heidbrink <[hidden email]> wrote:

AddressSpaceLimit=2048

I don’t know what is Pharo.ini, however I found in Pharo Contents the file Info.plist and there is

<key>SqueakMaxHeapSize</key>

I can increase the memory from 512 MB to 1074 MB, but if I want to put more than 1074 MB I got the message

But 2048 MB is better )), so where I can find Pharo.ini?

Kind regards,

Natalia

_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

Nicolas Anquetil

Re: Adding memory to image

on windows?
may be in the same directory as the VM ?

pay attention however that pharo needs a CONTINUOUS block of memory.
So even if you have 4 G. of RAM in your computer, you may well be unable to give more than 1G. to pharo

nicolas

On 17/04/2015 15:07, Natalia Tymchuk wrote:

Hi.

On 16 Apr 2015, at 17:26, Sebastian Heidbrink <[hidden email]> wrote:

AddressSpaceLimit=2048

I don’t know what is Pharo.ini, however I found in Pharo Contents the file Info.plist and there is

<key>SqueakMaxHeapSize</key>

<integer>536870912</integer>
I can increase the memory from 512 MB to 1074 MB, but if I want to put more than 1074 MB I got the message

But 2048 MB is better )), so where I can find Pharo.ini?

Kind regards,

Natalia
_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

abergel

Re: Adding memory to image

In reply to this post by Natalia Tymchuk

Hi Natalia,

I have also experience the same. Increasing the memory raises this information popup.

Alexandre

--
_,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:
Alexandre Bergel http://www.bergel.eu
^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;.

On Apr 17, 2015, at 10:07 AM, Natalia Tymchuk <[hidden email]> wrote:

Hi.

On 16 Apr 2015, at 17:26, Sebastian Heidbrink <[hidden email]> wrote:

AddressSpaceLimit=2048

I don’t know what is Pharo.ini, however I found in Pharo Contents the file Info.plist and there is
<key>SqueakMaxHeapSize</key>
<integer>536870912</integer>
I can increase the memory from 512 MB to 1074 MB, but if I want to put more than 1074 MB I got the message
<Screen Shot 2015-04-17 at 14.43.13.png>

But 2048 MB is better )), so where I can find Pharo.ini?

Kind regards,
Natalia

_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

stepharo

Re: Adding memory to image

In reply to this post by Natalia Tymchuk

Natalia

- first Did you created this file from Moose from the Pharo extractor?
Because there are settings to filter what you want to extract.

- second I think that andre did some scripts to load models and save them with less information.
Because it is rare to need all the information.

Stef

Le 16/4/15 17:03, Natalia Tymchuk a écrit :

Hello.
I want to load mse file (238 MB) into Moose image and I want to download even bigger files in the future. But the image crashed during the loading.

I tried to increase the size of image by adding the memory from command line ( --memory 4092; and even --memory 4190208), however the amount of “Space left” didn’t change.

Is there any way to solve this?

Best regards,

Natalia
_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

stepharo

Re: Adding memory to image

In reply to this post by Stephan Eggermont-3

Another problem is the structure of the FAMIX model.
The deep inheritance leads to leaf elements having too many instVars,
and the storage not being very memory efficient.
That leads to the model size blowing up.

Yes. Using dictionary would help and using slots in the future too.

Stephan

On 16-04-15 17:03, Natalia Tymchuk wrote:
Hello.
I want to load mse file (238 MB) into Moose image and I want to download even bigger files in the future. But the image crashed during the loading.

I tried to increase the size of image by adding the memory from command line ( --memory 4092; and even --memory 4190208), however the amount of “Space left” didn’t change.

Is there any way to solve this?

Best regards,

Natalia
_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev
_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

Natalia Tymchuk

Re: Adding memory to image

In reply to this post by stepharo

Hello,

> - first Did you created this file from Moose from the Pharo extractor?
No, I used VerveineJ.

> Because there are settings to filter what you want to extract.
I’m interested in it. Where can I find the information about it?

> - second I think that Andre did some scripts to load models and save them with less information.
> Because it is rare to need all the information.
Yes, I have this opportunity with VerveineJ.

Kind regards,
Natalia

_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev