Hello,
I've been loading all of those packages in order to build a full web stack development image. Everything now loads fine and kind of works but... The image is really slowing down and the size is getting very large.
Here is the current one: 332580684 29 jul 10:50 Pharo-DripfeedIt-Magritte3-OpenDBX_20130729_1050.image 300+ megs... I've been doing some development in there and started looking for why this was getting so large and slow.
I did a SpaceTally print analysis and imported the results in a spreadsheet. Look at the top consumers, especially the Semaphore thing. It is way beyond whatever was expected. There is something wrong there.
There must be a leak of Points, MorphExtensions and I can't just figure out why there are so many Floats. I've been running test suites for some of the packages (e.g. OpenDBX and Glorp) and this may be the result.
This image is kind of what one doing web dev would end up with. But then, it is very hard to get rid of that unwanted space. I am trying to build a system I can start using for business projects and feel concerned about that memory growth very seriously.
Any pointers (I chased some already but here, there are way too many entries); Thx Phil Screen Shot 2013-07-29 at 11.09.56.png (246K) Download Attachment STspace.text (171K) Download Attachment |
Hi Phil Have you been using changeSets? I had the same problem once, i couldn't figure out what the problem was, but i think there is a problem in the sorter tool (and change sets).
2013/7/29 [hidden email] <[hidden email]>
|
Hi Sebastian,
No, not intentionally. My code is going into the default change set and there isn't that much. But... when looking at the Changes Sorter, there are indeed a lot of entries related to all of those modules (due to the configurations being loaded I guess - see screenshots for samples, the list is much longer).
Phil On Mon, Jul 29, 2013 at 11:39 AM, Sebastian Tleye <[hidden email]> wrote:
Screen Shot 2013-07-29 at 11.47.52.png (52K) Download Attachment |
Mmm, so i'm not sure. I remember, when i had this problem, i was using directly changeSets, i solved the problem doing "FileIn entire file" instead of "Install into a new change set" (when you drag a changeset into Pharo). But it was like a random bug since i haven't had that problem again (even using "Install into a new change set"
2013/7/29 [hidden email] <[hidden email]>
|
What also happened to me, is that, each time i saved the image (even if i did nothing), the image was growing its size. 2013/7/29 Sebastian Tleye <[hidden email]>
|
Try loading the packages each one at time, and between packages save the image and check if it is growing. 2013/7/29 Sebastian Tleye <[hidden email]>
|
Yes, same for me here.
I'll update my configuration to load everything in a fresh 2.0 and report the results. Thing is that loading that full configuration takes ages (GlorpDBX is taking 20 minutes to load...) and the VM gets the SmallInteger bug triggered with such a large config...
I really need to get to grips with what happens down there. Phil On Monday, July 29, 2013, Sebastian Tleye wrote:
-- --- Philippe Back
Dramatic Performance Improvements Mob: +32(0) 478 650 140 | Fax: +32 (0) 70 408 027
Blog: http://philippeback.be | Twitter: @philippeback
High Octane SPRL rue cour Boisacq 101 | 1301 Bierges | Belgium Featured on the Software Process and Measurement Cast
Sparx Systems Enterprise Architect and Ability Engineering EADocX Value Added Reseller |
On Mon, Jul 29, 2013 at 9:02 AM, [hidden email] <[hidden email]> wrote: Yes, same for me here. It's easy to fix workaround SmallInteger add issue. Just one line of code in Metacello. And yes, it takes ages. I also build an app that loads Seaside, Magritte3, GlorpDBX, etc and it takes quite a lot.
Esteban did something to improve Monticello loading in Pharo 3.0....but that's 3.0, not 2.0...
Mariano http://marianopeck.wordpress.com |
In reply to this post by philippeback
On Jul 29, 2013, at 11:29 AM, [hidden email] wrote: > Hello, > > I've been loading all of those packages in order to build a full web stack development image. > > Everything now loads fine and kind of works but... > > The image is really slowing down and the size is getting very large. > > Here is the current one: > > 332580684 29 jul 10:50 Pharo-DripfeedIt-Magritte3-OpenDBX_20130729_1050.image > > 300+ megs... > Can you try to execute ImageCleaner cleanUpForRelease This way we know if maybe some cache is hanging onto something. > I've been doing some development in there and started looking for why this was getting so large and slow. > > I did a SpaceTally print analysis and imported the results in a spreadsheet. > > Look at the top consumers, especially the Semaphore thing. It is way beyond whatever was expected. There is something wrong there. > > There must be a leak of Points, MorphExtensions and I can't just figure out why there are so many Floats. > MorphExtension should only be referenced by the Morph it extends. So there should always be more Morphs than extensions. This looks really strange. Marcus |
In reply to this post by Mariano Martinez Peck
What Metacello line ? :-) I see that we are navigating the same kinds of waters with these things. Hopefully for the best. I am also quite concerned about the image doing blocking calls w/ databases etc.On Mon, Jul 29, 2013 at 2:11 PM, Mariano Martinez Peck <[hidden email]> wrote:
|
In reply to this post by Marcus Denker-4
I did. No significant change. --- Philippe Back Dramatic Performance Improvements Mob: +32(0) 478 650 140 | Fax: +32 (0) 70 408 027
Blog: http://philippeback.be | Twitter: @philippeback
High Octane SPRL rue cour Boisacq 101 | 1301 Bierges | Belgium
Featured on the Software Process and Measurement Cast Sparx Systems Enterprise Architect and Ability Engineering EADocX Value Added Reseller
On Mon, Jul 29, 2013 at 2:20 PM, Marcus Denker <[hidden email]> wrote:
|
In reply to this post by Marcus Denker-4
A possibility would be the AST cache. During development, if you do things like recompileAll or load packages the AST cache can grow the image size up to 300 Mo. But this cache is deleted when saving & quitting the image. Did you save and quit the image before looking at the memory size ? It might also be bugs related to Morph as you suggested because there was refactoring in it. We are investigating.
2013/7/29 Marcus Denker <[hidden email]>
|
Yes, I did. I do regular saves and then a final save and quit. How can I know if the AST cache is large in a running image? On Mon, Jul 29, 2013 at 3:53 PM, Clément Bera <[hidden email]> wrote:
|
On Jul 29, 2013, at 4:08 PM, "[hidden email]" <[hidden email]> wrote: > Yes, I did. I do regular saves and then a final save and quit. > > How can I know if the AST cache is large in a running image? > This can not happen in 2.0, as method #ast has not senders. #parseTree does not cache. Marcus |
In reply to this post by Marcus Denker-4
>>
>> Look at the top consumers, especially the Semaphore thing. It is way beyond whatever was expected. There is something wrong there. >> >> There must be a leak of Points, MorphExtensions and I can't just figure out why there are so many Floats. >> > MorphExtension should only be referenced by the Morph it extends. So there should always be more Morphs than extensions. > This looks really strange. yes this is really strange. > > Marcus > > |
I can send you my image but need to remove all my credentials from there first. --- Philippe Back Dramatic Performance Improvements
Mob: +32(0) 478 650 140 | Fax: +32 (0) 70 408 027
Blog: http://philippeback.be | Twitter: @philippeback
High Octane SPRL rue cour Boisacq 101 | 1301 Bierges | Belgium Featured on the Software Process and Measurement Cast
Sparx Systems Enterprise Architect and Ability Engineering EADocX Value Added Reseller On Mon, Jul 29, 2013 at 4:43 PM, Stéphane Ducasse <[hidden email]> wrote: >> |
Yes please (if it is not too much work :) ) I would like to check something. 2013/7/29 [hidden email] <[hidden email]>
|
The image and the changes file are here: (uploading... will take a while - 30 min or so)
Phil On Mon, Jul 29, 2013 at 5:06 PM, Sebastian Tleye <[hidden email]> wrote:
|
On Jul 29, 2013, at 7:31 PM, [hidden email] wrote: Ok, I downloaded them. Marcus |
On 30 July 2013 10:51, Marcus Denker <[hidden email]> wrote:
> > On Jul 29, 2013, at 7:31 PM, [hidden email] wrote: > > The image and the changes file are here: (uploading... will take a while - > 30 min or so) > > https://www.dropbox.com/sh/wfxep3jm5v27szt/5keLUTFvGz > > Ok, I downloaded them. > > Marcus > it appears that .changes file is corrupt, for instance , browse: WAWelcomeBrowse>>renderContentOn: and it shows: ontentOn: html html heading level1...... (and i guess all code which loaded after certain point is corrupt) i also found 2 UI processes hanging around as well as some others which i cannot terminate.. something went wrong during installing the code. -- Best regards, Igor Stasenko. |
Free forum by Nabble | Edit this page |