[squeak-dev] Smalltalk vmParameterAt:put: ?

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

[squeak-dev] Smalltalk vmParameterAt:put: ?

Jimmie Houchin-3
Hello,

I am having problems parsing and reading some csv data files which are
large. 25-50mb each. Each containing about 300,000 rows.
In the end I will 10s of millions of objects from these files.

I am using the latest squeak-dev image. My import program starts of
fine, but uses almost 100% of a cpu. The image is consuming more memory
as it goes, but I have only seen it get to 128mb or so.

So in an effort to get my data imported so that I can study it, and not
to have to use Python to do so. I started searching the squeak archives,
because I thought I remember some magic settings which helped memory
management, garbageCollection or something.

I found the 100 million objects thread and I copied Andreas code that he
uses for QF into a method to initialize the settings.

Which has a lot of messages like:
Smalltalk vmParameterAt: 5 put: 40000. "allocations between GCs
(default: 4000)"

But when I run the method I get this error.

SystemDictionary(Object)>> doesNotUnderstand: #vmParameterAt:put:

I opened up a couple of other clean images. Same problem.

Any help understanding why that isn't working would be greatly
appreciated.  And how I can get it working. :)

Thanks.

Jimmie

Reply | Threaded
Open this post in threaded view
|

Re: [squeak-dev] Smalltalk vmParameterAt:put: ?

Adrian Lienhard
SmalltalkImage current vmParameterAt: 5 put: 40000

HTH,
Adrian

On Jun 5, 2008, at 15:23 , Jimmie Houchin wrote:

> Hello,
>
> I am having problems parsing and reading some csv data files which are
> large. 25-50mb each. Each containing about 300,000 rows.
> In the end I will 10s of millions of objects from these files.
>
> I am using the latest squeak-dev image. My import program starts of
> fine, but uses almost 100% of a cpu. The image is consuming more  
> memory
> as it goes, but I have only seen it get to 128mb or so.
>
> So in an effort to get my data imported so that I can study it, and  
> not
> to have to use Python to do so. I started searching the squeak  
> archives,
> because I thought I remember some magic settings which helped memory
> management, garbageCollection or something.
>
> I found the 100 million objects thread and I copied Andreas code  
> that he
> uses for QF into a method to initialize the settings.
>
> Which has a lot of messages like:
> Smalltalk vmParameterAt: 5 put: 40000. "allocations between GCs
> (default: 4000)"
>
> But when I run the method I get this error.
>
> SystemDictionary(Object)>> doesNotUnderstand: #vmParameterAt:put:
>
> I opened up a couple of other clean images. Same problem.
>
> Any help understanding why that isn't working would be greatly
> appreciated.  And how I can get it working. :)
>
> Thanks.
>
> Jimmie
>


Reply | Threaded
Open this post in threaded view
|

Re: [squeak-dev] Smalltalk vmParameterAt:put: ?

Bert Freudenberg
In reply to this post by Jimmie Houchin-3

On 05.06.2008, at 15:23, Jimmie Houchin wrote:
>
> SystemDictionary(Object)>> doesNotUnderstand: #vmParameterAt:put:

Just find out who implements vmParameterAt:put: in your image. Might  
have been refactored.  I suspect "SmalltalkImage current".

- Bert -



Reply | Threaded
Open this post in threaded view
|

Re: [squeak-dev] Smalltalk vmParameterAt:put: ?

Jimmie Houchin-3
In reply to this post by Adrian Lienhard
Adrian Lienhard wrote:
> SmalltalkImage current vmParameterAt: 5 put: 40000
>
> HTH,
> Adrian

Adrian and Bert,

Thank you very, very much.

That worked.

I had done a search for #vmParameterAt:put: and found SmalltalkImage and
I tried that. It failed. But I didn't understand that I needed the
#current message first.

Thanks.

Jimmie