verveineJ - Java heap space

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
17 messages Options
Reply | Threaded
Open this post in threaded view
|

verveineJ - Java heap space

Andrea Caracciolo
Hi,

I' trying to run verveineJ on the Eclipse source code .. and i always get this:

Exception in thread "main" java.lang.OutOfMemoryError: Java heap space
        at java.util.LinkedList.addBefore(LinkedList.java:778)
        at java.util.LinkedList.add(LinkedList.java:198)
        at fr.inria.verveine.core.Dictionary.getEntityByName(Unknown Source)
        at fr.inria.verveine.extractor.java.JavaDictionary.ensureFamixMethod(Unknown Source)
        at fr.inria.verveine.extractor.java.VerveineVisitor.visitVariablesDeclarations(Unknown Source)
        at fr.inria.verveine.extractor.java.VerveineVisitor.visit(Unknown Source)
        at org.eclipse.jdt.core.dom.FieldDeclaration.accept0(FieldDeclaration.java:279)
        at org.eclipse.jdt.core.dom.ASTNode.accept(ASTNode.java:2514)
        at org.eclipse.jdt.core.dom.ASTNode.acceptChildren(ASTNode.java:2585)
        at org.eclipse.jdt.core.dom.TypeDeclaration.accept0(TypeDeclaration.java:484)
        at org.eclipse.jdt.core.dom.ASTNode.accept(ASTNode.java:2514)
        at org.eclipse.jdt.core.dom.ASTNode.acceptChildren(ASTNode.java:2585)
        at org.eclipse.jdt.core.dom.CompilationUnit.accept0(CompilationUnit.java:219)
        at org.eclipse.jdt.core.dom.ASTNode.accept(ASTNode.java:2514)
        at fr.inria.verveine.extractor.java.FamixRequestor.acceptAST(Unknown Source)
        at org.eclipse.jdt.core.dom.CompilationUnitResolver.resolve(CompilationUnitResolver.java:1016)
        at org.eclipse.jdt.core.dom.CompilationUnitResolver.resolve(CompilationUnitResolver.java:628)
        at org.eclipse.jdt.core.dom.ASTParser.createASTs(ASTParser.java:988)
        at fr.inria.verveine.extractor.java.VerveineJParser.parse(Unknown Source)
        at fr.inria.verveine.extractor.java.VerveineJParser.main(Unknown Source)


I tried adding -Xmx4000m .. but i still get the same exception.

Is there another trick ?

Thanks.
Andrea
_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev
Reply | Threaded
Open this post in threaded view
|

Re: verveineJ - Java heap space

Tudor Girba-2
I guess not.

Did you try with inFamix? This one claims to be optimized for memory.

Cheers,
Doru


On 2 Aug 2012, at 12:22, Andrea Caracciolo wrote:

> Hi,
>
> I' trying to run verveineJ on the Eclipse source code .. and i always get this:
>
> Exception in thread "main" java.lang.OutOfMemoryError: Java heap space
> at java.util.LinkedList.addBefore(LinkedList.java:778)
> at java.util.LinkedList.add(LinkedList.java:198)
> at fr.inria.verveine.core.Dictionary.getEntityByName(Unknown Source)
> at fr.inria.verveine.extractor.java.JavaDictionary.ensureFamixMethod(Unknown Source)
> at fr.inria.verveine.extractor.java.VerveineVisitor.visitVariablesDeclarations(Unknown Source)
> at fr.inria.verveine.extractor.java.VerveineVisitor.visit(Unknown Source)
> at org.eclipse.jdt.core.dom.FieldDeclaration.accept0(FieldDeclaration.java:279)
> at org.eclipse.jdt.core.dom.ASTNode.accept(ASTNode.java:2514)
> at org.eclipse.jdt.core.dom.ASTNode.acceptChildren(ASTNode.java:2585)
> at org.eclipse.jdt.core.dom.TypeDeclaration.accept0(TypeDeclaration.java:484)
> at org.eclipse.jdt.core.dom.ASTNode.accept(ASTNode.java:2514)
> at org.eclipse.jdt.core.dom.ASTNode.acceptChildren(ASTNode.java:2585)
> at org.eclipse.jdt.core.dom.CompilationUnit.accept0(CompilationUnit.java:219)
> at org.eclipse.jdt.core.dom.ASTNode.accept(ASTNode.java:2514)
> at fr.inria.verveine.extractor.java.FamixRequestor.acceptAST(Unknown Source)
> at org.eclipse.jdt.core.dom.CompilationUnitResolver.resolve(CompilationUnitResolver.java:1016)
> at org.eclipse.jdt.core.dom.CompilationUnitResolver.resolve(CompilationUnitResolver.java:628)
> at org.eclipse.jdt.core.dom.ASTParser.createASTs(ASTParser.java:988)
> at fr.inria.verveine.extractor.java.VerveineJParser.parse(Unknown Source)
> at fr.inria.verveine.extractor.java.VerveineJParser.main(Unknown Source)
>
>
> I tried adding -Xmx4000m .. but i still get the same exception.
>
> Is there another trick ?
>
> Thanks.
> Andrea
> _______________________________________________
> Moose-dev mailing list
> [hidden email]
> https://www.iam.unibe.ch/mailman/listinfo/moose-dev

--
www.tudorgirba.com

"To utilize feedback, you first have to acquire it."


_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev
Reply | Threaded
Open this post in threaded view
|

Re: verveineJ - Java heap space

jannik laval
That is why we need to share mse files.

I am uploading files (It will be available soon here: https://docs.google.com/folder/d/0B8B4OafJIEKhV2pwekNPN05iQjQ/edit)
There are:
- one Moose image configured with 2Gb memory and Eclipse3.4 loaded
- the mse files of Eclipse 1.0 to 3.7.1 (40 different versions).

These files are zipped in tar.bz2, they are created with the VerveinJ (downloaded in July 2012). And they work with Moose 4.6 (maybe other versons, not tried).

I have also all the mse files of the Qualitas Corpus.

Cheers,
Jannik

On Aug 3, 2012, at 10:16 PM, Tudor Girba <[hidden email]> wrote:

> I guess not.
>
> Did you try with inFamix? This one claims to be optimized for memory.
>
> Cheers,
> Doru
>
>
> On 2 Aug 2012, at 12:22, Andrea Caracciolo wrote:
>
>> Hi,
>>
>> I' trying to run verveineJ on the Eclipse source code .. and i always get this:
>>
>> Exception in thread "main" java.lang.OutOfMemoryError: Java heap space
>> at java.util.LinkedList.addBefore(LinkedList.java:778)
>> at java.util.LinkedList.add(LinkedList.java:198)
>> at fr.inria.verveine.core.Dictionary.getEntityByName(Unknown Source)
>> at fr.inria.verveine.extractor.java.JavaDictionary.ensureFamixMethod(Unknown Source)
>> at fr.inria.verveine.extractor.java.VerveineVisitor.visitVariablesDeclarations(Unknown Source)
>> at fr.inria.verveine.extractor.java.VerveineVisitor.visit(Unknown Source)
>> at org.eclipse.jdt.core.dom.FieldDeclaration.accept0(FieldDeclaration.java:279)
>> at org.eclipse.jdt.core.dom.ASTNode.accept(ASTNode.java:2514)
>> at org.eclipse.jdt.core.dom.ASTNode.acceptChildren(ASTNode.java:2585)
>> at org.eclipse.jdt.core.dom.TypeDeclaration.accept0(TypeDeclaration.java:484)
>> at org.eclipse.jdt.core.dom.ASTNode.accept(ASTNode.java:2514)
>> at org.eclipse.jdt.core.dom.ASTNode.acceptChildren(ASTNode.java:2585)
>> at org.eclipse.jdt.core.dom.CompilationUnit.accept0(CompilationUnit.java:219)
>> at org.eclipse.jdt.core.dom.ASTNode.accept(ASTNode.java:2514)
>> at fr.inria.verveine.extractor.java.FamixRequestor.acceptAST(Unknown Source)
>> at org.eclipse.jdt.core.dom.CompilationUnitResolver.resolve(CompilationUnitResolver.java:1016)
>> at org.eclipse.jdt.core.dom.CompilationUnitResolver.resolve(CompilationUnitResolver.java:628)
>> at org.eclipse.jdt.core.dom.ASTParser.createASTs(ASTParser.java:988)
>> at fr.inria.verveine.extractor.java.VerveineJParser.parse(Unknown Source)
>> at fr.inria.verveine.extractor.java.VerveineJParser.main(Unknown Source)
>>
>>
>> I tried adding -Xmx4000m .. but i still get the same exception.
>>
>> Is there another trick ?
>>
>> Thanks.
>> Andrea
>> _______________________________________________
>> Moose-dev mailing list
>> [hidden email]
>> https://www.iam.unibe.ch/mailman/listinfo/moose-dev
>
> --
> www.tudorgirba.com
>
> "To utilize feedback, you first have to acquire it."
>
>
> _______________________________________________
> Moose-dev mailing list
> [hidden email]
> https://www.iam.unibe.ch/mailman/listinfo/moose-dev

---
Jannik Laval


_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev
Reply | Threaded
Open this post in threaded view
|

Re: verveineJ - Java heap space

Andrea Caracciolo
Great. 

Thanks for sharing your MSEs
I've setup a webserver to host these files: http://pinocchio.unibe.ch/QualitasCorpus/
I'm missing the MSE files for the eclipse version (I will use yours) and for netbeans-6.9.1. 

I also have to add the metadata files. 

How did you manage to generate the models for such big projects without getting out of memory ? 

cheers,
Andrea

On Aug 3, 2012, at 10:29 PM, jannik.laval wrote:

That is why we need to share mse files.

I am uploading files (It will be available soon here: https://docs.google.com/folder/d/0B8B4OafJIEKhV2pwekNPN05iQjQ/edit)
There are:
- one Moose image configured with 2Gb memory and Eclipse3.4 loaded
- the mse files of Eclipse 1.0 to 3.7.1 (40 different versions).

These files are zipped in tar.bz2, they are created with the VerveinJ (downloaded in July 2012). And they work with Moose 4.6 (maybe other versons, not tried).

I have also all the mse files of the Qualitas Corpus.

Cheers,
Jannik

On Aug 3, 2012, at 10:16 PM, Tudor Girba <[hidden email]> wrote:

I guess not.

Did you try with inFamix? This one claims to be optimized for memory.

Cheers,
Doru


On 2 Aug 2012, at 12:22, Andrea Caracciolo wrote:

Hi,

I' trying to run verveineJ on the Eclipse source code .. and i always get this:

Exception in thread "main" java.lang.OutOfMemoryError: Java heap space
at java.util.LinkedList.addBefore(LinkedList.java:778)
at java.util.LinkedList.add(LinkedList.java:198)
at fr.inria.verveine.core.Dictionary.getEntityByName(Unknown Source)
at fr.inria.verveine.extractor.java.JavaDictionary.ensureFamixMethod(Unknown Source)
at fr.inria.verveine.extractor.java.VerveineVisitor.visitVariablesDeclarations(Unknown Source)
at fr.inria.verveine.extractor.java.VerveineVisitor.visit(Unknown Source)
at org.eclipse.jdt.core.dom.FieldDeclaration.accept0(FieldDeclaration.java:279)
at org.eclipse.jdt.core.dom.ASTNode.accept(ASTNode.java:2514)
at org.eclipse.jdt.core.dom.ASTNode.acceptChildren(ASTNode.java:2585)
at org.eclipse.jdt.core.dom.TypeDeclaration.accept0(TypeDeclaration.java:484)
at org.eclipse.jdt.core.dom.ASTNode.accept(ASTNode.java:2514)
at org.eclipse.jdt.core.dom.ASTNode.acceptChildren(ASTNode.java:2585)
at org.eclipse.jdt.core.dom.CompilationUnit.accept0(CompilationUnit.java:219)
at org.eclipse.jdt.core.dom.ASTNode.accept(ASTNode.java:2514)
at fr.inria.verveine.extractor.java.FamixRequestor.acceptAST(Unknown Source)
at org.eclipse.jdt.core.dom.CompilationUnitResolver.resolve(CompilationUnitResolver.java:1016)
at org.eclipse.jdt.core.dom.CompilationUnitResolver.resolve(CompilationUnitResolver.java:628)
at org.eclipse.jdt.core.dom.ASTParser.createASTs(ASTParser.java:988)
at fr.inria.verveine.extractor.java.VerveineJParser.parse(Unknown Source)
at fr.inria.verveine.extractor.java.VerveineJParser.main(Unknown Source)


I tried adding -Xmx4000m .. but i still get the same exception.

Is there another trick ?

Thanks.
Andrea
_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

--
www.tudorgirba.com

"To utilize feedback, you first have to acquire it."


_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

---
Jannik Laval


_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev


_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev
Reply | Threaded
Open this post in threaded view
|

Re: verveineJ - Java heap space

jannik laval

On Aug 6, 2012, at 10:23 AM, Andrea Caracciolo <[hidden email]> wrote:

Great. 

Thanks for sharing your MSEs
I've setup a webserver to host these files: http://pinocchio.unibe.ch/QualitasCorpus/

Ok, I am trying to access, but it is not possible to access for now.

I'm missing the MSE files for the eclipse version (I will use yours) and for netbeans-6.9.1. 

I generated the mse of netbeans yesterday (the last one I have to do).
This one is really big ! The mse file is a 1Gb file.
It will be soon in the same repository of Google drive: https://docs.google.com/folder/d/0B8B4OafJIEKhV2pwekNPN05iQjQ/edit



I also have to add the metadata files. 

Yes


How did you manage to generate the models for such big projects without getting out of memory ? 

hehe, for all files but netbeans, I had the JVM parameter -Xmx8000M.
For netbeans, -Xmx16000m is good.

So, do not try to do that without enough memory or a SSD ==> I have a 14Gb swap memory file.

Cheers,
Jannik


cheers,
Andrea

On Aug 3, 2012, at 10:29 PM, jannik.laval wrote:

That is why we need to share mse files.

I am uploading files (It will be available soon here: https://docs.google.com/folder/d/0B8B4OafJIEKhV2pwekNPN05iQjQ/edit)
There are:
- one Moose image configured with 2Gb memory and Eclipse3.4 loaded
- the mse files of Eclipse 1.0 to 3.7.1 (40 different versions).

These files are zipped in tar.bz2, they are created with the VerveinJ (downloaded in July 2012). And they work with Moose 4.6 (maybe other versons, not tried).

I have also all the mse files of the Qualitas Corpus.

Cheers,
Jannik

On Aug 3, 2012, at 10:16 PM, Tudor Girba <[hidden email]> wrote:

I guess not.

Did you try with inFamix? This one claims to be optimized for memory.

Cheers,
Doru


On 2 Aug 2012, at 12:22, Andrea Caracciolo wrote:

Hi,

I' trying to run verveineJ on the Eclipse source code .. and i always get this:

Exception in thread "main" java.lang.OutOfMemoryError: Java heap space
at java.util.LinkedList.addBefore(LinkedList.java:778)
at java.util.LinkedList.add(LinkedList.java:198)
at fr.inria.verveine.core.Dictionary.getEntityByName(Unknown Source)
at fr.inria.verveine.extractor.java.JavaDictionary.ensureFamixMethod(Unknown Source)
at fr.inria.verveine.extractor.java.VerveineVisitor.visitVariablesDeclarations(Unknown Source)
at fr.inria.verveine.extractor.java.VerveineVisitor.visit(Unknown Source)
at org.eclipse.jdt.core.dom.FieldDeclaration.accept0(FieldDeclaration.java:279)
at org.eclipse.jdt.core.dom.ASTNode.accept(ASTNode.java:2514)
at org.eclipse.jdt.core.dom.ASTNode.acceptChildren(ASTNode.java:2585)
at org.eclipse.jdt.core.dom.TypeDeclaration.accept0(TypeDeclaration.java:484)
at org.eclipse.jdt.core.dom.ASTNode.accept(ASTNode.java:2514)
at org.eclipse.jdt.core.dom.ASTNode.acceptChildren(ASTNode.java:2585)
at org.eclipse.jdt.core.dom.CompilationUnit.accept0(CompilationUnit.java:219)
at org.eclipse.jdt.core.dom.ASTNode.accept(ASTNode.java:2514)
at fr.inria.verveine.extractor.java.FamixRequestor.acceptAST(Unknown Source)
at org.eclipse.jdt.core.dom.CompilationUnitResolver.resolve(CompilationUnitResolver.java:1016)
at org.eclipse.jdt.core.dom.CompilationUnitResolver.resolve(CompilationUnitResolver.java:628)
at org.eclipse.jdt.core.dom.ASTParser.createASTs(ASTParser.java:988)
at fr.inria.verveine.extractor.java.VerveineJParser.parse(Unknown Source)
at fr.inria.verveine.extractor.java.VerveineJParser.main(Unknown Source)


I tried adding -Xmx4000m .. but i still get the same exception.

Is there another trick ?

Thanks.
Andrea
_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

--
www.tudorgirba.com

"To utilize feedback, you first have to acquire it."


_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

---
Jannik Laval


_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

---
Jannik Laval


_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev
Reply | Threaded
Open this post in threaded view
|

Re: verveineJ - Java heap space

Andrea Caracciolo

On Aug 6, 2012, at 10:32 AM, jannik.laval wrote:


On Aug 6, 2012, at 10:23 AM, Andrea Caracciolo <[hidden email]> wrote:

Great. 

Thanks for sharing your MSEs
I've setup a webserver to host these files: http://pinocchio.unibe.ch/QualitasCorpus/

Ok, I am trying to access, but it is not possible to access for now.

Looks like there is something to fix with DNS. 
I will look at it in the following days and notify you when everything is set in place. 


I'm missing the MSE files for the eclipse version (I will use yours) and for netbeans-6.9.1. 

I generated the mse of netbeans yesterday (the last one I have to do).
This one is really big ! The mse file is a 1Gb file.
It will be soon in the same repository of Google drive: https://docs.google.com/folder/d/0B8B4OafJIEKhV2pwekNPN05iQjQ/edit



I also have to add the metadata files. 

Yes


How did you manage to generate the models for such big projects without getting out of memory ? 

hehe, for all files but netbeans, I had the JVM parameter -Xmx8000M.
For netbeans, -Xmx16000m is good.

So, do not try to do that without enough memory or a SSD ==> I have a 14Gb swap memory file.

Wow ! These are some serious HW requirements ! 
As Doru said, InFamix could probably do it without all that ram… 


Cheers,
Jannik


cheers,
Andrea

On Aug 3, 2012, at 10:29 PM, jannik.laval wrote:

That is why we need to share mse files.

I am uploading files (It will be available soon here: https://docs.google.com/folder/d/0B8B4OafJIEKhV2pwekNPN05iQjQ/edit)
There are:
- one Moose image configured with 2Gb memory and Eclipse3.4 loaded
- the mse files of Eclipse 1.0 to 3.7.1 (40 different versions).

These files are zipped in tar.bz2, they are created with the VerveinJ (downloaded in July 2012). And they work with Moose 4.6 (maybe other versons, not tried).

I have also all the mse files of the Qualitas Corpus.

Cheers,
Jannik

On Aug 3, 2012, at 10:16 PM, Tudor Girba <[hidden email]> wrote:

I guess not.

Did you try with inFamix? This one claims to be optimized for memory.

Cheers,
Doru


On 2 Aug 2012, at 12:22, Andrea Caracciolo wrote:

Hi,

I' trying to run verveineJ on the Eclipse source code .. and i always get this:

Exception in thread "main" java.lang.OutOfMemoryError: Java heap space
at java.util.LinkedList.addBefore(LinkedList.java:778)
at java.util.LinkedList.add(LinkedList.java:198)
at fr.inria.verveine.core.Dictionary.getEntityByName(Unknown Source)
at fr.inria.verveine.extractor.java.JavaDictionary.ensureFamixMethod(Unknown Source)
at fr.inria.verveine.extractor.java.VerveineVisitor.visitVariablesDeclarations(Unknown Source)
at fr.inria.verveine.extractor.java.VerveineVisitor.visit(Unknown Source)
at org.eclipse.jdt.core.dom.FieldDeclaration.accept0(FieldDeclaration.java:279)
at org.eclipse.jdt.core.dom.ASTNode.accept(ASTNode.java:2514)
at org.eclipse.jdt.core.dom.ASTNode.acceptChildren(ASTNode.java:2585)
at org.eclipse.jdt.core.dom.TypeDeclaration.accept0(TypeDeclaration.java:484)
at org.eclipse.jdt.core.dom.ASTNode.accept(ASTNode.java:2514)
at org.eclipse.jdt.core.dom.ASTNode.acceptChildren(ASTNode.java:2585)
at org.eclipse.jdt.core.dom.CompilationUnit.accept0(CompilationUnit.java:219)
at org.eclipse.jdt.core.dom.ASTNode.accept(ASTNode.java:2514)
at fr.inria.verveine.extractor.java.FamixRequestor.acceptAST(Unknown Source)
at org.eclipse.jdt.core.dom.CompilationUnitResolver.resolve(CompilationUnitResolver.java:1016)
at org.eclipse.jdt.core.dom.CompilationUnitResolver.resolve(CompilationUnitResolver.java:628)
at org.eclipse.jdt.core.dom.ASTParser.createASTs(ASTParser.java:988)
at fr.inria.verveine.extractor.java.VerveineJParser.parse(Unknown Source)
at fr.inria.verveine.extractor.java.VerveineJParser.main(Unknown Source)


I tried adding -Xmx4000m .. but i still get the same exception.

Is there another trick ?

Thanks.
Andrea
_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

--
www.tudorgirba.com

"To utilize feedback, you first have to acquire it."


_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

---
Jannik Laval


_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

---
Jannik Laval

_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev


_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev
Reply | Threaded
Open this post in threaded view
|

Re: verveineJ - Java heap space

jannik laval
For information: I tried to load Netbeans in Moose and it is not loadable.
We need more memory space.

Jannik

On Aug 6, 2012, at 11:31 AM, Andrea Caracciolo <[hidden email]> wrote:


On Aug 6, 2012, at 10:32 AM, jannik.laval wrote:


On Aug 6, 2012, at 10:23 AM, Andrea Caracciolo <[hidden email]> wrote:

Great. 

Thanks for sharing your MSEs
I've setup a webserver to host these files: http://pinocchio.unibe.ch/QualitasCorpus/

Ok, I am trying to access, but it is not possible to access for now.

Looks like there is something to fix with DNS. 
I will look at it in the following days and notify you when everything is set in place. 


I'm missing the MSE files for the eclipse version (I will use yours) and for netbeans-6.9.1. 

I generated the mse of netbeans yesterday (the last one I have to do).
This one is really big ! The mse file is a 1Gb file.
It will be soon in the same repository of Google drive: https://docs.google.com/folder/d/0B8B4OafJIEKhV2pwekNPN05iQjQ/edit



I also have to add the metadata files. 

Yes


How did you manage to generate the models for such big projects without getting out of memory ? 

hehe, for all files but netbeans, I had the JVM parameter -Xmx8000M.
For netbeans, -Xmx16000m is good.

So, do not try to do that without enough memory or a SSD ==> I have a 14Gb swap memory file.

Wow ! These are some serious HW requirements ! 
As Doru said, InFamix could probably do it without all that ram… 


Cheers,
Jannik


cheers,
Andrea

On Aug 3, 2012, at 10:29 PM, jannik.laval wrote:

That is why we need to share mse files.

I am uploading files (It will be available soon here: https://docs.google.com/folder/d/0B8B4OafJIEKhV2pwekNPN05iQjQ/edit)
There are:
- one Moose image configured with 2Gb memory and Eclipse3.4 loaded
- the mse files of Eclipse 1.0 to 3.7.1 (40 different versions).

These files are zipped in tar.bz2, they are created with the VerveinJ (downloaded in July 2012). And they work with Moose 4.6 (maybe other versons, not tried).

I have also all the mse files of the Qualitas Corpus.

Cheers,
Jannik

On Aug 3, 2012, at 10:16 PM, Tudor Girba <[hidden email]> wrote:

I guess not.

Did you try with inFamix? This one claims to be optimized for memory.

Cheers,
Doru


On 2 Aug 2012, at 12:22, Andrea Caracciolo wrote:

Hi,

I' trying to run verveineJ on the Eclipse source code .. and i always get this:

Exception in thread "main" java.lang.OutOfMemoryError: Java heap space
at java.util.LinkedList.addBefore(LinkedList.java:778)
at java.util.LinkedList.add(LinkedList.java:198)
at fr.inria.verveine.core.Dictionary.getEntityByName(Unknown Source)
at fr.inria.verveine.extractor.java.JavaDictionary.ensureFamixMethod(Unknown Source)
at fr.inria.verveine.extractor.java.VerveineVisitor.visitVariablesDeclarations(Unknown Source)
at fr.inria.verveine.extractor.java.VerveineVisitor.visit(Unknown Source)
at org.eclipse.jdt.core.dom.FieldDeclaration.accept0(FieldDeclaration.java:279)
at org.eclipse.jdt.core.dom.ASTNode.accept(ASTNode.java:2514)
at org.eclipse.jdt.core.dom.ASTNode.acceptChildren(ASTNode.java:2585)
at org.eclipse.jdt.core.dom.TypeDeclaration.accept0(TypeDeclaration.java:484)
at org.eclipse.jdt.core.dom.ASTNode.accept(ASTNode.java:2514)
at org.eclipse.jdt.core.dom.ASTNode.acceptChildren(ASTNode.java:2585)
at org.eclipse.jdt.core.dom.CompilationUnit.accept0(CompilationUnit.java:219)
at org.eclipse.jdt.core.dom.ASTNode.accept(ASTNode.java:2514)
at fr.inria.verveine.extractor.java.FamixRequestor.acceptAST(Unknown Source)
at org.eclipse.jdt.core.dom.CompilationUnitResolver.resolve(CompilationUnitResolver.java:1016)
at org.eclipse.jdt.core.dom.CompilationUnitResolver.resolve(CompilationUnitResolver.java:628)
at org.eclipse.jdt.core.dom.ASTParser.createASTs(ASTParser.java:988)
at fr.inria.verveine.extractor.java.VerveineJParser.parse(Unknown Source)
at fr.inria.verveine.extractor.java.VerveineJParser.main(Unknown Source)


I tried adding -Xmx4000m .. but i still get the same exception.

Is there another trick ?

Thanks.
Andrea
_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

--
www.tudorgirba.com

"To utilize feedback, you first have to acquire it."


_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

---
Jannik Laval


_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

---
Jannik Laval

_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

---
Jannik Laval


_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev
Reply | Threaded
Open this post in threaded view
|

Re: verveineJ - Java heap space

Stéphane Ducasse
Or to filter… do we need all the this objects and others.

Stef

On Aug 6, 2012, at 4:03 PM, jannik.laval wrote:

> For information: I tried to load Netbeans in Moose and it is not loadable.
> We need more memory space.
>
> Jannik
>
> On Aug 6, 2012, at 11:31 AM, Andrea Caracciolo <[hidden email]> wrote:
>
>>
>> On Aug 6, 2012, at 10:32 AM, jannik.laval wrote:
>>
>>>
>>> On Aug 6, 2012, at 10:23 AM, Andrea Caracciolo <[hidden email]> wrote:
>>>
>>>> Great.
>>>>
>>>> Thanks for sharing your MSEs
>>>> I've setup a webserver to host these files: http://pinocchio.unibe.ch/QualitasCorpus/
>>>
>>> Ok, I am trying to access, but it is not possible to access for now.
>>
>> Looks like there is something to fix with DNS.
>> I will look at it in the following days and notify you when everything is set in place.
>>
>>
>>>> I'm missing the MSE files for the eclipse version (I will use yours) and for netbeans-6.9.1.
>>>
>>> I generated the mse of netbeans yesterday (the last one I have to do).
>>> This one is really big ! The mse file is a 1Gb file.
>>> It will be soon in the same repository of Google drive: https://docs.google.com/folder/d/0B8B4OafJIEKhV2pwekNPN05iQjQ/edit
>>>
>>>
>>>>
>>>> I also have to add the metadata files.
>>>
>>> Yes
>>>
>>>>
>>>> How did you manage to generate the models for such big projects without getting out of memory ?
>>>
>>> hehe, for all files but netbeans, I had the JVM parameter -Xmx8000M.
>>> For netbeans, -Xmx16000m is good.
>>>
>>> So, do not try to do that without enough memory or a SSD ==> I have a 14Gb swap memory file.
>>
>> Wow ! These are some serious HW requirements !
>> As Doru said, InFamix could probably do it without all that ram…
>>
>>
>>> Cheers,
>>> Jannik
>>>
>>>>
>>>> cheers,
>>>> Andrea
>>>>
>>>> On Aug 3, 2012, at 10:29 PM, jannik.laval wrote:
>>>>
>>>>> That is why we need to share mse files.
>>>>>
>>>>> I am uploading files (It will be available soon here: https://docs.google.com/folder/d/0B8B4OafJIEKhV2pwekNPN05iQjQ/edit)
>>>>> There are:
>>>>> - one Moose image configured with 2Gb memory and Eclipse3.4 loaded
>>>>> - the mse files of Eclipse 1.0 to 3.7.1 (40 different versions).
>>>>>
>>>>> These files are zipped in tar.bz2, they are created with the VerveinJ (downloaded in July 2012). And they work with Moose 4.6 (maybe other versons, not tried).
>>>>>
>>>>> I have also all the mse files of the Qualitas Corpus.
>>>>>
>>>>> Cheers,
>>>>> Jannik
>>>>>
>>>>> On Aug 3, 2012, at 10:16 PM, Tudor Girba <[hidden email]> wrote:
>>>>>
>>>>>> I guess not.
>>>>>>
>>>>>> Did you try with inFamix? This one claims to be optimized for memory.
>>>>>>
>>>>>> Cheers,
>>>>>> Doru
>>>>>>
>>>>>>
>>>>>> On 2 Aug 2012, at 12:22, Andrea Caracciolo wrote:
>>>>>>
>>>>>>> Hi,
>>>>>>>
>>>>>>> I' trying to run verveineJ on the Eclipse source code .. and i always get this:
>>>>>>>
>>>>>>> Exception in thread "main" java.lang.OutOfMemoryError: Java heap space
>>>>>>> at java.util.LinkedList.addBefore(LinkedList.java:778)
>>>>>>> at java.util.LinkedList.add(LinkedList.java:198)
>>>>>>> at fr.inria.verveine.core.Dictionary.getEntityByName(Unknown Source)
>>>>>>> at fr.inria.verveine.extractor.java.JavaDictionary.ensureFamixMethod(Unknown Source)
>>>>>>> at fr.inria.verveine.extractor.java.VerveineVisitor.visitVariablesDeclarations(Unknown Source)
>>>>>>> at fr.inria.verveine.extractor.java.VerveineVisitor.visit(Unknown Source)
>>>>>>> at org.eclipse.jdt.core.dom.FieldDeclaration.accept0(FieldDeclaration.java:279)
>>>>>>> at org.eclipse.jdt.core.dom.ASTNode.accept(ASTNode.java:2514)
>>>>>>> at org.eclipse.jdt.core.dom.ASTNode.acceptChildren(ASTNode.java:2585)
>>>>>>> at org.eclipse.jdt.core.dom.TypeDeclaration.accept0(TypeDeclaration.java:484)
>>>>>>> at org.eclipse.jdt.core.dom.ASTNode.accept(ASTNode.java:2514)
>>>>>>> at org.eclipse.jdt.core.dom.ASTNode.acceptChildren(ASTNode.java:2585)
>>>>>>> at org.eclipse.jdt.core.dom.CompilationUnit.accept0(CompilationUnit.java:219)
>>>>>>> at org.eclipse.jdt.core.dom.ASTNode.accept(ASTNode.java:2514)
>>>>>>> at fr.inria.verveine.extractor.java.FamixRequestor.acceptAST(Unknown Source)
>>>>>>> at org.eclipse.jdt.core.dom.CompilationUnitResolver.resolve(CompilationUnitResolver.java:1016)
>>>>>>> at org.eclipse.jdt.core.dom.CompilationUnitResolver.resolve(CompilationUnitResolver.java:628)
>>>>>>> at org.eclipse.jdt.core.dom.ASTParser.createASTs(ASTParser.java:988)
>>>>>>> at fr.inria.verveine.extractor.java.VerveineJParser.parse(Unknown Source)
>>>>>>> at fr.inria.verveine.extractor.java.VerveineJParser.main(Unknown Source)
>>>>>>>
>>>>>>>
>>>>>>> I tried adding -Xmx4000m .. but i still get the same exception.
>>>>>>>
>>>>>>> Is there another trick ?
>>>>>>>
>>>>>>> Thanks.
>>>>>>> Andrea
>>>>>>> _______________________________________________
>>>>>>> Moose-dev mailing list
>>>>>>> [hidden email]
>>>>>>> https://www.iam.unibe.ch/mailman/listinfo/moose-dev
>>>>>>
>>>>>> --
>>>>>> www.tudorgirba.com
>>>>>>
>>>>>> "To utilize feedback, you first have to acquire it."
>>>>>>
>>>>>>
>>>>>> _______________________________________________
>>>>>> Moose-dev mailing list
>>>>>> [hidden email]
>>>>>> https://www.iam.unibe.ch/mailman/listinfo/moose-dev
>>>>>
>>>>> ---
>>>>> Jannik Laval
>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> Moose-dev mailing list
>>>>> [hidden email]
>>>>> https://www.iam.unibe.ch/mailman/listinfo/moose-dev
>>>>
>>>> _______________________________________________
>>>> Moose-dev mailing list
>>>> [hidden email]
>>>> https://www.iam.unibe.ch/mailman/listinfo/moose-dev
>>>
>>> ---
>>> Jannik Laval
>>>
>>> _______________________________________________
>>> Moose-dev mailing list
>>> [hidden email]
>>> https://www.iam.unibe.ch/mailman/listinfo/moose-dev
>>
>> _______________________________________________
>> Moose-dev mailing list
>> [hidden email]
>> https://www.iam.unibe.ch/mailman/listinfo/moose-dev
>
> ---
> Jannik Laval
>
> _______________________________________________
> Moose-dev mailing list
> [hidden email]
> https://www.iam.unibe.ch/mailman/listinfo/moose-dev


_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev
Reply | Threaded
Open this post in threaded view
|

Re: verveineJ - Java heap space

jannik laval
For now, we do not need.
I am testing robusteness and what we can load.

But the future is in extra large applications, and we have to consider our limits to overpass them.
Filtering is an idea.

Another thing is the time to load: a 650Mb mse file makes tens of minutes to load, maybe several hours.
We have to consider that too.

Jannik

On Aug 6, 2012, at 6:31 PM, Stéphane Ducasse <[hidden email]> wrote:

> Or to filter… do we need all the this objects and others.
>
> Stef
>
> On Aug 6, 2012, at 4:03 PM, jannik.laval wrote:
>
>> For information: I tried to load Netbeans in Moose and it is not loadable.
>> We need more memory space.
>>
>> Jannik
>>
>> On Aug 6, 2012, at 11:31 AM, Andrea Caracciolo <[hidden email]> wrote:
>>
>>>
>>> On Aug 6, 2012, at 10:32 AM, jannik.laval wrote:
>>>
>>>>
>>>> On Aug 6, 2012, at 10:23 AM, Andrea Caracciolo <[hidden email]> wrote:
>>>>
>>>>> Great.
>>>>>
>>>>> Thanks for sharing your MSEs
>>>>> I've setup a webserver to host these files: http://pinocchio.unibe.ch/QualitasCorpus/
>>>>
>>>> Ok, I am trying to access, but it is not possible to access for now.
>>>
>>> Looks like there is something to fix with DNS.
>>> I will look at it in the following days and notify you when everything is set in place.
>>>
>>>
>>>>> I'm missing the MSE files for the eclipse version (I will use yours) and for netbeans-6.9.1.
>>>>
>>>> I generated the mse of netbeans yesterday (the last one I have to do).
>>>> This one is really big ! The mse file is a 1Gb file.
>>>> It will be soon in the same repository of Google drive: https://docs.google.com/folder/d/0B8B4OafJIEKhV2pwekNPN05iQjQ/edit
>>>>
>>>>
>>>>>
>>>>> I also have to add the metadata files.
>>>>
>>>> Yes
>>>>
>>>>>
>>>>> How did you manage to generate the models for such big projects without getting out of memory ?
>>>>
>>>> hehe, for all files but netbeans, I had the JVM parameter -Xmx8000M.
>>>> For netbeans, -Xmx16000m is good.
>>>>
>>>> So, do not try to do that without enough memory or a SSD ==> I have a 14Gb swap memory file.
>>>
>>> Wow ! These are some serious HW requirements !
>>> As Doru said, InFamix could probably do it without all that ram…
>>>
>>>
>>>> Cheers,
>>>> Jannik
>>>>
>>>>>
>>>>> cheers,
>>>>> Andrea
>>>>>
>>>>> On Aug 3, 2012, at 10:29 PM, jannik.laval wrote:
>>>>>
>>>>>> That is why we need to share mse files.
>>>>>>
>>>>>> I am uploading files (It will be available soon here: https://docs.google.com/folder/d/0B8B4OafJIEKhV2pwekNPN05iQjQ/edit)
>>>>>> There are:
>>>>>> - one Moose image configured with 2Gb memory and Eclipse3.4 loaded
>>>>>> - the mse files of Eclipse 1.0 to 3.7.1 (40 different versions).
>>>>>>
>>>>>> These files are zipped in tar.bz2, they are created with the VerveinJ (downloaded in July 2012). And they work with Moose 4.6 (maybe other versons, not tried).
>>>>>>
>>>>>> I have also all the mse files of the Qualitas Corpus.
>>>>>>
>>>>>> Cheers,
>>>>>> Jannik
>>>>>>
>>>>>> On Aug 3, 2012, at 10:16 PM, Tudor Girba <[hidden email]> wrote:
>>>>>>
>>>>>>> I guess not.
>>>>>>>
>>>>>>> Did you try with inFamix? This one claims to be optimized for memory.
>>>>>>>
>>>>>>> Cheers,
>>>>>>> Doru
>>>>>>>
>>>>>>>
>>>>>>> On 2 Aug 2012, at 12:22, Andrea Caracciolo wrote:
>>>>>>>
>>>>>>>> Hi,
>>>>>>>>
>>>>>>>> I' trying to run verveineJ on the Eclipse source code .. and i always get this:
>>>>>>>>
>>>>>>>> Exception in thread "main" java.lang.OutOfMemoryError: Java heap space
>>>>>>>> at java.util.LinkedList.addBefore(LinkedList.java:778)
>>>>>>>> at java.util.LinkedList.add(LinkedList.java:198)
>>>>>>>> at fr.inria.verveine.core.Dictionary.getEntityByName(Unknown Source)
>>>>>>>> at fr.inria.verveine.extractor.java.JavaDictionary.ensureFamixMethod(Unknown Source)
>>>>>>>> at fr.inria.verveine.extractor.java.VerveineVisitor.visitVariablesDeclarations(Unknown Source)
>>>>>>>> at fr.inria.verveine.extractor.java.VerveineVisitor.visit(Unknown Source)
>>>>>>>> at org.eclipse.jdt.core.dom.FieldDeclaration.accept0(FieldDeclaration.java:279)
>>>>>>>> at org.eclipse.jdt.core.dom.ASTNode.accept(ASTNode.java:2514)
>>>>>>>> at org.eclipse.jdt.core.dom.ASTNode.acceptChildren(ASTNode.java:2585)
>>>>>>>> at org.eclipse.jdt.core.dom.TypeDeclaration.accept0(TypeDeclaration.java:484)
>>>>>>>> at org.eclipse.jdt.core.dom.ASTNode.accept(ASTNode.java:2514)
>>>>>>>> at org.eclipse.jdt.core.dom.ASTNode.acceptChildren(ASTNode.java:2585)
>>>>>>>> at org.eclipse.jdt.core.dom.CompilationUnit.accept0(CompilationUnit.java:219)
>>>>>>>> at org.eclipse.jdt.core.dom.ASTNode.accept(ASTNode.java:2514)
>>>>>>>> at fr.inria.verveine.extractor.java.FamixRequestor.acceptAST(Unknown Source)
>>>>>>>> at org.eclipse.jdt.core.dom.CompilationUnitResolver.resolve(CompilationUnitResolver.java:1016)
>>>>>>>> at org.eclipse.jdt.core.dom.CompilationUnitResolver.resolve(CompilationUnitResolver.java:628)
>>>>>>>> at org.eclipse.jdt.core.dom.ASTParser.createASTs(ASTParser.java:988)
>>>>>>>> at fr.inria.verveine.extractor.java.VerveineJParser.parse(Unknown Source)
>>>>>>>> at fr.inria.verveine.extractor.java.VerveineJParser.main(Unknown Source)
>>>>>>>>
>>>>>>>>
>>>>>>>> I tried adding -Xmx4000m .. but i still get the same exception.
>>>>>>>>
>>>>>>>> Is there another trick ?
>>>>>>>>
>>>>>>>> Thanks.
>>>>>>>> Andrea
>>>>>>>> _______________________________________________
>>>>>>>> Moose-dev mailing list
>>>>>>>> [hidden email]
>>>>>>>> https://www.iam.unibe.ch/mailman/listinfo/moose-dev
>>>>>>>
>>>>>>> --
>>>>>>> www.tudorgirba.com
>>>>>>>
>>>>>>> "To utilize feedback, you first have to acquire it."
>>>>>>>
>>>>>>>
>>>>>>> _______________________________________________
>>>>>>> Moose-dev mailing list
>>>>>>> [hidden email]
>>>>>>> https://www.iam.unibe.ch/mailman/listinfo/moose-dev
>>>>>>
>>>>>> ---
>>>>>> Jannik Laval
>>>>>>
>>>>>>
>>>>>> _______________________________________________
>>>>>> Moose-dev mailing list
>>>>>> [hidden email]
>>>>>> https://www.iam.unibe.ch/mailman/listinfo/moose-dev
>>>>>
>>>>> _______________________________________________
>>>>> Moose-dev mailing list
>>>>> [hidden email]
>>>>> https://www.iam.unibe.ch/mailman/listinfo/moose-dev
>>>>
>>>> ---
>>>> Jannik Laval
>>>>
>>>> _______________________________________________
>>>> Moose-dev mailing list
>>>> [hidden email]
>>>> https://www.iam.unibe.ch/mailman/listinfo/moose-dev
>>>
>>> _______________________________________________
>>> Moose-dev mailing list
>>> [hidden email]
>>> https://www.iam.unibe.ch/mailman/listinfo/moose-dev
>>
>> ---
>> Jannik Laval
>>
>> _______________________________________________
>> Moose-dev mailing list
>> [hidden email]
>> https://www.iam.unibe.ch/mailman/listinfo/moose-dev
>
>
> _______________________________________________
> Moose-dev mailing list
> [hidden email]
> https://www.iam.unibe.ch/mailman/listinfo/moose-dev

---
Jannik Laval


_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev
Reply | Threaded
Open this post in threaded view
|

Re: verveineJ - Java heap space

Nicolas Anquetil
In reply to this post by Andrea Caracciolo

Hi andrea,

I see you found a solution o your problem (thanks to Jannik)

On the side of VerveineJ, another solution is to use incremental parsing.
You can parse the project in small parts (ultimately you could parse it
one file after the other).
As long as you specify the correct class path to verveinej and don't
touch the mse file generated, it should work.

nicolas

On 02/08/12 07:22, Andrea Caracciolo wrote:

> Hi,
>
> I' trying to run verveineJ on the Eclipse source code .. and i always get this:
>
> Exception in thread "main" java.lang.OutOfMemoryError: Java heap space
> at java.util.LinkedList.addBefore(LinkedList.java:778)
> at java.util.LinkedList.add(LinkedList.java:198)
> at fr.inria.verveine.core.Dictionary.getEntityByName(Unknown Source)
> at fr.inria.verveine.extractor.java.JavaDictionary.ensureFamixMethod(Unknown Source)
> at fr.inria.verveine.extractor.java.VerveineVisitor.visitVariablesDeclarations(Unknown Source)
> at fr.inria.verveine.extractor.java.VerveineVisitor.visit(Unknown Source)
> at org.eclipse.jdt.core.dom.FieldDeclaration.accept0(FieldDeclaration.java:279)
> at org.eclipse.jdt.core.dom.ASTNode.accept(ASTNode.java:2514)
> at org.eclipse.jdt.core.dom.ASTNode.acceptChildren(ASTNode.java:2585)
> at org.eclipse.jdt.core.dom.TypeDeclaration.accept0(TypeDeclaration.java:484)
> at org.eclipse.jdt.core.dom.ASTNode.accept(ASTNode.java:2514)
> at org.eclipse.jdt.core.dom.ASTNode.acceptChildren(ASTNode.java:2585)
> at org.eclipse.jdt.core.dom.CompilationUnit.accept0(CompilationUnit.java:219)
> at org.eclipse.jdt.core.dom.ASTNode.accept(ASTNode.java:2514)
> at fr.inria.verveine.extractor.java.FamixRequestor.acceptAST(Unknown Source)
> at org.eclipse.jdt.core.dom.CompilationUnitResolver.resolve(CompilationUnitResolver.java:1016)
> at org.eclipse.jdt.core.dom.CompilationUnitResolver.resolve(CompilationUnitResolver.java:628)
> at org.eclipse.jdt.core.dom.ASTParser.createASTs(ASTParser.java:988)
> at fr.inria.verveine.extractor.java.VerveineJParser.parse(Unknown Source)
> at fr.inria.verveine.extractor.java.VerveineJParser.main(Unknown Source)
>
>
> I tried adding -Xmx4000m .. but i still get the same exception.
>
> Is there another trick ?
>
> Thanks.
> Andrea
> _______________________________________________
> Moose-dev mailing list
> [hidden email]
> https://www.iam.unibe.ch/mailman/listinfo/moose-dev

_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev
Reply | Threaded
Open this post in threaded view
|

Re: verveineJ - Java heap space

jannik laval
In reply to this post by Andrea Caracciolo
Hi Andrea,

Do you have news for the server ?

Jannik

On Aug 6, 2012, at 11:31 AM, Andrea Caracciolo <[hidden email]> wrote:


On Aug 6, 2012, at 10:32 AM, jannik.laval wrote:


On Aug 6, 2012, at 10:23 AM, Andrea Caracciolo <[hidden email]> wrote:

Great. 

Thanks for sharing your MSEs
I've setup a webserver to host these files: http://pinocchio.unibe.ch/QualitasCorpus/

Ok, I am trying to access, but it is not possible to access for now.

Looks like there is something to fix with DNS. 
I will look at it in the following days and notify you when everything is set in place. 


I'm missing the MSE files for the eclipse version (I will use yours) and for netbeans-6.9.1. 

I generated the mse of netbeans yesterday (the last one I have to do).
This one is really big ! The mse file is a 1Gb file.
It will be soon in the same repository of Google drive: https://docs.google.com/folder/d/0B8B4OafJIEKhV2pwekNPN05iQjQ/edit



I also have to add the metadata files. 

Yes


How did you manage to generate the models for such big projects without getting out of memory ? 

hehe, for all files but netbeans, I had the JVM parameter -Xmx8000M.
For netbeans, -Xmx16000m is good.

So, do not try to do that without enough memory or a SSD ==> I have a 14Gb swap memory file.

Wow ! These are some serious HW requirements ! 
As Doru said, InFamix could probably do it without all that ram… 


Cheers,
Jannik


cheers,
Andrea

On Aug 3, 2012, at 10:29 PM, jannik.laval wrote:

That is why we need to share mse files.

I am uploading files (It will be available soon here: https://docs.google.com/folder/d/0B8B4OafJIEKhV2pwekNPN05iQjQ/edit)
There are:
- one Moose image configured with 2Gb memory and Eclipse3.4 loaded
- the mse files of Eclipse 1.0 to 3.7.1 (40 different versions).

These files are zipped in tar.bz2, they are created with the VerveinJ (downloaded in July 2012). And they work with Moose 4.6 (maybe other versons, not tried).

I have also all the mse files of the Qualitas Corpus.

Cheers,
Jannik

On Aug 3, 2012, at 10:16 PM, Tudor Girba <[hidden email]> wrote:

I guess not.

Did you try with inFamix? This one claims to be optimized for memory.

Cheers,
Doru


On 2 Aug 2012, at 12:22, Andrea Caracciolo wrote:

Hi,

I' trying to run verveineJ on the Eclipse source code .. and i always get this:

Exception in thread "main" java.lang.OutOfMemoryError: Java heap space
at java.util.LinkedList.addBefore(LinkedList.java:778)
at java.util.LinkedList.add(LinkedList.java:198)
at fr.inria.verveine.core.Dictionary.getEntityByName(Unknown Source)
at fr.inria.verveine.extractor.java.JavaDictionary.ensureFamixMethod(Unknown Source)
at fr.inria.verveine.extractor.java.VerveineVisitor.visitVariablesDeclarations(Unknown Source)
at fr.inria.verveine.extractor.java.VerveineVisitor.visit(Unknown Source)
at org.eclipse.jdt.core.dom.FieldDeclaration.accept0(FieldDeclaration.java:279)
at org.eclipse.jdt.core.dom.ASTNode.accept(ASTNode.java:2514)
at org.eclipse.jdt.core.dom.ASTNode.acceptChildren(ASTNode.java:2585)
at org.eclipse.jdt.core.dom.TypeDeclaration.accept0(TypeDeclaration.java:484)
at org.eclipse.jdt.core.dom.ASTNode.accept(ASTNode.java:2514)
at org.eclipse.jdt.core.dom.ASTNode.acceptChildren(ASTNode.java:2585)
at org.eclipse.jdt.core.dom.CompilationUnit.accept0(CompilationUnit.java:219)
at org.eclipse.jdt.core.dom.ASTNode.accept(ASTNode.java:2514)
at fr.inria.verveine.extractor.java.FamixRequestor.acceptAST(Unknown Source)
at org.eclipse.jdt.core.dom.CompilationUnitResolver.resolve(CompilationUnitResolver.java:1016)
at org.eclipse.jdt.core.dom.CompilationUnitResolver.resolve(CompilationUnitResolver.java:628)
at org.eclipse.jdt.core.dom.ASTParser.createASTs(ASTParser.java:988)
at fr.inria.verveine.extractor.java.VerveineJParser.parse(Unknown Source)
at fr.inria.verveine.extractor.java.VerveineJParser.main(Unknown Source)


I tried adding -Xmx4000m .. but i still get the same exception.

Is there another trick ?

Thanks.
Andrea
_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

--
www.tudorgirba.com

"To utilize feedback, you first have to acquire it."


_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

---
Jannik Laval


_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

---
Jannik Laval

_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

---
Jannik Laval


_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev
Reply | Threaded
Open this post in threaded view
|

Re: verveineJ - Java heap space

Andrea Caracciolo
Hi Jannik, 

I've been busy for some time and i will catch up in these days. 
I will surely update you at the beginning of the next week. 

Did you make some progress with orion ? 

Andrea

On Aug 29, 2012, at 2:26 PM, jannik.laval wrote:

Hi Andrea,

Do you have news for the server ?

Jannik

On Aug 6, 2012, at 11:31 AM, Andrea Caracciolo <[hidden email]> wrote:


On Aug 6, 2012, at 10:32 AM, jannik.laval wrote:


On Aug 6, 2012, at 10:23 AM, Andrea Caracciolo <[hidden email]> wrote:

Great. 

Thanks for sharing your MSEs
I've setup a webserver to host these files: http://pinocchio.unibe.ch/QualitasCorpus/

Ok, I am trying to access, but it is not possible to access for now.

Looks like there is something to fix with DNS. 
I will look at it in the following days and notify you when everything is set in place. 


I'm missing the MSE files for the eclipse version (I will use yours) and for netbeans-6.9.1. 

I generated the mse of netbeans yesterday (the last one I have to do).
This one is really big ! The mse file is a 1Gb file.
It will be soon in the same repository of Google drive: https://docs.google.com/folder/d/0B8B4OafJIEKhV2pwekNPN05iQjQ/edit



I also have to add the metadata files. 

Yes


How did you manage to generate the models for such big projects without getting out of memory ? 

hehe, for all files but netbeans, I had the JVM parameter -Xmx8000M.
For netbeans, -Xmx16000m is good.

So, do not try to do that without enough memory or a SSD ==> I have a 14Gb swap memory file.

Wow ! These are some serious HW requirements ! 
As Doru said, InFamix could probably do it without all that ram… 


Cheers,
Jannik


cheers,
Andrea

On Aug 3, 2012, at 10:29 PM, jannik.laval wrote:

That is why we need to share mse files.

I am uploading files (It will be available soon here: https://docs.google.com/folder/d/0B8B4OafJIEKhV2pwekNPN05iQjQ/edit)
There are:
- one Moose image configured with 2Gb memory and Eclipse3.4 loaded
- the mse files of Eclipse 1.0 to 3.7.1 (40 different versions).

These files are zipped in tar.bz2, they are created with the VerveinJ (downloaded in July 2012). And they work with Moose 4.6 (maybe other versons, not tried).

I have also all the mse files of the Qualitas Corpus.

Cheers,
Jannik

On Aug 3, 2012, at 10:16 PM, Tudor Girba <[hidden email]> wrote:

I guess not.

Did you try with inFamix? This one claims to be optimized for memory.

Cheers,
Doru


On 2 Aug 2012, at 12:22, Andrea Caracciolo wrote:

Hi,

I' trying to run verveineJ on the Eclipse source code .. and i always get this:

Exception in thread "main" java.lang.OutOfMemoryError: Java heap space
at java.util.LinkedList.addBefore(LinkedList.java:778)
at java.util.LinkedList.add(LinkedList.java:198)
at fr.inria.verveine.core.Dictionary.getEntityByName(Unknown Source)
at fr.inria.verveine.extractor.java.JavaDictionary.ensureFamixMethod(Unknown Source)
at fr.inria.verveine.extractor.java.VerveineVisitor.visitVariablesDeclarations(Unknown Source)
at fr.inria.verveine.extractor.java.VerveineVisitor.visit(Unknown Source)
at org.eclipse.jdt.core.dom.FieldDeclaration.accept0(FieldDeclaration.java:279)
at org.eclipse.jdt.core.dom.ASTNode.accept(ASTNode.java:2514)
at org.eclipse.jdt.core.dom.ASTNode.acceptChildren(ASTNode.java:2585)
at org.eclipse.jdt.core.dom.TypeDeclaration.accept0(TypeDeclaration.java:484)
at org.eclipse.jdt.core.dom.ASTNode.accept(ASTNode.java:2514)
at org.eclipse.jdt.core.dom.ASTNode.acceptChildren(ASTNode.java:2585)
at org.eclipse.jdt.core.dom.CompilationUnit.accept0(CompilationUnit.java:219)
at org.eclipse.jdt.core.dom.ASTNode.accept(ASTNode.java:2514)
at fr.inria.verveine.extractor.java.FamixRequestor.acceptAST(Unknown Source)
at org.eclipse.jdt.core.dom.CompilationUnitResolver.resolve(CompilationUnitResolver.java:1016)
at org.eclipse.jdt.core.dom.CompilationUnitResolver.resolve(CompilationUnitResolver.java:628)
at org.eclipse.jdt.core.dom.ASTParser.createASTs(ASTParser.java:988)
at fr.inria.verveine.extractor.java.VerveineJParser.parse(Unknown Source)
at fr.inria.verveine.extractor.java.VerveineJParser.main(Unknown Source)


I tried adding -Xmx4000m .. but i still get the same exception.

Is there another trick ?

Thanks.
Andrea
_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

--
www.tudorgirba.com

"To utilize feedback, you first have to acquire it."


_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

---
Jannik Laval


_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

---
Jannik Laval

_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

---
Jannik Laval

_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev


_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev
Reply | Threaded
Open this post in threaded view
|

Re: verveineJ - Java heap space

jannik laval

On Aug 29, 2012, at 5:22 PM, Andrea Caracciolo <[hidden email]> wrote:

Hi Jannik, 

I've been busy for some time and i will catch up in these days. 
I will surely update you at the beginning of the next week. 

Did you make some progress with orion ? 

Yes, I am recoding the core of Orion.
Now, it is clearer.

I am thinking about the importer for mse, but need some time to find the good solution.

Jannik


Andrea

On Aug 29, 2012, at 2:26 PM, jannik.laval wrote:

Hi Andrea,

Do you have news for the server ?

Jannik

On Aug 6, 2012, at 11:31 AM, Andrea Caracciolo <[hidden email]> wrote:


On Aug 6, 2012, at 10:32 AM, jannik.laval wrote:


On Aug 6, 2012, at 10:23 AM, Andrea Caracciolo <[hidden email]> wrote:

Great. 

Thanks for sharing your MSEs
I've setup a webserver to host these files: http://pinocchio.unibe.ch/QualitasCorpus/

Ok, I am trying to access, but it is not possible to access for now.

Looks like there is something to fix with DNS. 
I will look at it in the following days and notify you when everything is set in place. 


I'm missing the MSE files for the eclipse version (I will use yours) and for netbeans-6.9.1. 

I generated the mse of netbeans yesterday (the last one I have to do).
This one is really big ! The mse file is a 1Gb file.
It will be soon in the same repository of Google drive: https://docs.google.com/folder/d/0B8B4OafJIEKhV2pwekNPN05iQjQ/edit



I also have to add the metadata files. 

Yes


How did you manage to generate the models for such big projects without getting out of memory ? 

hehe, for all files but netbeans, I had the JVM parameter -Xmx8000M.
For netbeans, -Xmx16000m is good.

So, do not try to do that without enough memory or a SSD ==> I have a 14Gb swap memory file.

Wow ! These are some serious HW requirements ! 
As Doru said, InFamix could probably do it without all that ram… 


Cheers,
Jannik


cheers,
Andrea

On Aug 3, 2012, at 10:29 PM, jannik.laval wrote:

That is why we need to share mse files.

I am uploading files (It will be available soon here: https://docs.google.com/folder/d/0B8B4OafJIEKhV2pwekNPN05iQjQ/edit)
There are:
- one Moose image configured with 2Gb memory and Eclipse3.4 loaded
- the mse files of Eclipse 1.0 to 3.7.1 (40 different versions).

These files are zipped in tar.bz2, they are created with the VerveinJ (downloaded in July 2012). And they work with Moose 4.6 (maybe other versons, not tried).

I have also all the mse files of the Qualitas Corpus.

Cheers,
Jannik

On Aug 3, 2012, at 10:16 PM, Tudor Girba <[hidden email]> wrote:

I guess not.

Did you try with inFamix? This one claims to be optimized for memory.

Cheers,
Doru


On 2 Aug 2012, at 12:22, Andrea Caracciolo wrote:

Hi,

I' trying to run verveineJ on the Eclipse source code .. and i always get this:

Exception in thread "main" java.lang.OutOfMemoryError: Java heap space
at java.util.LinkedList.addBefore(LinkedList.java:778)
at java.util.LinkedList.add(LinkedList.java:198)
at fr.inria.verveine.core.Dictionary.getEntityByName(Unknown Source)
at fr.inria.verveine.extractor.java.JavaDictionary.ensureFamixMethod(Unknown Source)
at fr.inria.verveine.extractor.java.VerveineVisitor.visitVariablesDeclarations(Unknown Source)
at fr.inria.verveine.extractor.java.VerveineVisitor.visit(Unknown Source)
at org.eclipse.jdt.core.dom.FieldDeclaration.accept0(FieldDeclaration.java:279)
at org.eclipse.jdt.core.dom.ASTNode.accept(ASTNode.java:2514)
at org.eclipse.jdt.core.dom.ASTNode.acceptChildren(ASTNode.java:2585)
at org.eclipse.jdt.core.dom.TypeDeclaration.accept0(TypeDeclaration.java:484)
at org.eclipse.jdt.core.dom.ASTNode.accept(ASTNode.java:2514)
at org.eclipse.jdt.core.dom.ASTNode.acceptChildren(ASTNode.java:2585)
at org.eclipse.jdt.core.dom.CompilationUnit.accept0(CompilationUnit.java:219)
at org.eclipse.jdt.core.dom.ASTNode.accept(ASTNode.java:2514)
at fr.inria.verveine.extractor.java.FamixRequestor.acceptAST(Unknown Source)
at org.eclipse.jdt.core.dom.CompilationUnitResolver.resolve(CompilationUnitResolver.java:1016)
at org.eclipse.jdt.core.dom.CompilationUnitResolver.resolve(CompilationUnitResolver.java:628)
at org.eclipse.jdt.core.dom.ASTParser.createASTs(ASTParser.java:988)
at fr.inria.verveine.extractor.java.VerveineJParser.parse(Unknown Source)
at fr.inria.verveine.extractor.java.VerveineJParser.main(Unknown Source)


I tried adding -Xmx4000m .. but i still get the same exception.

Is there another trick ?

Thanks.
Andrea
_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

--
www.tudorgirba.com

"To utilize feedback, you first have to acquire it."


_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

---
Jannik Laval


_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

---
Jannik Laval

_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

---
Jannik Laval

_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev

---
Jannik Laval


_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev
Reply | Threaded
Open this post in threaded view
|

Re: verveineJ - Java heap space

Stéphane Ducasse

On Aug 29, 2012, at 5:31 PM, jannik.laval wrote:

>
> On Aug 29, 2012, at 5:22 PM, Andrea Caracciolo <[hidden email]> wrote:
>
>> Hi Jannik,
>>
>> I've been busy for some time and i will catch up in these days.
>> I will surely update you at the beginning of the next week.
>>
>> Did you make some progress with orion ?
>
> Yes, I am recoding the core of Orion.

cool
did you use the optimization andy used in his approach (cache somehow the version).

> Now, it is clearer.
>
> I am thinking about the importer for mse, but need some time to find the good solution.
>
> Jannik
>
>>
>> Andrea
>>
>> On Aug 29, 2012, at 2:26 PM, jannik.laval wrote:
>>
>>> Hi Andrea,
>>>
>>> Do you have news for the server ?
>>>
>>> Jannik
>>>
>>> On Aug 6, 2012, at 11:31 AM, Andrea Caracciolo <[hidden email]> wrote:
>>>
>>>>
>>>> On Aug 6, 2012, at 10:32 AM, jannik.laval wrote:
>>>>
>>>>>
>>>>> On Aug 6, 2012, at 10:23 AM, Andrea Caracciolo <[hidden email]> wrote:
>>>>>
>>>>>> Great.
>>>>>>
>>>>>> Thanks for sharing your MSEs
>>>>>> I've setup a webserver to host these files: http://pinocchio.unibe.ch/QualitasCorpus/
>>>>>
>>>>> Ok, I am trying to access, but it is not possible to access for now.
>>>>
>>>> Looks like there is something to fix with DNS.
>>>> I will look at it in the following days and notify you when everything is set in place.
>>>>
>>>>
>>>>>> I'm missing the MSE files for the eclipse version (I will use yours) and for netbeans-6.9.1.
>>>>>
>>>>> I generated the mse of netbeans yesterday (the last one I have to do).
>>>>> This one is really big ! The mse file is a 1Gb file.
>>>>> It will be soon in the same repository of Google drive: https://docs.google.com/folder/d/0B8B4OafJIEKhV2pwekNPN05iQjQ/edit
>>>>>
>>>>>
>>>>>>
>>>>>> I also have to add the metadata files.
>>>>>
>>>>> Yes
>>>>>
>>>>>>
>>>>>> How did you manage to generate the models for such big projects without getting out of memory ?
>>>>>
>>>>> hehe, for all files but netbeans, I had the JVM parameter -Xmx8000M.
>>>>> For netbeans, -Xmx16000m is good.
>>>>>
>>>>> So, do not try to do that without enough memory or a SSD ==> I have a 14Gb swap memory file.
>>>>
>>>> Wow ! These are some serious HW requirements !
>>>> As Doru said, InFamix could probably do it without all that ram…
>>>>
>>>>
>>>>> Cheers,
>>>>> Jannik
>>>>>
>>>>>>
>>>>>> cheers,
>>>>>> Andrea
>>>>>>
>>>>>> On Aug 3, 2012, at 10:29 PM, jannik.laval wrote:
>>>>>>
>>>>>>> That is why we need to share mse files.
>>>>>>>
>>>>>>> I am uploading files (It will be available soon here: https://docs.google.com/folder/d/0B8B4OafJIEKhV2pwekNPN05iQjQ/edit)
>>>>>>> There are:
>>>>>>> - one Moose image configured with 2Gb memory and Eclipse3.4 loaded
>>>>>>> - the mse files of Eclipse 1.0 to 3.7.1 (40 different versions).
>>>>>>>
>>>>>>> These files are zipped in tar.bz2, they are created with the VerveinJ (downloaded in July 2012). And they work with Moose 4.6 (maybe other versons, not tried).
>>>>>>>
>>>>>>> I have also all the mse files of the Qualitas Corpus.
>>>>>>>
>>>>>>> Cheers,
>>>>>>> Jannik
>>>>>>>
>>>>>>> On Aug 3, 2012, at 10:16 PM, Tudor Girba <[hidden email]> wrote:
>>>>>>>
>>>>>>>> I guess not.
>>>>>>>>
>>>>>>>> Did you try with inFamix? This one claims to be optimized for memory.
>>>>>>>>
>>>>>>>> Cheers,
>>>>>>>> Doru
>>>>>>>>
>>>>>>>>
>>>>>>>> On 2 Aug 2012, at 12:22, Andrea Caracciolo wrote:
>>>>>>>>
>>>>>>>>> Hi,
>>>>>>>>>
>>>>>>>>> I' trying to run verveineJ on the Eclipse source code .. and i always get this:
>>>>>>>>>
>>>>>>>>> Exception in thread "main" java.lang.OutOfMemoryError: Java heap space
>>>>>>>>> at java.util.LinkedList.addBefore(LinkedList.java:778)
>>>>>>>>> at java.util.LinkedList.add(LinkedList.java:198)
>>>>>>>>> at fr.inria.verveine.core.Dictionary.getEntityByName(Unknown Source)
>>>>>>>>> at fr.inria.verveine.extractor.java.JavaDictionary.ensureFamixMethod(Unknown Source)
>>>>>>>>> at fr.inria.verveine.extractor.java.VerveineVisitor.visitVariablesDeclarations(Unknown Source)
>>>>>>>>> at fr.inria.verveine.extractor.java.VerveineVisitor.visit(Unknown Source)
>>>>>>>>> at org.eclipse.jdt.core.dom.FieldDeclaration.accept0(FieldDeclaration.java:279)
>>>>>>>>> at org.eclipse.jdt.core.dom.ASTNode.accept(ASTNode.java:2514)
>>>>>>>>> at org.eclipse.jdt.core.dom.ASTNode.acceptChildren(ASTNode.java:2585)
>>>>>>>>> at org.eclipse.jdt.core.dom.TypeDeclaration.accept0(TypeDeclaration.java:484)
>>>>>>>>> at org.eclipse.jdt.core.dom.ASTNode.accept(ASTNode.java:2514)
>>>>>>>>> at org.eclipse.jdt.core.dom.ASTNode.acceptChildren(ASTNode.java:2585)
>>>>>>>>> at org.eclipse.jdt.core.dom.CompilationUnit.accept0(CompilationUnit.java:219)
>>>>>>>>> at org.eclipse.jdt.core.dom.ASTNode.accept(ASTNode.java:2514)
>>>>>>>>> at fr.inria.verveine.extractor.java.FamixRequestor.acceptAST(Unknown Source)
>>>>>>>>> at org.eclipse.jdt.core.dom.CompilationUnitResolver.resolve(CompilationUnitResolver.java:1016)
>>>>>>>>> at org.eclipse.jdt.core.dom.CompilationUnitResolver.resolve(CompilationUnitResolver.java:628)
>>>>>>>>> at org.eclipse.jdt.core.dom.ASTParser.createASTs(ASTParser.java:988)
>>>>>>>>> at fr.inria.verveine.extractor.java.VerveineJParser.parse(Unknown Source)
>>>>>>>>> at fr.inria.verveine.extractor.java.VerveineJParser.main(Unknown Source)
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> I tried adding -Xmx4000m .. but i still get the same exception.
>>>>>>>>>
>>>>>>>>> Is there another trick ?
>>>>>>>>>
>>>>>>>>> Thanks.
>>>>>>>>> Andrea
>>>>>>>>> _______________________________________________
>>>>>>>>> Moose-dev mailing list
>>>>>>>>> [hidden email]
>>>>>>>>> https://www.iam.unibe.ch/mailman/listinfo/moose-dev
>>>>>>>>
>>>>>>>> --
>>>>>>>> www.tudorgirba.com
>>>>>>>>
>>>>>>>> "To utilize feedback, you first have to acquire it."
>>>>>>>>
>>>>>>>>
>>>>>>>> _______________________________________________
>>>>>>>> Moose-dev mailing list
>>>>>>>> [hidden email]
>>>>>>>> https://www.iam.unibe.ch/mailman/listinfo/moose-dev
>>>>>>>
>>>>>>> ---
>>>>>>> Jannik Laval
>>>>>>>
>>>>>>>
>>>>>>> _______________________________________________
>>>>>>> Moose-dev mailing list
>>>>>>> [hidden email]
>>>>>>> https://www.iam.unibe.ch/mailman/listinfo/moose-dev
>>>>>>
>>>>>> _______________________________________________
>>>>>> Moose-dev mailing list
>>>>>> [hidden email]
>>>>>> https://www.iam.unibe.ch/mailman/listinfo/moose-dev
>>>>>
>>>>> ---
>>>>> Jannik Laval
>>>>>
>>>>> _______________________________________________
>>>>> Moose-dev mailing list
>>>>> [hidden email]
>>>>> https://www.iam.unibe.ch/mailman/listinfo/moose-dev
>>>>
>>>> _______________________________________________
>>>> Moose-dev mailing list
>>>> [hidden email]
>>>> https://www.iam.unibe.ch/mailman/listinfo/moose-dev
>>>
>>> ---
>>> Jannik Laval
>>>
>>> _______________________________________________
>>> Moose-dev mailing list
>>> [hidden email]
>>> https://www.iam.unibe.ch/mailman/listinfo/moose-dev
>>
>> _______________________________________________
>> Moose-dev mailing list
>> [hidden email]
>> https://www.iam.unibe.ch/mailman/listinfo/moose-dev
>
> ---
> Jannik Laval
>
> _______________________________________________
> Moose-dev mailing list
> [hidden email]
> https://www.iam.unibe.ch/mailman/listinfo/moose-dev


_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev
Reply | Threaded
Open this post in threaded view
|

Re: verveineJ - Java heap space

jannik laval

On Aug 29, 2012, at 11:22 PM, Stéphane Ducasse <[hidden email]> wrote:

>
> On Aug 29, 2012, at 5:31 PM, jannik.laval wrote:
>
>>
>> On Aug 29, 2012, at 5:22 PM, Andrea Caracciolo <[hidden email]> wrote:
>>
>>> Hi Jannik,
>>>
>>> I've been busy for some time and i will catch up in these days.
>>> I will surely update you at the beginning of the next week.
>>>
>>> Did you make some progress with orion ?
>>
>> Yes, I am recoding the core of Orion.
>
> cool
> did you use the optimization andy used in his approach (cache somehow the version).

Yes I did it.
I also optimize the structure, now, it is really easy to extend Orion.

Jannik

>
>> Now, it is clearer.
>>
>> I am thinking about the importer for mse, but need some time to find the good solution.
>>
>> Jannik
>>
>>>
>>> Andrea
>>>
>>> On Aug 29, 2012, at 2:26 PM, jannik.laval wrote:
>>>
>>>> Hi Andrea,
>>>>
>>>> Do you have news for the server ?
>>>>
>>>> Jannik
>>>>
>>>> On Aug 6, 2012, at 11:31 AM, Andrea Caracciolo <[hidden email]> wrote:
>>>>
>>>>>
>>>>> On Aug 6, 2012, at 10:32 AM, jannik.laval wrote:
>>>>>
>>>>>>
>>>>>> On Aug 6, 2012, at 10:23 AM, Andrea Caracciolo <[hidden email]> wrote:
>>>>>>
>>>>>>> Great.
>>>>>>>
>>>>>>> Thanks for sharing your MSEs
>>>>>>> I've setup a webserver to host these files: http://pinocchio.unibe.ch/QualitasCorpus/
>>>>>>
>>>>>> Ok, I am trying to access, but it is not possible to access for now.
>>>>>
>>>>> Looks like there is something to fix with DNS.
>>>>> I will look at it in the following days and notify you when everything is set in place.
>>>>>
>>>>>
>>>>>>> I'm missing the MSE files for the eclipse version (I will use yours) and for netbeans-6.9.1.
>>>>>>
>>>>>> I generated the mse of netbeans yesterday (the last one I have to do).
>>>>>> This one is really big ! The mse file is a 1Gb file.
>>>>>> It will be soon in the same repository of Google drive: https://docs.google.com/folder/d/0B8B4OafJIEKhV2pwekNPN05iQjQ/edit
>>>>>>
>>>>>>
>>>>>>>
>>>>>>> I also have to add the metadata files.
>>>>>>
>>>>>> Yes
>>>>>>
>>>>>>>
>>>>>>> How did you manage to generate the models for such big projects without getting out of memory ?
>>>>>>
>>>>>> hehe, for all files but netbeans, I had the JVM parameter -Xmx8000M.
>>>>>> For netbeans, -Xmx16000m is good.
>>>>>>
>>>>>> So, do not try to do that without enough memory or a SSD ==> I have a 14Gb swap memory file.
>>>>>
>>>>> Wow ! These are some serious HW requirements !
>>>>> As Doru said, InFamix could probably do it without all that ram…
>>>>>
>>>>>
>>>>>> Cheers,
>>>>>> Jannik
>>>>>>
>>>>>>>
>>>>>>> cheers,
>>>>>>> Andrea
>>>>>>>
>>>>>>> On Aug 3, 2012, at 10:29 PM, jannik.laval wrote:
>>>>>>>
>>>>>>>> That is why we need to share mse files.
>>>>>>>>
>>>>>>>> I am uploading files (It will be available soon here: https://docs.google.com/folder/d/0B8B4OafJIEKhV2pwekNPN05iQjQ/edit)
>>>>>>>> There are:
>>>>>>>> - one Moose image configured with 2Gb memory and Eclipse3.4 loaded
>>>>>>>> - the mse files of Eclipse 1.0 to 3.7.1 (40 different versions).
>>>>>>>>
>>>>>>>> These files are zipped in tar.bz2, they are created with the VerveinJ (downloaded in July 2012). And they work with Moose 4.6 (maybe other versons, not tried).
>>>>>>>>
>>>>>>>> I have also all the mse files of the Qualitas Corpus.
>>>>>>>>
>>>>>>>> Cheers,
>>>>>>>> Jannik
>>>>>>>>
>>>>>>>> On Aug 3, 2012, at 10:16 PM, Tudor Girba <[hidden email]> wrote:
>>>>>>>>
>>>>>>>>> I guess not.
>>>>>>>>>
>>>>>>>>> Did you try with inFamix? This one claims to be optimized for memory.
>>>>>>>>>
>>>>>>>>> Cheers,
>>>>>>>>> Doru
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On 2 Aug 2012, at 12:22, Andrea Caracciolo wrote:
>>>>>>>>>
>>>>>>>>>> Hi,
>>>>>>>>>>
>>>>>>>>>> I' trying to run verveineJ on the Eclipse source code .. and i always get this:
>>>>>>>>>>
>>>>>>>>>> Exception in thread "main" java.lang.OutOfMemoryError: Java heap space
>>>>>>>>>> at java.util.LinkedList.addBefore(LinkedList.java:778)
>>>>>>>>>> at java.util.LinkedList.add(LinkedList.java:198)
>>>>>>>>>> at fr.inria.verveine.core.Dictionary.getEntityByName(Unknown Source)
>>>>>>>>>> at fr.inria.verveine.extractor.java.JavaDictionary.ensureFamixMethod(Unknown Source)
>>>>>>>>>> at fr.inria.verveine.extractor.java.VerveineVisitor.visitVariablesDeclarations(Unknown Source)
>>>>>>>>>> at fr.inria.verveine.extractor.java.VerveineVisitor.visit(Unknown Source)
>>>>>>>>>> at org.eclipse.jdt.core.dom.FieldDeclaration.accept0(FieldDeclaration.java:279)
>>>>>>>>>> at org.eclipse.jdt.core.dom.ASTNode.accept(ASTNode.java:2514)
>>>>>>>>>> at org.eclipse.jdt.core.dom.ASTNode.acceptChildren(ASTNode.java:2585)
>>>>>>>>>> at org.eclipse.jdt.core.dom.TypeDeclaration.accept0(TypeDeclaration.java:484)
>>>>>>>>>> at org.eclipse.jdt.core.dom.ASTNode.accept(ASTNode.java:2514)
>>>>>>>>>> at org.eclipse.jdt.core.dom.ASTNode.acceptChildren(ASTNode.java:2585)
>>>>>>>>>> at org.eclipse.jdt.core.dom.CompilationUnit.accept0(CompilationUnit.java:219)
>>>>>>>>>> at org.eclipse.jdt.core.dom.ASTNode.accept(ASTNode.java:2514)
>>>>>>>>>> at fr.inria.verveine.extractor.java.FamixRequestor.acceptAST(Unknown Source)
>>>>>>>>>> at org.eclipse.jdt.core.dom.CompilationUnitResolver.resolve(CompilationUnitResolver.java:1016)
>>>>>>>>>> at org.eclipse.jdt.core.dom.CompilationUnitResolver.resolve(CompilationUnitResolver.java:628)
>>>>>>>>>> at org.eclipse.jdt.core.dom.ASTParser.createASTs(ASTParser.java:988)
>>>>>>>>>> at fr.inria.verveine.extractor.java.VerveineJParser.parse(Unknown Source)
>>>>>>>>>> at fr.inria.verveine.extractor.java.VerveineJParser.main(Unknown Source)
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> I tried adding -Xmx4000m .. but i still get the same exception.
>>>>>>>>>>
>>>>>>>>>> Is there another trick ?
>>>>>>>>>>
>>>>>>>>>> Thanks.
>>>>>>>>>> Andrea
>>>>>>>>>> _______________________________________________
>>>>>>>>>> Moose-dev mailing list
>>>>>>>>>> [hidden email]
>>>>>>>>>> https://www.iam.unibe.ch/mailman/listinfo/moose-dev
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> www.tudorgirba.com
>>>>>>>>>
>>>>>>>>> "To utilize feedback, you first have to acquire it."
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> _______________________________________________
>>>>>>>>> Moose-dev mailing list
>>>>>>>>> [hidden email]
>>>>>>>>> https://www.iam.unibe.ch/mailman/listinfo/moose-dev
>>>>>>>>
>>>>>>>> ---
>>>>>>>> Jannik Laval
>>>>>>>>
>>>>>>>>
>>>>>>>> _______________________________________________
>>>>>>>> Moose-dev mailing list
>>>>>>>> [hidden email]
>>>>>>>> https://www.iam.unibe.ch/mailman/listinfo/moose-dev
>>>>>>>
>>>>>>> _______________________________________________
>>>>>>> Moose-dev mailing list
>>>>>>> [hidden email]
>>>>>>> https://www.iam.unibe.ch/mailman/listinfo/moose-dev
>>>>>>
>>>>>> ---
>>>>>> Jannik Laval
>>>>>>
>>>>>> _______________________________________________
>>>>>> Moose-dev mailing list
>>>>>> [hidden email]
>>>>>> https://www.iam.unibe.ch/mailman/listinfo/moose-dev
>>>>>
>>>>> _______________________________________________
>>>>> Moose-dev mailing list
>>>>> [hidden email]
>>>>> https://www.iam.unibe.ch/mailman/listinfo/moose-dev
>>>>
>>>> ---
>>>> Jannik Laval
>>>>
>>>> _______________________________________________
>>>> Moose-dev mailing list
>>>> [hidden email]
>>>> https://www.iam.unibe.ch/mailman/listinfo/moose-dev
>>>
>>> _______________________________________________
>>> Moose-dev mailing list
>>> [hidden email]
>>> https://www.iam.unibe.ch/mailman/listinfo/moose-dev
>>
>> ---
>> Jannik Laval
>>
>> _______________________________________________
>> Moose-dev mailing list
>> [hidden email]
>> https://www.iam.unibe.ch/mailman/listinfo/moose-dev
>
>
> _______________________________________________
> Moose-dev mailing list
> [hidden email]
> https://www.iam.unibe.ch/mailman/listinfo/moose-dev

---
Jannik Laval


_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev
Reply | Threaded
Open this post in threaded view
|

Re: verveineJ - Java heap space

Stéphane Ducasse
>>
>
> Yes I did it.

excellent


> I also optimize the structure, now, it is really easy to extend Orion.
>
> Jannik

_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev
Reply | Threaded
Open this post in threaded view
|

Re: verveineJ - Java heap space

Andrea Caracciolo
In reply to this post by jannik laval
Good news ! 
I'm really looking forward to use it. 

On Aug 29, 2012, at 5:31 PM, jannik.laval wrote:

I am thinking about the importer for mse, but need some time to find the good solution.


_______________________________________________
Moose-dev mailing list
[hidden email]
https://www.iam.unibe.ch/mailman/listinfo/moose-dev