TravisCI build run out of memory

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
6 messages Options
Reply | Threaded
Open this post in threaded view
|

TravisCI build run out of memory

GLASS mailing list
Hi,

My build with TravisCI fail due to: "Fatal error 4067 OutOfMemory":
https://travis-ci.org/brunobuzzi/BpmFlow/builds/428266463

The entire project is loaded without problems but while running 246 tests
--> out of memory arise.

Searching in older post i found:
http://forum.world.st/Seaside-Smalltalk-CI-build-for-Gemstone-runs-out-of-temp-object-space-td4886891.html

SmalltalkCISpec {
   #gemstone:
     SCIGemStoneConfiguration {
       #gemConfPath : 'tests/gemstone/gem.conf',
       #stoneCofPath : 'tests/gemstone/system.conf',
       #timeZone : 'Europe/Prague'
     }
}

Do i should create a 'tests' folder in my proyect root and copy there
gemstone configuration files ?

How i provide these configuration files to my TravisCI configuration ?

regards,
bruno



--
Sent from: http://forum.world.st/GLASS-f1460844.html
_______________________________________________
Glass mailing list
[hidden email]
http://lists.gemtalksystems.com/mailman/listinfo/glass
Reply | Threaded
Open this post in threaded view
|

Re: TravisCI build run out of memory

GLASS mailing list


On 09/17/2018 08:23 PM, BrunoBB via Glass wrote:

> Hi,
>
> My build with TravisCI fail due to: "Fatal error 4067 OutOfMemory":
> https://travis-ci.org/brunobuzzi/BpmFlow/builds/428266463
>
> The entire project is loaded without problems but while running 246 tests
> --> out of memory arise.
>
> Searching in older post i found:
> http://forum.world.st/Seaside-Smalltalk-CI-build-for-Gemstone-runs-out-of-temp-object-space-td4886891.html
>
> SmalltalkCISpec {
>     #gemstone:
>       SCIGemStoneConfiguration {
>         #gemConfPath : 'tests/gemstone/gem.conf',
>         #stoneCofPath : 'tests/gemstone/system.conf',
>         #timeZone : 'Europe/Prague'
>       }
> }
>
> Do i should create a 'tests' folder in my proyect root and copy there
> gemstone configuration files ?
See[1] for the current details of defining the conf files.

[1]
https://github.com/hpi-swa/smalltalkCI/tree/master/gemstone#smalltalkci-scigemstoneserverconfigspec

>
> How i provide these configuration files to my TravisCI configuration ?
You are already using smalltalk.ston file with TravisCI, so you'll only
need to add a #configuring section to your existing .smalltalk.ston file.

Dale

>
> regards,
> bruno
>
>
>
> --
> Sent from: http://forum.world.st/GLASS-f1460844.html
> _______________________________________________
> Glass mailing list
> [hidden email]
> http://lists.gemtalksystems.com/mailman/listinfo/glass

_______________________________________________
Glass mailing list
[hidden email]
http://lists.gemtalksystems.com/mailman/listinfo/glass
Reply | Threaded
Open this post in threaded view
|

Re: TravisCI build run out of memory

GLASS mailing list
Dale,

Thanks for your answer i updated my .smalltalk.ston file as:
SmalltalkCISpec {
  #configuring : [
    SCIGemStoneServerConfigSpec {
     #defaultSessionName : 'travis',
     #stoneConfPath : 'gemstone/system.conf',
     #gemConfPath : 'gemstone/gem.conf',
     #timeZone : 'UTC',
     #platforms : [ #gemstone, #gemstoneClient ]
    }
  ],
  #loading : [
    SCIMetacelloLoadSpec {
      #baseline : 'BpmFlow',
      #directory : 'repository',
      #onWarningLog : true,
      #load : [ 'default' ],
      #platforms : [ #gemstone ]
    }
  ]
}

As i understand #gemConfPath and #stoneConfPath are relative to my project
path ?
In my case i copied local GS conf files to:
../BpmFlow/gemstone

But i still get the same error and in Travis logs i see:
Using GEM_TEMPOBJ_CACHE_SIZE 100000 from -T command line option

How i can remove -T option or change it to 500000 ?

Also in Travis logs i see:
GEM_TEMPOBJ_CACHE_SIZE = 100000KB;

Which is an indication that my setup is wrong or being ignored ...

regards,
bruno



--
Sent from: http://forum.world.st/GLASS-f1460844.html
_______________________________________________
Glass mailing list
[hidden email]
http://lists.gemtalksystems.com/mailman/listinfo/glass
Reply | Threaded
Open this post in threaded view
|

Re: TravisCI build run out of memory

GLASS mailing list


On 09/18/2018 07:51 AM, BrunoBB via Glass wrote:

> Dale,
>
> Thanks for your answer i updated my .smalltalk.ston file as:
> SmalltalkCISpec {
>    #configuring : [
>      SCIGemStoneServerConfigSpec {
>       #defaultSessionName : 'travis',
>       #stoneConfPath : 'gemstone/system.conf',
>       #gemConfPath : 'gemstone/gem.conf',
>       #timeZone : 'UTC',
>       #platforms : [ #gemstone, #gemstoneClient ]
>      }
>    ],
>    #loading : [
>      SCIMetacelloLoadSpec {
>        #baseline : 'BpmFlow',
>        #directory : 'repository',
>        #onWarningLog : true,
>        #load : [ 'default' ],
>        #platforms : [ #gemstone ]
>      }
>    ]
> }
>
> As i understand #gemConfPath and #stoneConfPath are relative to my project
> path ?
> In my case i copied local GS conf files to:
> ../BpmFlow/gemstone
>
> But i still get the same error and in Travis logs i see:
> Using GEM_TEMPOBJ_CACHE_SIZE 100000 from -T command line option
>
> How i can remove -T option or change it to 500000 ?
Hmmm, this looks like a bug ... The -T option is used to start the topaz
jobs[1] because the default TOC size for GemStone is/was too small...
and I didn't want to require a gem.conf file for running travis on a
normal basis ... I've submitted a SmalltalkCI issue[2] for this ...

In the mean time, you _can_ fork the smalltalkCI project, edit the
run.sh script in these two spots[3],[4] and then change your .travis.yml
file to point to your own branch[5].

I _am_ in the process of adding Rowan to smalltalkCI[6], so I should be
able to implement the bugfix[2], however, my schedule has been getting
hijacked on a regular basis these days by higher priority tasks and my
todo list continues to grow, so I cannot forecast when I will be able to
get around to addressing the issue properly ...

Dale

[1] https://github.com/hpi-swa/smalltalkCI/blob/master/gemstone/run.sh#L246
[2] https://github.com/hpi-swa/smalltalkCI/issues/396
[3] https://github.com/hpi-swa/smalltalkCI/blob/master/gemstone/run.sh#L246
[4] https://github.com/hpi-swa/smalltalkCI/blob/master/gemstone/run.sh#L207
[5]
https://github.com/hpi-swa/smalltalkCI#using-a-different-smalltalkci-branch-or-fork
[6] https://github.com/hpi-swa/smalltalkCI/issues/387

>
> Also in Travis logs i see:
> GEM_TEMPOBJ_CACHE_SIZE = 100000KB;
>
> Which is an indication that my setup is wrong or being ignored ...
>
> regards,
> bruno
>
>
>
> --
> Sent from: http://forum.world.st/GLASS-f1460844.html
> _______________________________________________
> Glass mailing list
> [hidden email]
> http://lists.gemtalksystems.com/mailman/listinfo/glass

_______________________________________________
Glass mailing list
[hidden email]
http://lists.gemtalksystems.com/mailman/listinfo/glass
Reply | Threaded
Open this post in threaded view
|

Re: TravisCI build run out of memory

GLASS mailing list
Dale,

Thanks for the detailed answer. I have created PR:
https://github.com/hpi-swa/smalltalkCI/pull/397

It only adds ${GSCI_TOC:-100000} to run.sh.

If someone wants to increase TOC for Travis Test execution then:
1) clone GsDevKit/GsDevKit_home
2) Update your GsDevKit_home
https://github.com/brunobuzzi/GsDevKit_home/blob/master/bin/defHOME_PATH.env
with: *export GSCI_TOC=integer_value_here* (export GSCI_TOC=500000)
3) clone hpi-swa/smalltalkCI
4) Update your smalltalkCI
https://github.com/brunobuzzi/smalltalkCI/blob/master/gemstone/run.sh#L12
with your 1) git file

regards,
bruno







--
Sent from: http://forum.world.st/GLASS-f1460844.html
_______________________________________________
Glass mailing list
[hidden email]
http://lists.gemtalksystems.com/mailman/listinfo/glass
Reply | Threaded
Open this post in threaded view
|

Re: TravisCI build run out of memory

GLASS mailing list
A couple of corrections:

PR has to be merged first:
https://github.com/hpi-swa/smalltalkCI/pull/397 

To increase TOC for Travis Test execution (using GSCI_TOC env var) then:

1) FORK GsDevKit/GsDevKit_home:
2) Update your GsDevKit_home
https://github.com/brunobuzzi/GsDevKit_home/blob/master/bin/defHOME_PATH.env
with: *export GSCI_TOC=integer_value_here* (export GSCI_TOC=500000)
3) FORK hpi-swa/smalltalkCI
4) Update your smalltalkCI
https://github.com/brunobuzzi/smalltalkCI/blob/master/gemstone/run.sh#L12
with your 1) git file
5) As Dale said change your .travis.yml file to point to your own branch:
https://github.com/hpi-swa/smalltalkCI#using-a-different-smalltalkci-branch-or-fork

regards,
bruno



--
Sent from: http://forum.world.st/GLASS-f1460844.html
_______________________________________________
Glass mailing list
[hidden email]
http://lists.gemtalksystems.com/mailman/listinfo/glass