Build instructions for building threaded 6.0 VM on linux

Hi Everyone,

Would someone please point me to instructions on how to build the 6.0
threaded VM for linux (Ubuntu).

Thanks!
Alistair

On Sun, Mar 26, 2017 at 1:13 AM, Alistair Grant <[hidden email]> wrote:
> Hi Everyone,
>
> Would someone please point me to instructions on how to build the 6.0
> threaded VM for linux (Ubuntu).

Looking here...
https://github.com/OpenSmalltalk/opensmalltalk-vm/tree/Cog/build.linux32x86/pharo.cog.spur
its not the itimerheartbeat ones, so do...

$ git clone https://github.com/OpenSmalltalk/opensmalltalk-vm.git
$ cd build.linux32x86/pharo.cog.spur/build
$ ./mvm

cheers -ben

$ git clone https://github.com/pharo-project/pharo-vm.git

Hi Esteban & Ben,

Thanks very much for your quick replies.

Both versions are failing trying to build libssl.so, see error messages
below.

The build output is huge, so I've only included the final few lines (a
but more in Ben's build).

My familiarity with makefiles is bad enough, and have never
touched cmake, so hopefully this is an easy fix...

Any suggestions?


Thanks again,
Alistair


Trying to build using Esteban's instructions:

make[3]: *** No rule to make target
'/usr/lib/i386-linux-gnu/libssl.so', needed by 'libgit2.so.0.23.0'.
Stop.
make[3]: Leaving directory
'/data/pharo-snap/akg-try/pharo-vm/opensmalltalk-vm/build.linux32x86/third-party/libgit2-0.23.0'
CMakeFiles/Makefile2:67: recipe for target 'CMakeFiles/git2.dir/all' failed
make[2]: *** [CMakeFiles/git2.dir/all] Error 2
make[2]: Leaving directory
'/data/pharo-snap/akg-try/pharo-vm/opensmalltalk-vm/build.linux32x86/third-party/libgit2-0.23.0'
Makefile:127: recipe for target 'all' failed
make[1]: *** [all] Error 2
make[1]: Leaving directory
'/data/pharo-snap/akg-try/pharo-vm/opensmalltalk-vm/build.linux32x86/third-party/libgit2-0.23.0'
Makefile.libgit2:28: recipe for target
'/data/pharo-snap/akg-try/pharo-vm/opensmalltalk-vm/.thirdparty-cache/linux/i386/lib/libgit2.so.0.23.0'
failed
make: *** [/data/pharo-snap/akg-try/pharo-vm/opensmalltalk-vm/.thirdparty-cache/linux/i386/lib/libgit2.so.0.23.0]
Error 2


Trying to build using Ben's instructions:

[ 96%] Building C object CMakeFiles/git2.dir/deps/zlib/infback.c.o
[ 97%] Building C object CMakeFiles/git2.dir/deps/zlib/trees.c.o
[ 97%] Building C object CMakeFiles/git2.dir/deps/zlib/adler32.c.o
/data/pharo-snap/akg-try/opensmalltalk-vm/build.linux32x86/third-party/libgit2-0.23.0/deps/zlib/adler32.c:173:15:
warning: function declaration isn't a prototype [-Wstrict-prototypes]
 uLong ZEXPORT adler32_combine64(adler1, adler2, len2)
               ^
[ 98%] Building C object CMakeFiles/git2.dir/deps/zlib/inftrees.c.o
[ 99%] Building C object CMakeFiles/git2.dir/deps/http-parser/http_parser.c.o
make[3]: *** No rule to make target
'/usr/lib/i386-linux-gnu/libssl.so', needed by 'libgit2.so.0.23.0'.
Stop.
make[3]: Leaving directory
'/data/pharo-snap/akg-try/opensmalltalk-vm/build.linux32x86/third-party/libgit2-0.23.0'
CMakeFiles/Makefile2:67: recipe for target 'CMakeFiles/git2.dir/all' failed
make[2]: *** [CMakeFiles/git2.dir/all] Error 2
make[2]: Leaving directory
'/data/pharo-snap/akg-try/opensmalltalk-vm/build.linux32x86/third-party/libgit2-0.23.0'
Makefile:127: recipe for target 'all' failed
make[1]: *** [all] Error 2
make[1]: Leaving directory
'/data/pharo-snap/akg-try/opensmalltalk-vm/build.linux32x86/third-party/libgit2-0.23.0'
Makefile.libgit2:28: recipe for target
'/data/pharo-snap/akg-try/opensmalltalk-vm/.thirdparty-cache/linux/i386/lib/libgit2.so.0.23.0'
failed
make: *** [/data/pharo-snap/akg-try/opensmalltalk-vm/.thirdparty-cache/linux/i386/lib/libgit2.so.0.23.0]
Error 2


On 25 March 2017 at 18:42, Esteban Lorenzano <[hidden email]> wrote:

On Sat, Mar 25, 2017 at 07:29:29PM +0100, Alistair Grant wrote:
> make[3]: *** No rule to make target
> '/usr/lib/i386-linux-gnu/libssl.so', needed by 'libgit2.so.0.23.0'.

Try:

  % sudo apt-get install libssl1.0.0:i386

Pierce

On Sat, Mar 25, 2017 at 07:29:29PM +0100, Alistair Grant wrote:
> make[3]: *** No rule to make target
> '/usr/lib/i386-linux-gnu/libssl.so', needed by 'libgit2.so.0.23.0'.

Sorry, also

  % sudo apt-get install libssl-dev:i386

On 26 March 2017 at 04:09, Pierce Ng <[hidden email]> wrote:
> On Sat, Mar 25, 2017 at 07:29:29PM +0100, Alistair Grant wrote:
>> make[3]: *** No rule to make target
>> '/usr/lib/i386-linux-gnu/libssl.so', needed by 'libgit2.so.0.23.0'.
>
> Sorry, also
>
>   % sudo apt-get install libssl-dev:i386

Thanks, Pierce.

That gets past the previous errors, I'm now getting:

...
Installing links
/data/pharo-snap/akg-try/pharo-vm/opensmalltalk-vm/build.linux32x86/pharo.cog.spur/build
/data/pharo-snap/akg-try/pharo-vm/opensmalltalk-vm/build.linux32x86/pharo.cog.spur/build
/data/pharo-snap/akg-try/pharo-vm/opensmalltalk-vm/build.linux32x86/pharo.cog.spur/build
cp -f /data/pharo-snap/akg-try/pharo-vm/opensmalltalk-vm/.thirdparty-cache/linux/i386/lib/libssh2.so.1.0.1
/data/pharo-snap/akg-try/pharo-vm/opensmalltalk-vm/products/phcogspurlinuxht/lib/squeak/5.0-
Installing links
DONE
/data/pharo-snap/akg-try/pharo-vm/opensmalltalk-vm/build.linux32x86/pharo.cog.spur/build
/data/pharo-snap/akg-try/pharo-vm/opensmalltalk-vm/build.linux32x86/pharo.cog.spur/build
/data/pharo-snap/akg-try/pharo-vm/opensmalltalk-vm/build.linux32x86/pharo.cog.spur/build
cp -f /data/pharo-snap/akg-try/pharo-vm/opensmalltalk-vm/.thirdparty-cache/linux/i386/lib/libgit2.so.0.23.0
/data/pharo-snap/akg-try/pharo-vm/opensmalltalk-vm/products/phcogspurlinuxht/lib/squeak/5.0-
Installing links
DONE
/data/pharo-snap/akg-try/pharo-vm/opensmalltalk-vm/build.linux32x86/pharo.cog.spur/build
can't find PharoV50.sources


I haven't used travis, but it looks like it is defining a number of
environment variables, e.g. ARCH, FLAVOR, SRC_ARCH, HEARTBEAT.  If I
want the 32 bit linux threaded heartbeat, do I need to set these
manually?

Thanks again,
Alistair

no, once compiled is done (and your compilation worked).
those variables are for travis consumption, to allow use to pick the right artifact to build, but you already did it by hand :)

Esteban

>
> Thanks again,
> Alistair
>

On Sun, Mar 26, 2017 at 3:10 PM, Alistair Grant <[hidden email]> wrote:
Is there text cut from the right side of these lines.  The next three
lines are repeated, but maybe there was something more to distinguish
them? Also line 5 "squeak/5.0-" seems cut off.

Check whats under the ***products*** folder I marked above.

> Installing links
> DONE
> /data/pharo-snap/akg-try/pharo-vm/opensmalltalk-vm/build.linux32x86/pharo.cog.spur/build
> can't find PharoV50.sources

PharoV50.sources [1] needs to sit next to the VM or Image files to be found.
"can't find" it, is a standard message from a running VM.

Could you report if this works for you...
https://github.com/OpenSmalltalk/opensmalltalk-vm/pull/79

cheers -ben

Hi Esteban & Ben,

On 26 March 2017 at 10:49, Esteban Lorenzano <[hidden email]> wrote:
>
>> On 26 Mar 2017, at 09:10, Alistair Grant <[hidden email]> wrote:
>> I haven't used travis, but it looks like it is defining a number of
>> environment variables, e.g. ARCH, FLAVOR, SRC_ARCH, HEARTBEAT.  If I
>> want the 32 bit linux threaded heartbeat, do I need to set these
>> manually?
>
> no, once compiled is done (and your compilation worked).
> those variables are for travis consumption, to allow use to pick the right artifact to build, but you already did it by hand :)

Thanks for pointing this out, I wouldn't have realised that the
compilation succeeded. :-)



On 26 March 2017 at 15:20, Ben Coman <[hidden email]> wrote:
There was text cut off from the right side of the lines.  I
cut-and-pasted this from the terminal, but still not sure how the text
was cut, my apologies for the inconvenience.

See below for "5.0-".

From my most recent build:

Installing links
DONE
make[1]: Leaving directory
'/data/pharo-snap/parts/pharo/build/pharo-vm/opensmalltalk-vm/build.linux32x86/third-party'
/data/pharo-snap/parts/pharo/build/pharo-vm/opensmalltalk-vm/build.linux32x86/pharo.cog.spur/build
/data/pharo-snap/parts/pharo/build/pharo-vm/opensmalltalk-vm/build.linux32x86/pharo.cog.spur/build
/data/pharo-snap/parts/pharo/build/pharo-vm/opensmalltalk-vm/build.linux32x86/pharo.cog.spur/build
make[1]: warning: jobserver unavailable: using -j1.  Add '+' to parent
make rule.
make[1]: Entering directory
'/data/pharo-snap/parts/pharo/build/pharo-vm/opensmalltalk-vm/build.linux32x86/third-party'
cp -f /data/pharo-snap/parts/pharo/build/pharo-vm/opensmalltalk-vm/.thirdparty-cache/linux/i386/lib/libgit2.so.0.23.0
/data/pharo-snap/parts/pharo/build/pharo-vm/opensmalltalk-vm/products/phcogspurlinuxht/lib/squeak/5.0-
Installing links
DONE
make[1]: Leaving directory
'/data/pharo-snap/parts/pharo/build/pharo-vm/opensmalltalk-vm/build.linux32x86/third-party'
/data/pharo-snap/parts/pharo/build/pharo-vm/opensmalltalk-vm/build.linux32x86/pharo.cog.spur/build



The "squeak/5.0-" directory is no longer present after the build
completes, however the path to the final vm is:

"parts/pharo/build/pharo-vm/opensmalltalk-vm/products/phcogspurlinuxht/lib/pharo/5.0-"

I agree that "5.0-" is a strange directory name, however looking at
the version info produced by my vm vs. the version info produced by
get.pharo.org/60+vmT, I suspect that there's something missing in my
build environment.  60+vmT produces:

  5.0-201702221539  Wed Feb 22 15:46:29 UTC 2017 gcc 4.6.3 [Production
Spur ITHB VM]

201702221539 looks like a timestamp.  Not sure why it is missing in my vm.

(I assume that squeak/5.0- is renamed to pharo/5.0- in editpharoinstall.sh)



>> cp -f /data/pharo-snap/akg-try/pharo-vm/opensmalltalk-vm/.thirdparty-cache/linux/i386/lib/libgit2.so.0.23.0
>> /data/pharo-snap/akg-try/pharo-vm/opensmalltalk-vm/***products***/phcogspurlinuxht/lib/squeak/5.0-
>
> Check whats under the ***products*** folder I marked above.

$ ls -R pharo-vm/opensmalltalk-vm/products
parts/pharo/build/pharo-vm/opensmalltalk-vm/products:
phcogspurlinuxht

parts/pharo/build/pharo-vm/opensmalltalk-vm/products/phcogspurlinuxht:
bin  lib  pharo

parts/pharo/build/pharo-vm/opensmalltalk-vm/products/phcogspurlinuxht/bin:
pharo

parts/pharo/build/pharo-vm/opensmalltalk-vm/products/phcogspurlinuxht/lib:
pharo

parts/pharo/build/pharo-vm/opensmalltalk-vm/products/phcogspurlinuxht/lib/pharo:
5.0-

parts/pharo/build/pharo-vm/opensmalltalk-vm/products/phcogspurlinuxht/lib/pharo/5.0-:
AioPlugin             JPEGReadWriter2Plugin  libSDL2-2.0.so.0.4.1
libssl.so.1.0.0   vm-display-null
B3DAcceleratorPlugin  libcrypto.so.1.0.0     libSDL2.so
pharo             vm-display-X11
EventsHandlerPlugin   libgit2.so             libssh2.so
RePlugin          vm-sound-ALSA
FT2Plugin             libgit2.so.0.23.0      libssh2.so.1
SqueakSSL         vm-sound-null
InternetConfigPlugin  libgit2.so.23          libssh2.so.1.0.1
SurfacePlugin     vm-sound-OSS
JPEGReaderPlugin      libSDL2-2.0.so.0       libssl.so
vm-display-fbdev




If I try to view the change ("View changes" button) on github I get:
"We went looking everywhere, but couldn’t find those commits."

However I'd be surprised if it had any affect as PharoV50.sources
didn't exist anywhere in the build tree.

However it did give me enough of a clue that I've now modified my
build script to add the sources file in, so there aren't any obvious
errors during the build process (well, obvious to me, I haven't gone
through all 7700 lines of the build log).


Trying to use the VM produces:

THERE_BE_DRAGONS_HERE
Your VM is too old for this image. Please download the latest VM.
26 March 2017 10:54:36.099174 pm

VM: unix - i686 - linux-gnu - CoInterpreter VMMaker.oscog-eem.2175
uuid: eb79e804-a80b-4ad3-bd19-9c60a24a14f1 Mar 26 2017
StackToRegisterMappingCogit VMMaker.oscog-eem.2174 uuid:
eefef0d3-2df8-4fe7-9f71-2aca68641ba6 Mar 26 2017
VM:   Date:  Plugins:

Image: Pharo6.0 [Latest update: #60447]

StartupUIManager>>inform:
Receiver: a StartupUIManager
Arguments and temporary variables:
arg1: 'Your VM is too old for this image. Please download the latest VM.'
tmp1: nil
Receiver's instance variables:
doNotQuitOnRestart: false
uiManager: nil


DiskStore class(Object)>>inform:
Receiver: DiskStore
Arguments and temporary variables:
arg1: 'Your VM is too old for this image. Please download the latest VM.'
Receiver's instance variables:
superclass: FileSystemStore
methodDict: a MethodDictionary(#=->DiskStore>>#=
#basenameFromEntry:->DiskStore...etc...
format: 65537
layout: a FixedLayout
instanceVariables: nil
organization: a ClassOrganization
subclasses: {UnixStore. WindowsStore}
name: #DiskStore
classPool: a Dictionary(#CurrentFS->a FileSystem #Primitives->a
FilePluginPrims...etc...
sharedPools: nil
environment: a SystemDictionary(lots of globals)
category: #'FileSystem-Disk'
traitComposition: {}
localSelectors: nil
...


The same thing happens with a V5.0 image.

FYI:

$ pharo.ui --version
5.0-  Sun Mar 26 20:48:38 UTC 2017 gcc 5.4.0 [Production Spur VM]
CoInterpreter VMMaker.oscog-eem.2175 uuid:
eb79e804-a80b-4ad3-bd19-9c60a24a14f1 Mar 26 2017
StackToRegisterMappingCogit VMMaker.oscog-eem.2174 uuid:
eefef0d3-2df8-4fe7-9f71-2aca68641ba6 Mar 26 2017
VM:   Date:
Plugins:
Linux 10b18a356b12 4.8.0-41-generic #44~16.04.1-Ubuntu SMP Fri Mar 3
17:11:16 UTC 2017 i686 i686 i686 GNU/Linux
plugin path: /snap/pharo/x1/usr/bin/pharo-vm/ [default:
/snap/pharo/x1/usr/bin/pharo-vm/]


Given I've only just built the VM, I'm a bit surprised that it is too old. :-)

I'm basically using Esteban's instructions, i.e.:

$ git clone https://github.com/pharo-project/pharo-vm.git
$ cd pharo-vm/opensmalltalk-vm/build.linux32x86/pharo.cog.spur/build
$ ./mvm

Once I get this working properly, hopefully I can contribute some
documentation back that makes it easier for the next person.

More hints please... :-)

Thanks very much for all you assistance,
Alistair

On Mon, Mar 27, 2017 at 5:25 AM, Alistair Grant <[hidden email]> wrote:
> Trying to use the VM produces:
>
> THERE_BE_DRAGONS_HERE
> Your VM is too old for this image. Please download the latest VM.
> 26 March 2017 10:54:36.099174 pm

Last night I built the 64-bit pharo-vm on OSX
and then trying to run 60451-64.image gave me the same error.
I didn't have time to look into it.

cheers -ben

On 27 March 2017 at 01:37, Ben Coman <[hidden email]> wrote:
Thanks for the confirmation.

In my case it's caused by the VM failing to report the VM, Date and
Plugin information (which can be seen from the --version information I
supplied previously), which probably also ties back to the "5.0-"
directory.  So hopefully once that is sorted, it will all magically
work.

Thanks again,
Alistair

Hi Ben,

On 27 March 2017 at 01:37, Ben Coman <[hidden email]> wrote:
Did you get a chance to resolve this?

If not, can you (or someone) point me to where the VM prints its
version information, i.e.:

pharo --version

I think I'll be able to trace back from there what the problem is.

Thanks very much,
Alistair

that’s because you need to generate commit info.
this is usually a hook, but is not working super fine.
I have thi script in my root:

genVersion.sh:
#! /bin/bash

echo "`cat opensmalltalk-vm/platforms/Cross/vm/sqSCCSVersion.h | opensmalltalk-vm/.git_filters/RevDateURL.smudge`" > opensmalltalk-vm/platforms/Cross/vm/sqSCCSVersion.h
echo "`cat opensmalltalk-vm/platforms/Cross/plugins/sqPluginsSCCSVersion.h | opensmalltalk-vm/.git_filters/RevDateURL.smudge`" > opensmalltalk-vm/platforms/Cross/plugins/sqPluginsSCCSVersion.h


:P

Esteban

On Wed, Mar 29, 2017 at 9:04 PM, Esteban Lorenzano <[hidden email]> wrote:
> that’s because you need to generate commit info.

ahhhh. penny drops!
I guess you mean "Important notice for developers" per...
https://github.com/OpenSmalltalk/opensmalltalk-vm

I was on a new machine and that was long forgotten.
cheers -ben

Hi Estaban,

On 29 March 2017 at 15:04, Esteban Lorenzano <[hidden email]> wrote:
And up and running!

Next step is to try and get the snap package to the point where I'm
happy to post it on bintray for people to try.

Thanks for your assistance!
Alistair