Deployment pharo with multiple instances and voyage
Locked
Deployment pharo with multiple instances and voyage
 
|
Hi!
I’m close to deploy a web service using Pharo with Voyage and MongoDB. I have been playing with it and everything works ok with a single Pharo image. Couple of days ago I started questioning myself about how voyage behaves when you have multiple pharo images using the same mongo database (horizontal scaling). I want to know how the cache of voyage behaves in a scenario with object updates. Example: —————————————— Imagine I have two images A and B. - Image A query for object o and voyage put it in the cache. - Image B query for object o and voyage put it in the cache. - Image A updates object o and push it into the database calling #save. - Image B query for object o that should be already in the cache. In this case, does Image B see the changes performed by image A? —————————————— All ideas are welcome :) Thanks and cheers! Alejandro |
Re: Deployment pharo with multiple instances and voyage
|
|
Hi,
> Am 25.01.2017 um 01:30 schrieb Alejandro Infante <[hidden email]>: > > Hi! > > I’m close to deploy a web service using Pharo with Voyage and MongoDB. I have been playing with it and everything works ok with a single Pharo image. > > Couple of days ago I started questioning myself about how voyage behaves when you have multiple pharo images using the same mongo database (horizontal scaling). I want to know how the cache of voyage behaves in a scenario with object updates. > > Example: —————————————— > Imagine I have two images A and B. > > - Image A query for object o and voyage put it in the cache. > - Image B query for object o and voyage put it in the cache. > - Image A updates object o and push it into the database calling #save. > - Image B query for object o that should be already in the cache. > > In this case, does Image B see the changes performed by image A? > —————————————— > > All ideas are welcome :) > Nevertheless you can have problems if you use references. Voyage can handle references pretty well. But each class might be stored in another document/collection. As in mongo only the storage of a single document is atomic you need to be careful when doing concurrent updates with references. Norbert |
|
|
In reply to this post by Alejandro Infante
> On 25 Jan 2017, at 01:30, Alejandro Infante <[hidden email]> wrote: > > Hi! > > I’m close to deploy a web service using Pharo with Voyage and MongoDB. I have been playing with it and everything works ok with a single Pharo image. > > Couple of days ago I started questioning myself about how voyage behaves when you have multiple pharo images using the same mongo database (horizontal scaling). I want to know how the cache of voyage behaves in a scenario with object updates. > > Example: —————————————— > Imagine I have two images A and B. > > - Image A query for object o and voyage put it in the cache. > - Image B query for object o and voyage put it in the cache. > - Image A updates object o and push it into the database calling #save. > - Image B query for object o that should be already in the cache. > > In this case, does Image B see the changes performed by image A? > —————————————— yes. Voyage will always verify the version on the mongodb, no matter the cache, because in fact, the cache of Voyage is meant just to keep object identity (there has been discussions on if this is a real cache… I think it is, but with a different purpose than usual). Recently Martin enhanced that part by adding VMMongoRepository>>saveEnsuringCurrent: protocol who will also check your version is correct when writing (to avoid overwrite before update). So, this should be Ok :) Esteban > > All ideas are welcome :) > > Thanks and cheers! > Alejandro |
Re: Deployment pharo with multiple instances and voyage
|
|
Cool! Thanks for the answers!
Norbert mentions something interesting about references. I have found that even though on each query mongo get the up-to-date version of the objects, it does not install the proxies to look for the up-to-date versions of the references of the queried object. I made the following experiment: Having two images 1 and 2 and two classes A and B, each of them having one instance variable. ————————— Image 1 (Create two objects, “a” referencing “b”) [ |a b| a := A new. b := B new a setInstVar: b. b setInstVar: ‘foo'. b save. a save. ] Image 2 (Mutates the second object, but the first is not changed) [ b := (repository selectAll: A) first instVar. b setInstVar: ‘bar’. b save. ] Image 1 (Query the first object and access to the referenced object) [ b := (repository selectAll: A) first instVar. b instVar. “-> foo” b := (repository selectAll: B) first. b instVar. “-> bar" ] This little experiment showed me that I cannot trust on the state of other objects that I have not explicitly queried for. Is there any way of solving this without creating new instances of voyage repositories for each request? Thanks! Alejandro
|
Re: Deployment pharo with multiple instances and voyage
|
|
> On 25 Jan 2017, at 22:39 , Alejandro Infante <[hidden email]> wrote: > > Cool! Thanks for the answers! > > Norbert mentions something interesting about references. > I have found that even though on each query mongo get the up-to-date version of the objects, it does not install the proxies to look for the up-to-date versions of the references of the queried object. > > I made the following experiment: > Having two images 1 and 2 and two classes A and B, each of them having one instance variable. > ————————— > Image 1 (Create two objects, “a” referencing “b”) > [ |a b| > a := A new. > b := B new > a setInstVar: b. > b setInstVar: ‘foo'. > b save. > a save. > ] > > Image 2 (Mutates the second object, but the first is not changed) > [ > b := (repository selectAll: A) first instVar. > b setInstVar: ‘bar’. > b save. > ] > > Image 1 (Query the first object and access to the referenced object) > [ > b := (repository selectAll: A) first instVar. > b instVar. “-> foo” > b := (repository selectAll: B) first. > b instVar. “-> bar" > ] > > This little experiment showed me that I cannot trust on the state of other objects that I have not explicitly queried for. > > Is there any way of solving this without creating new instances of voyage repositories for each request? > > Thanks! > Alejandro Three, actually ;) - Accept that an image will contain some stale values, and deal with conflicts at save time. This is the most performant/scalable. - Always save only root objects More overhead since there's more likeliness of cache misses and actual reloads, but you can be sure any query will return the freshest value. - Extend retrieveObjectOf:json: to either replace doc refs with proxies, or do eager (recursive) lookup of whether cached versions of referenced documents are up-to-date when returning a cached object. In reality, only the first really makes sense; as you can never guarantee how long a queried object stays current. Cheers, Henry |
Re: Deployment pharo with multiple instances and voyage
|
|
In reply to this post by Alejandro Infante
This is great
I would love to know what is your application and we should add it in the success stories. Stef > Hi! > > I’m close to deploy a web service using Pharo with Voyage and MongoDB. I > have been playing with it and everything works ok with a single Pharo > image. > > Couple of days ago I started questioning myself about how voyage behaves > when you have multiple pharo images using the same mongo database > (horizontal scaling). I want to know how the cache of voyage behaves in > a scenario with object updates. > > Example: —————————————— > Imagine I have two images A and B. > > - Image A query for object o and voyage put it in the cache. > - Image B query for object o and voyage put it in the cache. > - Image A updates object o and push it into the database calling #save. > - Image B query for object o that should be already in the cache. > > In this case, does Image B see the changes performed by image A? > —————————————— > > All ideas are welcome :) > > Thanks and cheers! > Alejandro -- Using Opera's mail client: http://www.opera.com/mail/ |
|
|
+1
> Le 26 janv. 2017 à 16:10, stepharong <[hidden email]> a écrit : > > This is great > I would love to know what is your application and we should add it in the success stories. > > Stef > >> Hi! >> >> I’m close to deploy a web service using Pharo with Voyage and MongoDB. I have been playing with it and everything works ok with a single Pharo image. >> >> Couple of days ago I started questioning myself about how voyage behaves when you have multiple pharo images using the same mongo database (horizontal scaling). I want to know how the cache of voyage behaves in a scenario with object updates. >> >> Example: —————————————— >> Imagine I have two images A and B. >> >> - Image A query for object o and voyage put it in the cache. >> - Image B query for object o and voyage put it in the cache. >> - Image A updates object o and push it into the database calling #save. >> - Image B query for object o that should be already in the cache. >> >> In this case, does Image B see the changes performed by image A? >> —————————————— >> >> All ideas are welcome :) >> >> Thanks and cheers! >> Alejandro > > > -- > Using Opera's mail client: http://www.opera.com/mail/ > |
«
Return to Pharo Smalltalk Users
|
1 view|%1 views
| Free forum by Nabble | Edit this page |