Jenkis is testing twice (or counting twice)

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
7 messages Options
Reply | Threaded
Open this post in threaded view
|

Jenkis is testing twice (or counting twice)

Mariano Martinez Peck
Take as an example Fuel. For 2 of the 6 packages, it runs the tests twice. Or at least they are count twice. Examples:

https://ci.lille.inria.fr/pharo/job/Fuel/369/testReport/FuelTests.Collections/FLSimpleStackTest/
https://ci.lille.inria.fr/pharo/job/Fuel/369/testReport/FuelTests.InternalMetalevel/FLCompiledMethodSerializationTest/

Of course, running those tests from a normal TestRunner I see the correct amount of tests.

Any ideas?

--
Mariano
http://marianopeck.wordpress.com

Reply | Threaded
Open this post in threaded view
|

Re: Jenkis is testing twice (or counting twice)

Schwab,Wilhelm K
Divide by two?

*Somebody* was going to say it :)  On the optimistic side, the tests are being used and results reported.




________________________________________
From: [hidden email] [[hidden email]] On Behalf Of Mariano Martinez Peck [[hidden email]]
Sent: Wednesday, October 05, 2011 3:50 PM
To: Pharo Development
Subject: [Pharo-project] Jenkis is testing twice (or counting twice)

Take as an example Fuel. For 2 of the 6 packages, it runs the tests twice. Or at least they are count twice. Examples:

https://ci.lille.inria.fr/pharo/job/Fuel/369/testReport/FuelTests.Collections/FLSimpleStackTest/
https://ci.lille.inria.fr/pharo/job/Fuel/369/testReport/FuelTests.InternalMetalevel/FLCompiledMethodSerializationTest/

Of course, running those tests from a normal TestRunner I see the correct amount of tests.

Any ideas?

--
Mariano
http://marianopeck.wordpress.com


Reply | Threaded
Open this post in threaded view
|

Re: Jenkis is testing twice (or counting twice)

Mariano Martinez Peck


On Wed, Oct 5, 2011 at 10:15 PM, Schwab,Wilhelm K <[hidden email]> wrote:
Divide by two?

*Somebody* was going to say it :)

hehehehheheh. But the problem is that you know to which packages you have to divide. Because it affects only some of them, not all ;)
 
 On the optimistic side, the tests are being used and results reported.




________________________________________
From: [hidden email] [[hidden email]] On Behalf Of Mariano Martinez Peck [[hidden email]]
Sent: Wednesday, October 05, 2011 3:50 PM
To: Pharo Development
Subject: [Pharo-project] Jenkis is testing twice (or counting twice)

Take as an example Fuel. For 2 of the 6 packages, it runs the tests twice. Or at least they are count twice. Examples:

https://ci.lille.inria.fr/pharo/job/Fuel/369/testReport/FuelTests.Collections/FLSimpleStackTest/
https://ci.lille.inria.fr/pharo/job/Fuel/369/testReport/FuelTests.InternalMetalevel/FLCompiledMethodSerializationTest/

Of course, running those tests from a normal TestRunner I see the correct amount of tests.

Any ideas?

--
Mariano
http://marianopeck.wordpress.com





--
Mariano
http://marianopeck.wordpress.com

Reply | Threaded
Open this post in threaded view
|

Re: Jenkis is testing twice (or counting twice)

Schwab,Wilhelm K
Mariano,

You are, of course, correct in wanting to fix it.  Do the troublesome tests result in debug logs?  If not, could that be made to happen?  There is no guarantee that it will show itself this way, but it might be worth a try.

Bill


________________________________________
From: [hidden email] [[hidden email]] On Behalf Of Mariano Martinez Peck [[hidden email]]
Sent: Wednesday, October 05, 2011 4:48 PM
To: [hidden email]
Subject: Re: [Pharo-project] Jenkis is testing twice (or counting twice)

On Wed, Oct 5, 2011 at 10:15 PM, Schwab,Wilhelm K <[hidden email]<mailto:[hidden email]>> wrote:
Divide by two?

*Somebody* was going to say it :)

hehehehheheh. But the problem is that you know to which packages you have to divide. Because it affects only some of them, not all ;)

 On the optimistic side, the tests are being used and results reported.




________________________________________
From: [hidden email]<mailto:[hidden email]> [[hidden email]<mailto:[hidden email]>] On Behalf Of Mariano Martinez Peck [[hidden email]<mailto:[hidden email]>]
Sent: Wednesday, October 05, 2011 3:50 PM
To: Pharo Development
Subject: [Pharo-project] Jenkis is testing twice (or counting twice)

Take as an example Fuel. For 2 of the 6 packages, it runs the tests twice. Or at least they are count twice. Examples:

https://ci.lille.inria.fr/pharo/job/Fuel/369/testReport/FuelTests.Collections/FLSimpleStackTest/
https://ci.lille.inria.fr/pharo/job/Fuel/369/testReport/FuelTests.InternalMetalevel/FLCompiledMethodSerializationTest/

Of course, running those tests from a normal TestRunner I see the correct amount of tests.

Any ideas?

--
Mariano
http://marianopeck.wordpress.com





--
Mariano
http://marianopeck.wordpress.com


Reply | Threaded
Open this post in threaded view
|

Re: Jenkis is testing twice (or counting twice)

Mariano Martinez Peck


On Thu, Oct 6, 2011 at 2:49 AM, Schwab,Wilhelm K <[hidden email]> wrote:
Mariano,

You are, of course, correct in wanting to fix it.  Do the troublesome tests result in debug logs? 

No, because they succeed :(
 
You can see it here: https://ci.lille.inria.fr/pharo/job/Fuel/465/testReport/FuelTests.InternalMetalevel/FLCompiledMethodSerializationTest/

I think it is something related to HDTestReport  of HudsonBuildTools

Lukas any idea?


 If not, could that be made to happen?  There is no guarantee that it will show itself this way, but it might be worth a try.

Bill


________________________________________
From: [hidden email] [[hidden email]] On Behalf Of Mariano Martinez Peck [[hidden email]]
Sent: Wednesday, October 05, 2011 4:48 PM
To: [hidden email]
Subject: Re: [Pharo-project] Jenkis is testing twice (or counting twice)

On Wed, Oct 5, 2011 at 10:15 PM, Schwab,Wilhelm K <[hidden email]<mailto:[hidden email]>> wrote:
Divide by two?

*Somebody* was going to say it :)

hehehehheheh. But the problem is that you know to which packages you have to divide. Because it affects only some of them, not all ;)

 On the optimistic side, the tests are being used and results reported.




________________________________________
From: [hidden email]<mailto:[hidden email]> [[hidden email]<mailto:[hidden email]>] On Behalf Of Mariano Martinez Peck [[hidden email]<mailto:[hidden email]>]
Sent: Wednesday, October 05, 2011 3:50 PM
To: Pharo Development
Subject: [Pharo-project] Jenkis is testing twice (or counting twice)

Take as an example Fuel. For 2 of the 6 packages, it runs the tests twice. Or at least they are count twice. Examples:

https://ci.lille.inria.fr/pharo/job/Fuel/369/testReport/FuelTests.Collections/FLSimpleStackTest/
https://ci.lille.inria.fr/pharo/job/Fuel/369/testReport/FuelTests.InternalMetalevel/FLCompiledMethodSerializationTest/

Of course, running those tests from a normal TestRunner I see the correct amount of tests.

Any ideas?

--
Mariano
http://marianopeck.wordpress.com





--
Mariano
http://marianopeck.wordpress.com





--
Mariano
http://marianopeck.wordpress.com

Reply | Threaded
Open this post in threaded view
|

Re: Jenkis is testing twice (or counting twice)

Mariano Martinez Peck
Well, of course the problem was mine, since I was sending a list of CATEGORIES to  HDTestReport runPackages:    instead of packages....


On Mon, Oct 31, 2011 at 12:44 AM, Mariano Martinez Peck <[hidden email]> wrote:


On Thu, Oct 6, 2011 at 2:49 AM, Schwab,Wilhelm K <[hidden email]> wrote:
Mariano,

You are, of course, correct in wanting to fix it.  Do the troublesome tests result in debug logs? 

No, because they succeed :(
 
You can see it here: https://ci.lille.inria.fr/pharo/job/Fuel/465/testReport/FuelTests.InternalMetalevel/FLCompiledMethodSerializationTest/

I think it is something related to HDTestReport  of HudsonBuildTools

Lukas any idea?


 If not, could that be made to happen?  There is no guarantee that it will show itself this way, but it might be worth a try.

Bill


________________________________________
From: [hidden email] [[hidden email]] On Behalf Of Mariano Martinez Peck [[hidden email]]
Sent: Wednesday, October 05, 2011 4:48 PM
To: [hidden email]
Subject: Re: [Pharo-project] Jenkis is testing twice (or counting twice)

On Wed, Oct 5, 2011 at 10:15 PM, Schwab,Wilhelm K <[hidden email]<mailto:[hidden email]>> wrote:
Divide by two?

*Somebody* was going to say it :)

hehehehheheh. But the problem is that you know to which packages you have to divide. Because it affects only some of them, not all ;)

 On the optimistic side, the tests are being used and results reported.




________________________________________
From: [hidden email]<mailto:[hidden email]> [[hidden email]<mailto:[hidden email]>] On Behalf Of Mariano Martinez Peck [[hidden email]<mailto:[hidden email]>]
Sent: Wednesday, October 05, 2011 3:50 PM
To: Pharo Development
Subject: [Pharo-project] Jenkis is testing twice (or counting twice)

Take as an example Fuel. For 2 of the 6 packages, it runs the tests twice. Or at least they are count twice. Examples:

https://ci.lille.inria.fr/pharo/job/Fuel/369/testReport/FuelTests.Collections/FLSimpleStackTest/
https://ci.lille.inria.fr/pharo/job/Fuel/369/testReport/FuelTests.InternalMetalevel/FLCompiledMethodSerializationTest/

Of course, running those tests from a normal TestRunner I see the correct amount of tests.

Any ideas?

--
Mariano
http://marianopeck.wordpress.com





--
Mariano
http://marianopeck.wordpress.com





--
Mariano
http://marianopeck.wordpress.com




--
Mariano
http://marianopeck.wordpress.com

Reply | Threaded
Open this post in threaded view
|

Re: Jenkis is testing twice (or counting twice)

Schwab,Wilhelm K
Nice catch!  Things like that can be frustrating to find.  But it gets to something I generally tell myself while chasing what seems to be a disproportionately stubborn defect: when Smalltalk fails, it usually does so for a "good" reason.  By that, I mean that Smalltalk systems generally do just what we humans told them to do.

Bill




From: [hidden email] [[hidden email]] on behalf of Mariano Martinez Peck [[hidden email]]
Sent: Sunday, October 30, 2011 7:55 PM
To: [hidden email]
Subject: Re: [Pharo-project] Jenkis is testing twice (or counting twice)

Well, of course the problem was mine, since I was sending a list of CATEGORIES to  HDTestReport runPackages:    instead of packages....


On Mon, Oct 31, 2011 at 12:44 AM, Mariano Martinez Peck <[hidden email]> wrote:


On Thu, Oct 6, 2011 at 2:49 AM, Schwab,Wilhelm K <[hidden email]> wrote:
Mariano,

You are, of course, correct in wanting to fix it.  Do the troublesome tests result in debug logs? 

No, because they succeed :(
 
You can see it here: https://ci.lille.inria.fr/pharo/job/Fuel/465/testReport/FuelTests.InternalMetalevel/FLCompiledMethodSerializationTest/

I think it is something related to HDTestReport  of HudsonBuildTools

Lukas any idea?


 If not, could that be made to happen?  There is no guarantee that it will show itself this way, but it might be worth a try.

Bill


________________________________________
From: [hidden email] [[hidden email]] On Behalf Of Mariano Martinez Peck [[hidden email]]
Sent: Wednesday, October 05, 2011 4:48 PM
To: [hidden email]
Subject: Re: [Pharo-project] Jenkis is testing twice (or counting twice)

On Wed, Oct 5, 2011 at 10:15 PM, Schwab,Wilhelm K <[hidden email]<mailto:[hidden email]>> wrote:
Divide by two?

*Somebody* was going to say it :)

hehehehheheh. But the problem is that you know to which packages you have to divide. Because it affects only some of them, not all ;)

 On the optimistic side, the tests are being used and results reported.




________________________________________
From: [hidden email]<mailto:[hidden email]> [[hidden email]<mailto:[hidden email]>] On Behalf Of Mariano Martinez Peck [[hidden email]<mailto:[hidden email]>]
Sent: Wednesday, October 05, 2011 3:50 PM
To: Pharo Development
Subject: [Pharo-project] Jenkis is testing twice (or counting twice)

Take as an example Fuel. For 2 of the 6 packages, it runs the tests twice. Or at least they are count twice. Examples:

https://ci.lille.inria.fr/pharo/job/Fuel/369/testReport/FuelTests.Collections/FLSimpleStackTest/
https://ci.lille.inria.fr/pharo/job/Fuel/369/testReport/FuelTests.InternalMetalevel/FLCompiledMethodSerializationTest/

Of course, running those tests from a normal TestRunner I see the correct amount of tests.

Any ideas?

--
Mariano
http://marianopeck.wordpress.com





--
Mariano
http://marianopeck.wordpress.com





--
Mariano
http://marianopeck.wordpress.com




--
Mariano
http://marianopeck.wordpress.com