Assessments Framework (1.49) in VW 7.7.1: 6 errors, 1 failure

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Assessments Framework (1.49) in VW 7.7.1: 6 errors, 1 failure

espin
Hi all (expecially Andres ;-),
I have been finally able to get VW7.7.1 and load Assessment budle (1.49).
(I also loaded RBSUnitExtensions 7.7.1 - 7)

I wanted to see it running so I executed the tests and got 6 errors
and 1 failure.
It looks like almost all of them boil down to missing #whatever method


Did I fail to load things properly?
Any suggestions?

Any guidance on what to look as an example to understand how to
write assessments (in lieu of SUnit tests)?

Thanks a lot in advance
Bye
--
Enrico Spinielli
"Do Androids dream of electric sheep?"— Philip K. Dick
"Hear and forget; see and remember;do and understand."—Mitchel Resnick

_______________________________________________
vwnc mailing list
[hidden email]
http://lists.cs.uiuc.edu/mailman/listinfo/vwnc
Reply | Threaded
Open this post in threaded view
|

Re: Assessments Framework (1.49) in VW 7.7.1: 6 errors, 1 failure

Andres Valloud-6
Those errors are there on purpose to make sure errors and other types of
failures show up in the results viewer like they should.  This approach
parallels that of SUnit: some of SUnit's tests typically have a failure
and an error that occur on purpose to verify they are visible in the UI.

Take a look at the Self Checks packages, in particular the classes in
"Assessments - Checks".  Note there are many meta-tests which are used
by the tests to ensure the framework is working properly.  The self
checks also show how to use Assessments without a user interface.
Here's another example: running the MemoryPolicyStressTests SUnit tests
under Assessments headlessly writing a log file.

assessment := Assessment new.
AbstractMemoryPolicyStressTest withAllSubclasses do:
        [:each |
                | checklist |
                checklist := CheckRepository checklistForClass: each.
                assessment addChecklist: checklist
        ].
context := assessment defaultEvaluationContext.
resultPolicy := CompositeAssessmentResultPolicy new.
resultPolicy addPolicy: context resultPolicy.
filePolicy := HardenedFileLogAssessmentResultPolicy new.
filePolicy fileName: 'igcTuning-tuned.txt'.
resultPolicy addPolicy: filePolicy.
context resultPolicy: resultPolicy.
context evaluate: assessment

On 3/14/2011 1:55 AM, Enrico Spinielli wrote:

> Hi all (expecially Andres ;-),
> I have been finally able to get VW7.7.1 and load Assessment budle (1.49).
> (I also loaded RBSUnitExtensions 7.7.1 - 7)
>
> I wanted to see it running so I executed the tests and got 6 errors
> and 1 failure.
> It looks like almost all of them boil down to missing #whatever method
>
>
> Did I fail to load things properly?
> Any suggestions?
>
> Any guidance on what to look as an example to understand how to
> write assessments (in lieu of SUnit tests)?
>
> Thanks a lot in advance
> Bye
_______________________________________________
vwnc mailing list
[hidden email]
http://lists.cs.uiuc.edu/mailman/listinfo/vwnc
Reply | Threaded
Open this post in threaded view
|

Re: Assessments Framework (1.49) in VW 7.7.1: 6 errors, 1 failure

Andres Valloud-6
Also, I just noted that the title of this email refers to a sub-bundle
within Assessments.  To load Assessments proper, load the bundle
"Assessments".

On 3/14/2011 3:05 PM, Andres Valloud wrote:

> Those errors are there on purpose to make sure errors and other types of
> failures show up in the results viewer like they should. This approach
> parallels that of SUnit: some of SUnit's tests typically have a failure
> and an error that occur on purpose to verify they are visible in the UI.
>
> Take a look at the Self Checks packages, in particular the classes in
> "Assessments - Checks". Note there are many meta-tests which are used by
> the tests to ensure the framework is working properly. The self checks
> also show how to use Assessments without a user interface. Here's
> another example: running the MemoryPolicyStressTests SUnit tests under
> Assessments headlessly writing a log file.
>
> assessment := Assessment new.
> AbstractMemoryPolicyStressTest withAllSubclasses do:
> [:each |
> | checklist |
> checklist := CheckRepository checklistForClass: each.
> assessment addChecklist: checklist
> ].
> context := assessment defaultEvaluationContext.
> resultPolicy := CompositeAssessmentResultPolicy new.
> resultPolicy addPolicy: context resultPolicy.
> filePolicy := HardenedFileLogAssessmentResultPolicy new.
> filePolicy fileName: 'igcTuning-tuned.txt'.
> resultPolicy addPolicy: filePolicy.
> context resultPolicy: resultPolicy.
> context evaluate: assessment
>
> On 3/14/2011 1:55 AM, Enrico Spinielli wrote:
>> Hi all (expecially Andres ;-),
>> I have been finally able to get VW7.7.1 and load Assessment budle (1.49).
>> (I also loaded RBSUnitExtensions 7.7.1 - 7)
>>
>> I wanted to see it running so I executed the tests and got 6 errors
>> and 1 failure.
>> It looks like almost all of them boil down to missing #whatever method
>>
>>
>> Did I fail to load things properly?
>> Any suggestions?
>>
>> Any guidance on what to look as an example to understand how to
>> write assessments (in lieu of SUnit tests)?
>>
>> Thanks a lot in advance
>> Bye
_______________________________________________
vwnc mailing list
[hidden email]
http://lists.cs.uiuc.edu/mailman/listinfo/vwnc