Hi
Mariano!
I wish I could claim credit for the CI integration, but that is purely the effort of our Solutions Architect, David.
Yes, he did an amazing job.
And if he had time he'd be able to bash a testing framework, but alas he doesn't.
Thanks for the SUnit suggestion, we started to incorporate new work requiring SUnit tests before passing code review.
But as always things got a little crazy and we haven't stuck to the change of workflow, something we will definitely revisit.
We need something more for running Regression tests.
In our situation a regression test would be like:
- Launch application, navigate the tree menu to a certain point/depth, i.e., find the menu item and launch that
- Opens up a list of Purchase Orders (PO), add a new PO (several ways to achieve this, toolbar, r-click context menu, hotkey)
- Fill out some predetermined fields with programmed inputs, save the new PO
- Then determine if the "action" met the success criteria:
- Either check for an expected new DB record
- Scan/check the parent list for the new GUI entry (i.e., scrutinised the collection)
- or some other method.
Once we have a facility like that, then we can go about writing the 2,000 we need j/k... probably more like 20,000
:o)
/Ma tt
Matthew Boulter <[hidden email]>: Dec 14 08:34AM +1000
Hello ST Community!
I've been given the task to evaluate a team member's suggestion of an
automated testing tool that we will choose, invest and move forward with.
This is a big and long lasting decision and as such I would like any and
all suggestions from this community, who no doubt have faced similar
testing requirements of your enterprise software products.
Our Product Overview:
- A very large ERP system
- Most business logic contained in the thick *Windows *client
application.
- Operational Context:
- Windows (ST) client
- Linux (Centos) server (primarily batch processing only)
- PostgreSQL database
- Dev Environment: VA Smalltalk v9.1 (will upgrade to 9.2.x in Q1 2021
probably)
- *Key Goal*:
- Testing of the many, many GUI functions
- Pretty typical ERP functionality - Typical CRUD activities,
but the ability to test our more advanced, complicated interaction
screens
Currently we implement https://github.com/instantiations/ci-examples-vast
CI building with Jenkins.
Thanks in advance for any insights.
Regards, Matthew.
|
Mariano Martinez Peck <[hidden email]>: Dec 14 10:53AM -0300
Hi Matthew,
First, thanks for sharing that original code from ci-examples-vast! It was
very helpful and some customers had already benefited from it.
For the Smalltalk thick GUI client aspect, I would like to share what we
use internally in Instantiations to unit test GUIs:
https://github.com/vast-community-hub/sunit-extensions-vast
It's a little project but we removed our internal dependencies and make it
open-source in Github plus some documentation and examples. As said, it's a
very simple framework but it might be a good start. Of course, you are
welcome to contribute if it meets your needs :)
For running server-side tests, we have an internal little tool which is a
kind of headless SUnit runner. It just runs the tests and outputs the
results on the stdout. Then from our CI we grep based on those printed
results. If you are interested in this, I can try to polish it a bit,
remove possible internal dependencies and add it into ci-examples-vast
repo. That being said, I think we have customers which have gone further
and have better solutions. For example, rather than printing some custom
results into the stdout, they printed the JUnit XML expected by most CIs so
that you can then visualize the results within CI. We have had other
customers inquiring about this....so I think this may be a great
opportunity to join forces on Github. I think ci-examples-vast could be a
good way to start with it.
Best,
Mariano
On Sun, Dec 13, 2020 at 7:34 PM Matthew Boulter <[hidden email]>
wrote:
--
Mariano Martinez Peck
Software Engineer, Instantiations Inc.
Email: [hidden email]
Twitter: https://twitter.com/MartinezPeck
LinkedIn: www.linkedin.com/in/mariano-martinez-peck
<https://www.linkedin.com/in/mariano-mart%C3%ADnez-peck/>
Blog: https://marianopeck.wordpress.com/
|
You received this digest because you're subscribed to updates for this group. You can change your settings on the group membership page.
To unsubscribe from this group and stop receiving emails from it send an email to [hidden email].
|
--
---------
Matty
---------
--
You received this message because you are subscribed to the Google Groups "VA Smalltalk" group.
To unsubscribe from this group and stop receiving emails from it, send an email to
[hidden email].
To view this discussion on the web visit
https://groups.google.com/d/msgid/va-smalltalk/CAHC26T4GKMJkBgfjcWLJ7G3h2TQhj_oT%3DZOXanksW9Q_OtJDyg%40mail.gmail.com.