Automated Testing tools suggestions?

Hello ST Community!

I've been given the task to evaluate a team member's suggestion of an automated testing tool that we will choose, invest and move forward with.

This is a big and long lasting decision and as such I would like any and all suggestions from this community, who no doubt have faced similar testing requirements of your enterprise software products.

Our Product Overview:

• A very large ERP system
• Most business logic contained in the thick Windows client application.
• Operational Context:
• Windows (ST) client
• Linux (Centos) server (primarily batch processing only)
• PostgreSQL database
• Dev Environment: VA Smalltalk v9.1 (will upgrade to 9.2.x in Q1 2021 probably)
  
  
• Key Goal:  
• Testing of the many, many GUI functions
• Pretty typical ERP functionality - Typical CRUD activities,
  but the ability to test our more advanced, complicated interaction screens

Currently we implement https://github.com/instantiations/ci-examples-vast CI building with Jenkins.

Thanks in advance for any insights.

Regards, Matthew.

--
You received this message because you are subscribed to the Google Groups "VA Smalltalk" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/va-smalltalk/CAHC26T7KUodSap3xDL1G7JCbvfVadiJUjicd9OWnxGprYu%2BodA%40mail.gmail.com.

Hi Matthew,

First, thanks for sharing that original code from ci-examples-vast! It was very helpful and some customers had already benefited from it. 

For the Smalltalk thick GUI client aspect, I would like to share what we use internally in Instantiations to unit test GUIs: https://github.com/vast-community-hub/sunit-extensions-vast

It's a little project but we removed our internal dependencies and make it open-source in Github plus some documentation and examples. As said, it's a very simple framework but it might be a good start. Of course, you are welcome to contribute if it meets your needs :)

For running server-side tests, we have an internal little tool which is a kind of headless SUnit runner. It just runs the tests and outputs the results on the stdout. Then from our CI we grep based on those printed results. If you are interested in this, I can try to polish it a bit, remove possible internal dependencies and add it into ci-examples-vast repo. That being said, I think we have customers which have gone further and have better solutions. For example, rather than printing some custom results into the stdout, they printed the JUnit XML expected by most CIs so that you can then visualize the results within CI. We have had other customers inquiring about this....so I think this may be a great opportunity to join forces on Github. I think ci-examples-vast could be a good way to start with it.

Best,

Mariano

On Sun, Dec 13, 2020 at 7:34 PM Matthew Boulter <[hidden email]> wrote:

Hello ST Community!

I've been given the task to evaluate a team member's suggestion of an automated testing tool that we will choose, invest and move forward with.

This is a big and long lasting decision and as such I would like any and all suggestions from this community, who no doubt have faced similar testing requirements of your enterprise software products.

Our Product Overview:

• A very large ERP system
• Most business logic contained in the thick Windows client application.
• Operational Context:
• Windows (ST) client
• Linux (Centos) server (primarily batch processing only)
• PostgreSQL database
• Dev Environment: VA Smalltalk v9.1 (will upgrade to 9.2.x in Q1 2021 probably)
  
  
• Key Goal:  
• Testing of the many, many GUI functions
• Pretty typical ERP functionality - Typical CRUD activities,
  but the ability to test our more advanced, complicated interaction screens

Currently we implement https://github.com/instantiations/ci-examples-vast CI building with Jenkins.

Thanks in advance for any insights.

Regards, Matthew.

--
You received this message because you are subscribed to the Google Groups "VA Smalltalk" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/va-smalltalk/CAHC26T7KUodSap3xDL1G7JCbvfVadiJUjicd9OWnxGprYu%2BodA%40mail.gmail.com.

--

Mariano Martinez Peck
Software Engineer, Instantiations Inc.

Email: [hidden email]

Twitter: https://twitter.com/MartinezPeck

LinkedIn: www.linkedin.com/in/mariano-martinez-peck

Blog: https://marianopeck.wordpress.com/