Tag: software testing

  • QA – Why Bother?

    QA – Why Bother?

    If you get the feeling that this is a question you encounter a lot, you are not alone. We get a lot of calls and emails asking us to explain this question. Of course, the answer is dependent on who is asking the question.

    People want to know why they should consider it and, more importantly, the benefit. Sometimes they are simply looking for something to carry back to the project or department.

    In order to answer the question, we need to appeal to the broader costs calculated over multiple projects.

    We define QA as Process Improvement and processes generally apply to multiple projects (or at least can be applied to multiple projects). Hence the need for long term measurements and metrics.

    The simplest example is Defect Management. A simple process to ensure all defects are addressed and handled only once by each member of the team would remove a lot of redundancy.

    Other examples include Testcase creation; Testing; Summary reporting; Development; and Requirements management.  With the advent of AI, this has become much more critical to get right. The chances of going off track at high speed have increased substantially.

  • Are you satisfied with your testing?

    Are you satisfied with your testing?

    Most people we speak to answer that question with a resounding NO; they are not satisfied with their testing. The answer may vary from stakeholder to stakeholder, and the intensity and source of the dissatisfaction may be different.  However, doing something about it is a different matter.    The most recent of many examples involved someone who complained about the testing and was promptly put in charge.  Not the result they were aiming for at the time!

    Solving the dissatisfaction is very difficult. Process improvement is resisted on many levels and there is usually a large number of potential improvements that may impact the perception.  The starting point is with a stakeholder survey and process assessment; this gives the basis for supportable incremental changes to improve satisfaction. 

    Take a look at Assessments for a starting point on what to include.

  • TASSQ 2025 – 2026 Schedule

    TASSQ 2025 – 2026 Schedule

    TASSQ is pleased to announce their September 2025 through February 2026 schedule.

  • Isn’t there a better way to Test?

    Isn’t there a better way to Test?

    This is a question that gets asked very frequently especially at the end of projects that have not gone well.

    While there are many people who will advocate one methodology or another for testing and tell you their way is the only way, every method must adapt to the project at hand, the risks and the desired outcomes.  There is no one way to test but there are ways to improve the testing.

    The first need is time at the end of the project to evaluate what went right and wrong before people forget.

    Some common concerns:

    1. Too much documentation:  It is acceptable to reduce documentation if the same testers will be available for the next project but not so effective if the next project will be staffed with new people unfamiliar with the project.
    2. Too little documentation:  This can be solved but it takes time or can be fed through AI to generate the complete documentation.  Always review anything produced by AI.
    3. Too much repetition:  This is a process error that can be solved by RCA and then implemented but is not likely to have much effect for at least a project or two.
    4. Unused testcases:  This is a classification issue that can be solved with AI at this point.
    5. Too many escaped defects:  Again RCA with the aid of AI can address this but it is too late to implement the solution for the existing project.
  • Is your testing Ad hoc?

    Is your testing Ad hoc?

    While most people won’t come out and say that their testing is Ad Hoc, it can usually be inferred from some of the following comments:

    1. We keep redoing things.

    2. We seem to lose everything with every iteration.

    3. We keep re-inventing the wheel.

    4. We have thousands of testcases and most of them have not been looked at in years.

    5. We miss things in every release even though we saw them in the past.

    6. We keep solving the same problems in development.

    And on the list goes.

    If you feel you are stuck in this rut, it is time to break out

    .

    But that requires a fresh look at the following items:

    * Current assets

    * Current processes

    * Missing pieces

    * Left over items and problems. Breaking out of Ad Hoc testing is very difficult. Process improvement is resisted on many levels.

  • What do Test Managers do in a project?

    What do Test Managers do in a project?

    There would be an obvious answer to that question if one replaced the word Test with the word Project. So, if we transfer in reverse the answer is the same. Since we had to answer this question …

    Please take a look at Case Study 11: https://nvp.ca/wp-content/uploads/2025/05/Case Study 12.pdf  for an answer to this question.

  • Resources

    Resources

    Resources are always a problem in projects. You may have too many at one point, too few at another point and the skills may be mismatched even if the number matches to what you estimated. Issue The client was expanding rapidly in a new industry. Two large organizations in a related industry had already started divisions to address this market but we were dealing with a new and much younger company.

    Please take a look at Case Study 9: https://nvp.ca/wp-content/uploads/2021/06/Case-Study-9-Resources.pdf to see how the process was managed.

  • Designing Testing

    Designing Testing

    Frequently organizations grow concerned about their Quality Assurance Processes. They are not sure if they are using the best processes for their testing. Everything has been internally built with little input from outside the organization. Over time the isolation may lead to inefficient processes. There may not be an awareness of what has changed and how it might impact their work habits.

    Please take a look at Case Study 7: https://nvp.ca/wp-content/uploads/2021/06/Case-Study-7-Consulting.pdf to see how the process was redesigned.