Operational Assurance

A Method For Measuring and Monitoring System Quality

Call us for a free consultation. Choose QA as a capability today.

Operational Assurance [OA]

How much confidence do you have that your systems will perform according to your expectations?

Operational Assurance is the discipline by which software and systems are measured and monitored for quality and performance. Using well defined metrics and proofs, quality can be monitored throughout the dependency circuit of a system. OA starts with a focus and builds down from there, exploring the components and systems involved with that focus. Each component in that circuit can be given a confidence metric that relays up to the focus giving it a real and measurable metric of quality.

Writing software for over 30 years

Capturing the utility of a system

Software systems are designed around capabilities that are the focus of the system.

Human factors, automation factors, usability, these are all controllers of systems that focus on sets of capabilities. Starting with that focus and decomposing into components, gives rise to the OA Circuit.

How many times have you been in a meeting and someone said "I didn't know my change would affect that capability?"

Millions of users served and validated.

Quality travels like lightning through a system

Change one component and that change ripples up to the focus

Quantifying isn't enough for metrics, they need to be proven. OA defines proofs for metrics to verify the provenance of reported quality metrics.

First principles and a strong commitment to quality

Measurability is the problem to solve.

Cross discipline experience creates the languae of cooperation.

Systems are not just software, they are hardware, cryptographic elements, humans, and AI. The numbers are the key to measuring software and systems quality and raising visibility. Being able to monitor the metrics and prove their provenance is the cornerstone of success in [OA].

Operators should be foremost in the design methodology

A plan is the guide through the weeds

Would you hike without a map?

No plan can survive contact with a contested arena, but without a plan, no system can survive the rigors of user interactions. The OA Plan is the collection of the OA artifacts, the Focus, Metrics, Circuits, and the Arena. Documentation is helpful, but a living document that responds to operator interaction, now that's a plan that can survive.

Passionate About Problem Solving, Not Profit Seeking

Many platforms today

always contested and dynamic

The arena is where the system meets the operator. Whether automated or human, the operator will put the system through a rigor that typically defies prediction. Having a complete decomposition of focus capabilities, the system can adequately quantify operator interactions and convey defects to software.

Hope is never a plan
In 2000 Jacob Anderson and his colleagues from PRAJA formed a group named QA Commandos. We were passionate about improving quality and testing in software. Unfortunately, software projects continue to view QA as a cost center that acts like a cash buffer when the project runs lean. QA is a measurable concept that has real life metrics and real impact on systems. The advent of cyber crime at scale is a reminder that QA is not a cost center, it's a valuable capability in any system.