ad
ad
Topview AI logo

StructSure, AI QA

Science & Technology

Introduction

Hello everyone, my name is Jeff Mannion, and I am the Program Director here at Standard Imaging. I am also the Product Manager for StructSure AI QA. StructSure AI QA is an exciting new product and it's the first Quality Assurance (QA) software for auto-segmentation (auto-seg) engines. It performs its functions by comparing your auto-seg contours to your own gold standard with a high degree of resolution and accuracy.

Introduction

When AI-based auto-segmentation first emerged on the market about 10 years ago, it wasn't very accurate, and physicists were hesitant to adopt it. However, significant improvements have been made since then, and auto-segmentation technology now offers highly accurate work, which is rapidly gaining acceptance across the industry. As physicists and physicians consider adopting this new technology, they are faced with important questions about how to perform quality assurance and acceptance testing. This is where StructSure AI QA comes into play.

Key Features and Benefits

StructSure AI QA provides three main benefits:

  1. Pre-purchase Evaluation: Use StructSure AI QA before deciding which auto-seg engine to buy. Ideally, you would obtain a temporary license from your auto-seg vendor to test the software. StructSure AI QA is the perfect tool to organize and produce objective evidence, helping you determine which model performs best, whether it's from Electra, Varian, or any other third-party companies such as Limbus AI.

  2. Commissioning and Acceptance Testing: Before using the auto-seg engine clinically, use StructSure AI QA for commissioning or acceptance testing. This allows you to determine which areas you trust and which you don’t, ensuring efficiency and objectivity in your assessments.

  3. Continuous Validation: As new models are produced by vendors, use StructSure AI QA continually to verify performance. AI auto-seg engines are evolving like dose engines, with new versions and updates emerging regularly. StructSure AI QA helps you verify whether new releases perform as promised without introducing new issues.

Detailed Features and Walkthrough

Let's dive into a quick mini-tour of the software.

Loading Data

The application is straightforward—a few clicks, and you’re ready to go. First, you select your CT set and load the images. Next, select your primary structure set, which serves as your gold standard for comparison. Then, select the secondary file, which could be from an auto-seg engine or another source.

Analysis and Metrics

The main page provides an axial plane view, navigation tools, and a table of regions of interest. You can turn regions on or off to reduce clutter. Metrics like volume, dice coefficient, max difference, and structure score are calculated. These metrics provide valuable insights into the performance of auto-seg engines.

Volume Distance Histogram

The histogram shows incremental distances from the common volume, highlighting under and over-segmented areas. Reports can be generated to document findings.

Batch Analysis

For handling multiple gold standards, a batch analysis feature allows you to load and analyze multiple datasets simultaneously, producing detailed reports in CSV format.

Conclusion

StructSure AI QA is a groundbreaking resource for ensuring the quality of AI-based auto-segmentation engines, aiding in pre-purchase evaluations, acceptance testing, and continuous validation. Thank you for your time, and I hope to hear from you soon.

Keywords

  • AI-based auto-segmentation
  • Quality assurance
  • StructSure AI QA
  • Acceptance testing
  • Commissioning
  • Continuous validation

FAQs

Q1: What is StructSure AI QA used for? A1: StructSure AI QA is used for quality assurance of auto-segmentation engines by comparing auto-seg contours to your gold standard with high accuracy and resolution.

Q2: How does StructSure AI QA help in the decision-making process before buying an auto-seg engine? A2: It helps by providing objective evidence of the performance of different auto-seg models, enabling you to make informed decisions.

Q3: Can StructSure AI QA be used for purposes other than auto-seg engines? A3: Yes, it can compare any segmentation results, whether from an auto-seg engine, a dosimetrist, or another physicist.

Q4: How does StructSure AI QA handle new model updates from vendors? A4: It offers continuous validation, allowing you to verify if new updates meet performance standards and do not introduce new issues.

Q5: What types of reports can StructSure AI QA generate? A5: It can generate detailed reports with thumbnails of each region of interest, as well as simpler reports that show essential data and metrics.