Deep-Tech 3D Vision

Designing for Precision: Perfecting 3D Imagery Across Diverse Screen Sizes

While there were many obstacles, the biggest design challenge ICS faced was ensuring that VISIE’s ultra-high-definition 3D images would look perfect on both small, low-resolution medical device screens and large 50-inch 4K TVs. 

Our design team tackled this Herculean task by developing a UI that would seamlessly display complex 3D point clouds with pixel-perfect clarity, even when viewed on drastically different screen sizes. This required careful attention to scaling, resolution and layout to ensure that the visual fidelity would remain uncompromised, even when transitioning between different screen sizes.

Innovative Solutions: Real-Time 3D Scanning and CAAT Integration

While ensuring image clarity was a significant design hurdle, another pressing challenge came when VISIE developed its Continuous Anatomic Auto Tracking (CAAT) technology — a groundbreaking feature that allows dynamic tracking of anatomy without the need for re-calibration. This innovation required that ICS completely overhaul the tech stack to support the streaming and visualization of 3D scans in real-time.

Specifically, we adjusted our approach to rendering 3D scans, leveraging PySide6 and Qt 6.5 to create a bridge between VISIE’s backend and the QML interface to allow for dynamic, real-time visualizations. Additionally, we updated the UI to support the new CAAT-enabled system; developed scalable network architecture to handle 3D point cloud data and live transforms; and created custom QML components for seamless data rendering.

Raising the Bar: Redefining Knee Surgery Visualization with CAAT

Impressed with the original demo ICS created, VISIE again leaned on us when they were ready to publicly unveil CAAT. Their ask: two additional demos, this time specifically geared toward knee replacement surgery. One demo would show convincingly how CAAT can be used to calculate gapping between a patient’s femur and tibia when the knee is manipulated into various positions during surgery, while the other demo would present how CAAT analyzes the movement of the femur to calculate the center of the leg movement at the hip. The goal was to highlight the tracking capabilities of the CAAT technology in a most compelling way, and spotlight its advanced features in real-time.

The Result: Showcasing the Full Potential of VISIE’s Transformative Technology

These demos did more than explain the technology — they brought VISIE’s CAAT to life with an experience that has enthralled prospective medical device partners, helping solidify VISIE’s position as a trailblazer in robotic surgery. Working on an accelerated timeline, our team helped VISIE deliver a series of visually stunning demos that persuasively demonstrates the full potential of the transformative technology.