Cinematic rendering

This article is about data visualization technique. For cinematographic adaptation, see Film adaptation.

Comparison of whole-body CT scan visualizations: volume rendering is on the left, cinematic rendering on the right

In medical diagnostics, cinematic rendering is an image processing technique applied to create three-dimensional, photorealistic images of cross-sectional data, such as computed-tomography, or magnetic resonance imaging (MRI)/ Cinematic rendering is an alternative to the volume rendering, the name was inspired by the modern computer animation techniques that allow studios, like Pixar, to create realistically looking objects.

The steps used to produce the cinematic rendering are similar to the ones for the volume rendering:

• the magnitude (gray) value of each voxel (3-dimensional pixel) produced during the scan is mapped into the color and opacity pair based on what structures need to be highlighted or hidden;
• ray casting used for volume rendering, where each pixel in the 2D image is formed by a single ray of light, is replaced by path tracing with a global illumination model that integrates over all the illuminance arriving to every single point on the surface of an object.

Since the number of light paths in this technique is nearly unlimited, a finite randomized selection of the paths and importance sampling are used to imitate the real-life propagation of light, scattering, and reflection using models build on real-life data. The result is a photorealistic image.

Applications in medical education

Cinematic rendering is not approved for the clinical use.

Cinematic rendering technology is currently applied as a virtual educational method at specialized facilities, institutions, and centers to teach the subject of anatomy to both medical students and other healthcare professions, for example, at the JKU Faculty of Medicine at the Johannes Kepler University Linz, and for post-graduate programs in clinical areas as well as medical assistant professions.

Surgical applications

A 2026 review described cinematic rendering in CT angiography as useful for visualizing complex vascular anatomy and identified preoperative planning as a potential application area. In a 2019 preclinical randomized crossover study in hepatopancreatobiliary surgery, surgeons using cinematic rendering answered anatomy questions more correctly and more quickly than with conventional CT.

See also

• German Future Prize 2017 – Team 1

Further reading

• Eid, Marwen; De Cecco, Carlo N.; Nance Jr, John W.; Caruso, Damiano; Albrecht, Moritz H; Spandorfer, Adam J; De Santis, Domenico; Varga-Szemes, Akos; Schoepf, U Joseph (2017-05-15). "Cinematic Rendering in CT: A Novel, Lifelike 3D Visualization Technique". American Journal of Roentgenology. 209 (2): 370–379. doi:10.2214/AJR.17.17850. PMID 28504564. Retrieved 2024-03-24. Quote: "The purpose of this article is to present an overview of cinematic rendering, illustrating its potential advantages and applications. Conclusion: Volume-rendered reconstruction, obtaining 3D visualization from original CT datasets, is increasingly used by physicians and medical educators in various clinical and educational scenarios. Cinematic rendering is a novel 3D rendering algorithm that simulates the propagation and interaction of light rays as they pass through the volumetric data, showing a more photorealistic representation of 3D images than achieved with standard volume rendering. ..."
• Kun, Li; Ruiying, Yan; Ma, Huan; Zhang, Da-Fu; Ding, Yingying; Li, Zhen-Hui (2019-01-15). "Value of the Cinematic Rendering from Volumetric Computed Tomography Data in Evaluating the Relationship Between Deep Soft Tissue Sarcomas of the Extremities and Adjacent Major Vessels: A Preliminary Study". Journal of Computer Assisted Tomography. 43 (3): 386–391. doi:10.1097/RCT.0000000000000852. PMC 6530969. PMID 30920424. Quote: "Abstract: Objective:The aim of the study was to assess the value of cinematic rendering (CR) from volumetric computed tomography data in evaluating the relationship between deep soft tissue sarcomas (STSs) of the extremities and the adjacent major vessels..."
• Moser, Susanne Elisabeth (2017-09-04). "Cinematic Rendering: Körperkino für das Tumorboard". deutsches Ärzteblatt (in German). 114: 35–36. Retrieved 2024-03-24., Citation in German Language: "...Cinematic Rendering: technologischer Hintergrund. Cinematic Rendering – deutsch etwa: filmische Bildsynthese – beschreibt ein 3-D-Visualisierungsverfahren. Die Technologie stammt aus der Filmbranche, wo sie unter anderem digital animierte Figuren realitätsnah in von Menschen dargestellte Filmszenen integriert – beispielsweise „Gollum“ in „Herr der Ringe“. Aus konventionellen 2-D-CT- oder MRT-DICOM-Daten errechnet die Cinematic-Rendering-Software dreidimensionale Strukturen. ..."
• Binder, Johannes S.; Scholz, Michael; Ellmann, Stepan; Uder, Michael; Grützmann, Robert; Weber, Georg F.; Krautz, Christian (2020-06-02). "Cinematic Rendering in Anatomy: A Crossover Study Comparing a Novel 3D Reconstruction Technique to Conventional Computed Tomography". Anatomical Sciences Education. 14 (3): 22–32. doi:10.1002/ase.1989. eISSN 1935-9780. ISSN 1935-9772. PMID 32521121. Quote: "Abstract: Integration of medical imaging into preclinical anatomy courses is already underway in many medical schools. However, interpretation of two-dimensional grayscale images is dif-ficult and conventional volume rendering techniques provide only images of limited quality. In this regard, a more photorealistic visualization provided by Cinematic Rendering (CR) may be more suitable for anatomical education. ...
• Niedermair, Julian F.; Antipova, Veronica; Manhal, Simone; Siwetz, Martin; Wimmer-Röll, Monika; Hammer, Nils; Fellner, Franz A. (2022-11-23). "On the added benefit of virtual anatomy for dissection-based skills". Anatomical Sciences Education. 16 (3): 439–451. doi:10.1002/ase.2234. eISSN 1935-9780. ISSN 1935-9772. PMID 36453060. Retrieved 2024-03-24. Quote: "Technological approaches deploying three-dimensional visualization to integrate virtual anatomy are increasingly used to provide medical students with state-of-the-art teaching. It is unclear to date to which extent virtual anatomy may help replace the dissection course. Medical students of Johannes Kepler University attend both a dissection and a virtual anatomy course. This virtual anatomy course is based on Cinematic Rendering and radiological imaging and teaches anatomy and pathology.