{"id":3542,"date":"2023-12-01T17:08:18","date_gmt":"2023-12-01T22:08:18","guid":{"rendered":"https:\/\/my.dev.vanderbilt.edu\/masi\/?p=3542"},"modified":"2024-04-24T16:38:50","modified_gmt":"2024-04-24T21:38:50","slug":"inter-vendor-harmonization-of-ct-reconstruction-kernels-using-unpaired-image-translation","status":"publish","type":"post","link":"https:\/\/my.dev.vanderbilt.edu\/masi\/2023\/12\/inter-vendor-harmonization-of-ct-reconstruction-kernels-using-unpaired-image-translation\/","title":{"rendered":"Inter-vendor harmonization of CT reconstruction kernels using unpaired image translation"},"content":{"rendered":"<p><span class=\"ArticleContentText\">Aravind R. Krishnan<\/span>,\u00a0<span class=\"ArticleContentText\">Kaiwen Xu<\/span>,\u00a0<a class=\"ArticleContentText\" href=\"https:\/\/www.spiedigitallibrary.org\/profile\/Thomas.Li-4416558\">Thomas Li<\/a>,\u00a0<a class=\"ArticleContentText\" href=\"https:\/\/www.spiedigitallibrary.org\/profile\/Chenyu.Gao-4356817\">Chenyu Gao<\/a>,\u00a0<span class=\"ArticleContentText\">Lucas W. Remedios<\/span>,\u00a0<a class=\"ArticleContentText\" href=\"https:\/\/www.spiedigitallibrary.org\/profile\/Praitayini.Kanakaraj-4342905\">Praitayini Kanakaraj<\/a>,\u00a0<a class=\"ArticleContentText\" href=\"https:\/\/www.spiedigitallibrary.org\/profile\/Ho-Hin.Lee-4213194\">Ho Hin Lee<\/a>,\u00a0<a class=\"ArticleContentText\" href=\"https:\/\/www.spiedigitallibrary.org\/profile\/Shunxing.Bao-253756\">Shunxing Bao<\/a>,\u00a0<a class=\"ArticleContentText\" href=\"https:\/\/www.spiedigitallibrary.org\/profile\/Kim.Sandler-4222278\">Kim L. Sandler<\/a>,\u00a0<a class=\"ArticleContentText\" href=\"https:\/\/www.spiedigitallibrary.org\/profile\/Fabien.Maldonado-4178612\">Fabien Maldonado<\/a>,\u00a0<a class=\"ArticleContentText\" href=\"https:\/\/www.spiedigitallibrary.org\/profile\/Ivana.Isgum-111855\">Ivana I\u0161gum<\/a>,\u00a0and\u00a0<a class=\"ArticleContentText\" href=\"https:\/\/www.spiedigitallibrary.org\/profile\/Bennett.Landman\">Bennett A. Landman<\/a>\u00a0&#8220;Inter-vendor harmonization of CT reconstruction kernels using unpaired image translation&#8221;, Proc. SPIE 12926, Medical Imaging 2024: Image Processing, 129261D (2 April 2024);\u00a0<a class=\"ArticleContentSignText\" href=\"https:\/\/doi.org\/10.1117\/12.3006608\" target=\"_blank\">https:\/\/doi.org\/10.1117\/12.3006608<\/a><\/p>\n<h2>Abstract<\/h2>\n<p>The reconstruction kernel in computed tomography (CT) generation determines the texture of the image. Consistency in reconstruction kernels is important as the underlying CT texture can impact measurements during quantitative image analysis. Harmonization (i.e., kernel conversion) minimizes differences in measurements due to inconsistent reconstruction kernels. Existing methods investigate harmonization of CT scans in single or multiple manufacturers. However, these methods require paired scans of hard and soft reconstruction kernels that are spatially and anatomically aligned. Additionally, a large number of models need to be trained across different kernel pairs within manufacturers. In this study, we adopt an unpaired image translation approach to investigate harmonization between and across reconstruction kernels from different manufacturers by constructing a multipath cycle generative adversarial network (GAN). We use hard and soft reconstruction kernels from the Siemens and GE vendors from the National Lung Screening trial dataset. We use 50 scans from each reconstruction kernel and train a multipath cycle GAN. To evaluate the effect of harmonization on the reconstruction kernels, we harmonize 50 scans each from Siemens hard kernel, GE soft kernel and GE hard kernel to a reference Siemens soft kernel (B30f) and evaluate percent emphysema. We fit a linear model by considering the age, smoking status, sex and vendor and perform an analysis of variance (ANOVA) on the emphysema scores. Our approach minimizes differences in emphysema measurement and highlights the impact of age, sex, smoking status and vendor on emphysema quantification.<\/p>\n<figure id=\"attachment_3563\" aria-describedby=\"caption-attachment-3563\" style=\"width: 650px\" class=\"wp-caption alignnone\"><img loading=\"lazy\" decoding=\"async\" class=\"size-large wp-image-3563\" src=\"https:\/\/my.dev.vanderbilt.edu\/masi\/wp-content\/uploads\/sites\/2304\n2661\/2023\/12\/Problem_figure-1-650x237.png\" alt=\"Differences in reconstruction kernels can be minimized by harmonizing to a reference standard. Harmonizing between paired kernels (left) has been explored due to the presence of one-to-one pixel correspondence between scans. However, unpaired kernels (right) create additional difficulties due to the difference in the anatomical alignment of scans obtained for different subjects from different vendors.\" width=\"650\" height=\"237\" \/><figcaption id=\"caption-attachment-3563\" class=\"wp-caption-text\"><strong>Fig 1.<\/strong> Differences in reconstruction kernels can be minimized by harmonizing to a reference standard. Harmonizing between paired kernels (left) has been explored due to the presence of one-to-one pixel correspondence between scans. However, unpaired kernels (right) create additional difficulties due to the difference in the anatomical alignment of scans obtained for different subjects from different vendors.<\/figcaption><\/figure>\n<p>&nbsp;<\/p>\n<figure id=\"attachment_3564\" aria-describedby=\"caption-attachment-3564\" style=\"width: 650px\" class=\"wp-caption alignnone\"><img loading=\"lazy\" decoding=\"async\" class=\"size-large wp-image-3564\" src=\"https:\/\/my.dev.vanderbilt.edu\/masi\/wp-content\/uploads\/sites\/2304\n2661\/2023\/12\/Idea_figure-1-650x315.png\" alt=\"Kernel harmonization across four different reconstruction kernels can be performed using multiple cycle GANs operating across multiple paths. For a given source domain, a latent space is obtained from a source encoder that can be decoded by the corresponding target decoders. This approach enables harmonization between kernels from the same vendor and across kernels from different vendors using a high dimensional shared latent space (denoted as \u201cL\u201d).\" width=\"650\" height=\"315\" srcset=\"https:\/\/cdn-dev.vanderbilt.edu\/t2-my-dev\/wp-content\/uploads\/sites\/2304\/2023\/12\/Idea_figure-1-650x315.png 650w, https:\/\/cdn-dev.vanderbilt.edu\/t2-my-dev\/wp-content\/uploads\/sites\/2304\/2023\/12\/Idea_figure-1-300x145.png 300w, https:\/\/cdn-dev.vanderbilt.edu\/t2-my-dev\/wp-content\/uploads\/sites\/2304\/2023\/12\/Idea_figure-1-768x372.png 768w, https:\/\/cdn-dev.vanderbilt.edu\/t2-my-dev\/wp-content\/uploads\/sites\/2304\/2023\/12\/Idea_figure-1.png 1300w\" sizes=\"auto, (max-width: 650px) 100vw, 650px\" \/><figcaption id=\"caption-attachment-3564\" class=\"wp-caption-text\"><strong>Fig 2.<\/strong> Kernel harmonization across four different reconstruction kernels can be performed using multiple cycle GANs operating across multiple paths. For a given source domain, a latent space is obtained from a source encoder that can be decoded by the corresponding target decoders. This approach enables harmonization between kernels from the same vendor and across kernels from different vendors using a high dimensional shared latent space (denoted as \u201cL\u201d).<\/figcaption><\/figure>\n<p>&nbsp;<\/p>\n<figure id=\"attachment_3565\" aria-describedby=\"caption-attachment-3565\" style=\"width: 650px\" class=\"wp-caption alignnone\"><img loading=\"lazy\" decoding=\"async\" class=\"size-large wp-image-3565\" src=\"https:\/\/my.dev.vanderbilt.edu\/masi\/wp-content\/uploads\/sites\/2304\n2661\/2023\/12\/Method_figure-1-650x512.png\" alt=\"A cycle GAN consists of a forward and backward path. In the forward path, the source encoder and target decoder combine together to form a U-Net that generates a synthetic image with the style of the target domain. The synthetic image and the real target domain image are passed as inputs to a discriminator DB which distinguishes whether the generated image is real or fake. In the backward path, a synthetic image with the style of the source domain is generated which is fed to discriminator DA along with the source domain image.\" width=\"650\" height=\"512\" srcset=\"https:\/\/cdn-dev.vanderbilt.edu\/t2-my-dev\/wp-content\/uploads\/sites\/2304\/2023\/12\/Method_figure-1-650x512.png 650w, https:\/\/cdn-dev.vanderbilt.edu\/t2-my-dev\/wp-content\/uploads\/sites\/2304\/2023\/12\/Method_figure-1-300x236.png 300w, https:\/\/cdn-dev.vanderbilt.edu\/t2-my-dev\/wp-content\/uploads\/sites\/2304\/2023\/12\/Method_figure-1-768x605.png 768w, https:\/\/cdn-dev.vanderbilt.edu\/t2-my-dev\/wp-content\/uploads\/sites\/2304\/2023\/12\/Method_figure-1.png 1300w\" sizes=\"auto, (max-width: 650px) 100vw, 650px\" \/><figcaption id=\"caption-attachment-3565\" class=\"wp-caption-text\"><strong>Fig 3.<\/strong> A cycle GAN consists of a forward and backward path. In the forward path, the source encoder and target decoder combine together to form a U-Net that generates a synthetic image with the style of the target domain. The synthetic image and the real target domain image are passed as inputs to a discriminator DB which distinguishes whether the generated image is real or fake. In the backward path, a synthetic image with the style of the source domain is generated which is fed to discriminator DA along with the source domain image.<\/figcaption><\/figure>\n<p>&nbsp;<\/p>\n<figure id=\"attachment_3566\" aria-describedby=\"caption-attachment-3566\" style=\"width: 650px\" class=\"wp-caption alignnone\"><img loading=\"lazy\" decoding=\"async\" class=\"size-large wp-image-3566\" src=\"https:\/\/my.dev.vanderbilt.edu\/masi\/wp-content\/uploads\/sites\/2304\n2661\/2023\/12\/Qualitative_figure-1-650x394.png\" alt=\"The noise in reconstruction kernels creates differences in the texture of underlying anatomical structures. The B50f and GE BONE hard kernels are noisy while the B30f and GE STD kernels are less noisy. Although the B30f and GE STD are soft kernels, their noise levels are different as these kernels belong to different vendors. Standardizing the GE soft kernel, GE BONE kernel and the B50f kernel to the reference B30f kernel (row 2) ensures consistent texture across all kernels for quantitative image analysis.\" width=\"650\" height=\"394\" srcset=\"https:\/\/cdn-dev.vanderbilt.edu\/t2-my-dev\/wp-content\/uploads\/sites\/2304\/2023\/12\/Qualitative_figure-1-650x394.png 650w, https:\/\/cdn-dev.vanderbilt.edu\/t2-my-dev\/wp-content\/uploads\/sites\/2304\/2023\/12\/Qualitative_figure-1-300x182.png 300w, https:\/\/cdn-dev.vanderbilt.edu\/t2-my-dev\/wp-content\/uploads\/sites\/2304\/2023\/12\/Qualitative_figure-1-768x466.png 768w, https:\/\/cdn-dev.vanderbilt.edu\/t2-my-dev\/wp-content\/uploads\/sites\/2304\/2023\/12\/Qualitative_figure-1.png 1300w\" sizes=\"auto, (max-width: 650px) 100vw, 650px\" \/><figcaption id=\"caption-attachment-3566\" class=\"wp-caption-text\"><strong>Fig 4.<\/strong> The noise in reconstruction kernels creates differences in the texture of underlying anatomical structures. The B50f and GE BONE hard kernels are noisy while the B30f and GE STD kernels are less noisy. Although the B30f and GE STD are soft kernels, their noise levels are different as these kernels belong to different vendors. Standardizing the GE soft kernel, GE BONE kernel and the B50f kernel to the reference B30f kernel (row 2) ensures consistent texture across all kernels for quantitative image analysis.<\/figcaption><\/figure>\n<p>&nbsp;<\/p>\n<figure id=\"attachment_3567\" aria-describedby=\"caption-attachment-3567\" style=\"width: 650px\" class=\"wp-caption alignnone\"><img loading=\"lazy\" decoding=\"async\" class=\"size-large wp-image-3567\" src=\"https:\/\/my.dev.vanderbilt.edu\/masi\/wp-content\/uploads\/sites\/2304\n2661\/2023\/12\/Quantitative-1-650x315.png\" alt=\"Percentage emphysema scores are affected by the reconstruction kernel in a given vendor, resulting in differences in measurements. Hard kernels overestimate emphysema quantification. Harmonizing kernels from different vendors to a reference soft kernel minimizes measurement errors, leading to a consensus among vendors for emphysema measurement.\" width=\"650\" height=\"315\" srcset=\"https:\/\/cdn-dev.vanderbilt.edu\/t2-my-dev\/wp-content\/uploads\/sites\/2304\/2023\/12\/Quantitative-1-650x315.png 650w, https:\/\/cdn-dev.vanderbilt.edu\/t2-my-dev\/wp-content\/uploads\/sites\/2304\/2023\/12\/Quantitative-1-300x145.png 300w, https:\/\/cdn-dev.vanderbilt.edu\/t2-my-dev\/wp-content\/uploads\/sites\/2304\/2023\/12\/Quantitative-1-768x372.png 768w, https:\/\/cdn-dev.vanderbilt.edu\/t2-my-dev\/wp-content\/uploads\/sites\/2304\/2023\/12\/Quantitative-1.png 1300w\" sizes=\"auto, (max-width: 650px) 100vw, 650px\" \/><figcaption id=\"caption-attachment-3567\" class=\"wp-caption-text\"><strong>Fig 5.<\/strong> Percentage emphysema scores are affected by the reconstruction kernel in a given vendor, resulting in differences in measurements. Hard kernels overestimate emphysema quantification. Harmonizing kernels from different vendors to a reference soft kernel minimizes measurement errors, leading to a consensus among vendors for emphysema measurement.<\/figcaption><\/figure>\n<p>&nbsp;<\/p>\n<figure id=\"attachment_3568\" aria-describedby=\"caption-attachment-3568\" style=\"width: 650px\" class=\"wp-caption alignnone\"><img loading=\"lazy\" decoding=\"async\" class=\"size-large wp-image-3568\" src=\"https:\/\/my.dev.vanderbilt.edu\/masi\/wp-content\/uploads\/sites\/2304\n2661\/2023\/12\/Sensitivity-1-650x276.png\" alt=\"Emphysema quantification of GE BONE after kernel harmonization to B30f remained challenging. Although harmonization correctly reduced emphysema variation (left) in a few subjects, emphysema in the majority of subjects was over estimated (right).\" width=\"650\" height=\"276\" srcset=\"https:\/\/cdn-dev.vanderbilt.edu\/t2-my-dev\/wp-content\/uploads\/sites\/2304\/2023\/12\/Sensitivity-1-650x276.png 650w, https:\/\/cdn-dev.vanderbilt.edu\/t2-my-dev\/wp-content\/uploads\/sites\/2304\/2023\/12\/Sensitivity-1-300x127.png 300w, https:\/\/cdn-dev.vanderbilt.edu\/t2-my-dev\/wp-content\/uploads\/sites\/2304\/2023\/12\/Sensitivity-1-768x326.png 768w, https:\/\/cdn-dev.vanderbilt.edu\/t2-my-dev\/wp-content\/uploads\/sites\/2304\/2023\/12\/Sensitivity-1.png 1300w\" sizes=\"auto, (max-width: 650px) 100vw, 650px\" \/><figcaption id=\"caption-attachment-3568\" class=\"wp-caption-text\"><strong>Fig 6.<\/strong> Emphysema quantification of GE BONE after kernel harmonization to B30f remained challenging. Although harmonization correctly reduced emphysema variation (left) in a few subjects, emphysema in the majority of subjects was over estimated (right).<\/figcaption><\/figure>\n<div class=\"mceTemp\"><\/div>\n","protected":false},"excerpt":{"rendered":"<p>Aravind R. Krishnan,\u00a0Kaiwen Xu,\u00a0Thomas Li,\u00a0Chenyu Gao,\u00a0Lucas W. Remedios,\u00a0Praitayini Kanakaraj,\u00a0Ho Hin Lee,\u00a0Shunxing Bao,\u00a0Kim L. Sandler,\u00a0Fabien Maldonado,\u00a0Ivana I\u0161gum,\u00a0and\u00a0Bennett A. Landman\u00a0&#8220;Inter-vendor harmonization of CT reconstruction kernels using unpaired image translation&#8221;, Proc. SPIE 12926, Medical Imaging 2024: Image Processing, 129261D (2 April 2024);\u00a0https:\/\/doi.org\/10.1117\/12.3006608 Abstract The reconstruction kernel in computed tomography (CT) generation determines the texture of the image. Consistency&#8230;<\/p>\n","protected":false},"author":9571,"featured_media":3565,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[60,130,131,132,116,147],"tags":[],"class_list":["post-3542","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-computed-tomography","category-deep-learning","category-generative-adversarial-networks","category-harmonization","category-image-processing","category-lung-screening-ct"],"_links":{"self":[{"href":"https:\/\/my.dev.vanderbilt.edu\/masi\/wp-json\/wp\/v2\/posts\/3542","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/my.dev.vanderbilt.edu\/masi\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/my.dev.vanderbilt.edu\/masi\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/my.dev.vanderbilt.edu\/masi\/wp-json\/wp\/v2\/users\/9571"}],"replies":[{"embeddable":true,"href":"https:\/\/my.dev.vanderbilt.edu\/masi\/wp-json\/wp\/v2\/comments?post=3542"}],"version-history":[{"count":12,"href":"https:\/\/my.dev.vanderbilt.edu\/masi\/wp-json\/wp\/v2\/posts\/3542\/revisions"}],"predecessor-version":[{"id":3714,"href":"https:\/\/my.dev.vanderbilt.edu\/masi\/wp-json\/wp\/v2\/posts\/3542\/revisions\/3714"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/my.dev.vanderbilt.edu\/masi\/wp-json\/wp\/v2\/media\/3565"}],"wp:attachment":[{"href":"https:\/\/my.dev.vanderbilt.edu\/masi\/wp-json\/wp\/v2\/media?parent=3542"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/my.dev.vanderbilt.edu\/masi\/wp-json\/wp\/v2\/categories?post=3542"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/my.dev.vanderbilt.edu\/masi\/wp-json\/wp\/v2\/tags?post=3542"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}