PLoS ONE
Home Therapeutic response monitoring after targeted therapy in an orthotopic rat model of hepatocellular carcinoma using contrast-enhanced ultrasound: Focusing on inter-scanner, and inter-operator reproducibility
Therapeutic response monitoring after targeted therapy in an orthotopic rat model of hepatocellular carcinoma using contrast-enhanced ultrasound: Focusing on inter-scanner, and inter-operator reproducibility
Therapeutic response monitoring after targeted therapy in an orthotopic rat model of hepatocellular carcinoma using contrast-enhanced ultrasound: Focusing on inter-scanner, and inter-operator reproducibility

Competing Interests: The authors have declared that no competing interests exist.

Article Type: research-article Article History
Abstract

Purpose

To assess therapeutic response monitoring after targeted therapy in an orthotopic rat model of hepatocellular carcinoma (HCC) using CEUS with focusing on inter-scanner and inter-operator reproducibility.

Materials and methods

For reproducibility, CEUS was performed using two different US scanners by two operators in sixteen rat models of HCC. Using perfusion analysis software (VueBox ®), eleven parameters were collected, and intra-class correlation coefficient (ICC) was used to analyze reproducibility. Then seventeen rat models of HCC were divided into treatment group (n = 8, 30 mg/kg/day sorafenib for five days) and control group (n = 9). CEUS was performed at baseline and 14 days after first treatment, and changes of perfusion parameters were analyzed.

Results

In treatment group, CEUS perfusion parameters showed a significant change. The peak enhancement (PE, 2.50 x103±1.68 x103 vs 5.55x102±4.65x102, p = 0.010) and wash-in and wash out AUC (WiWoAUC, 1.07x105±6.48 x104 vs 2.65x104±2.25x104, p = 0.009) had significantly decreased two weeks after treatment. On the contrary, control group did not show a significant change, including PE (1.15 x103±7.53x102 vs 9.43x102± 7.81 x102, p = 0.632) and WiWoAUC (5.09 x104±3.25x104 vs 5.92 x104±3.20x104, p = 0.646). For reproducibility, the various degrees of inter-scanner reproducibility were from poor to good (ICC: <0.01–0.63). However, inter-operator reproducibility of important perfusion parameters, including WiAUC, WoAUC, and WiWoAUC, ranged from fair to excellent (ICC: 0.59–0.93) in a different scanner.

Conclusion

Our results suggest that CEUS is useful for assessment of the treatment response after targeted therapy and with fair to excellent inter-operator reproducibility.

Ryu,Kim,Lee,Han,and Baltzer: Therapeutic response monitoring after targeted therapy in an orthotopic rat model of hepatocellular carcinoma using contrast-enhanced ultrasound: Focusing on inter-scanner, and inter-operator reproducibility

Introduction

Various imaging techniques are widely used for the diagnosis and monitoring of the treatment response of cancer. Among the available imaging modalities, contrast-enhanced ultrasound (CEUS) with microbubble contrast agents is an emerging imaging technique used for monitoring targeted treatments as it provides real-time qualitative and quantitative information regarding tumor vascularity with high sensitivity. CEUS also has the advantage of being a non-invasive method which can be performed bedside and allow repeated examinations without renal toxicity [13]. Although CEUS has strong points for evaluating the treatment response using quantitative information for tumor perfusion, there are only a few studies regarding CEUS reproducibility. Because of the need for standardization of CEUS findings and for defining inter-scanner and inter-operator reproducibility, there are some attempts to improve reproducibility and to standardize CEUS findings and protocols, such as the quantitative imaging biomarkers alliance (QIBA) which is a group of researchers, healthcare professionals, and industry personnel [4].

For hepatocellular carcinoma (HCC), one of the most well-known hypervascular tumors, angiogenesis has an important role regarding tumor growth and development. Therefore, angiogenesis is considered an important feature for tumor-targeted therapy [3, 5]. The recent treatment strategy of HCC was directed to the effect of targeted therapy, and sorafenib (Nexavar®, Bayer Health Care, Leverkusen, Germany) is one of the targeted therapies widely used. Sorafenib is a molecularly targeted, multi-kinase inhibitor that suppresses the signal transduction pathways that mediate tumor growth and angiogenesis [6]. It is known that reductions in intra-tumor blood flow before measurable change in tumor size with therapeutic response are often observed after molecularly targeted therapy [79]. Therefore, there is a need for better imaging features than tumor size in order to evaluate the efficacy of sorafenib therapy with successful reproducibility [10]. However, to date, there have been small number of studies focusing on the inter-scanner and inter-operator reproducibility using CEUS. The purpose of this study is to assess therapeutic responses monitoring after targeted therapy in an orthotopic rat model of HCC using CEUS while focusing on the inter-scanner and inter-operator reproducibility.

Materials and methods

This study was approved by Seoul National University Hospital’s Institutional Animal Care and Use Committee (IACUC; No. 17-0125-S1A0) and was performed in accordance with the Guide for our IACUC and the National Institute of Health Guide for the Care and Use of Laboratory Animals.

Animal models

Seventeen, male Sprague–Dawley rats (approximately two months old; body weight, 250–340 g) were used for the human HCC xenograft model. The N1-S1 rat hepatoma cells (CRL-1604; ATCC, Manassas, VA, USA) were cultured in RPMI-1640 (WelGENE, Daegu, Korea) supplemented with 10% fetal bovine serum (WelGENE) and a 1% penicillin/streptomycin mixture (Gibco, Grand Island, NY, USA) at 37°C in a humidified atmosphere containing oxygen and 5% CO2. After testing the viability with Trypan blue staining (confirming > 90% cell viability for each tumor implantation procedure), cells were harvested for implantation. Before every handling, all rats were anesthetised to minimize animal suffering and distress. Rats were housed in the standard animal care facility cage during all experiments, which kept on a natural dark and light (12:12 h) cycle, in a temperature and humidity-controlled room and had free access to food and rodent food pellets. To anesthetize the rats, a mixture of zolazepam (5 mg/kg, Zoletil®; Virbac, Carros, France) and xylazine (10 mg/kg, Rompun®; Bayer-Schering Pharma, Berlin, Germany) was intramuscularly injected into the hind limb of each rat. All rats then underwent an upper midline incision and their left hepatic lobes were exposed on a sterile compress. According to the established protocols for the N1-S1 tumor model [11, 12], a suspension of 5 x 106 cells prepared in 50 μL of medium were slowly injected under the hepatic capsule into the left lobe of each rat using a 30-gauge needle. A gentle compression with handheld electrocautery (Bovie Medical Corporation, Clearwater, FL, USA) and cotton applicator were used for few seconds in order to avoid bleeding and reflux of the cells. To prevent spontaneous tumor regression of the N1-S1, cyclosporine A (20 mg/kg/day; Chong Kun Dang Pharmaceutical Corp., Seoul, Korea) was subcutaneously administrated from one day before the tumor implantation until four days after the surgery [13]. After the surgery, the animals were transferred to their home cage, which kept on a natural dark and light cycle in a temperature and humidity-controlled room. The rats were allowed access to food and pellets after recovery from anesthesia with strict observation for the first 2 hours after surgery. Rats were received daily postoperative care with regular food intake amount and body weight measured during the follow-up period after surgery. The rats had be planned euthanasia when a decrease in food intake for three days or weight loss of 20%

Experimental protocol

Two weeks following tumor implantation, an US examination was performed to check tumor growth. A CEUS examination and treatment were started only for rats with visible tumor having reached in diameter of approximately 10 mm. All of the examinations were performed after achieving anesthesia using the same method as that used for tumor implantation. For reproducibility evaluation, two radiologists (000 with 18 years of clinical experience in abdominal US, and 000 with five years of clinical experience in abdominal US) performed initial CEUS using two different US scanners, i.e. LOGIQ E9 ultrasound system (US scanner A, GE Healthcare, Wauwatosa, WI, USA), and RS80A ultrasound system (US scanner B, Samsung Medison, Seoul, Korea). Those two kind of scanners are widely used US scanner thesedays, and they were used in various previous CEUS imaging studies such as tumor detection and characterization, or tissue vascularization and perfusion [1418]. After the CEUS examination, the rats were randomly divided into two groups as follows: (1) the sorafenib-treated group (n = 8); and (2) the control group (n = 9). In the sorafenib-treated group, sorafenib was administered orally at a dosage of 30 mg/kg/day for five days. The same volume of saline was administered orally to the control group rats. Follow up CEUS examinations were performed one day and 14 days after the first sorafenib administration by one radiologist (000) using US scanner A. After the last CEUS examination, all of the rats were sacrificed with a lethal dose of sodium pentobarbital (100 mg/kg body weight, intraperitoneal). Just after sacrifice, the tumors of each rat were collected for histologic analysis. The tumor length at the maximum dimension and the CEUS datasets of each rat were obtained in the same manner as with the initial CEUS examination. The study design is outlined in Fig 1.

Outline of the experimental design.
Fig 1

Outline of the experimental design.

Note–CEUS: contrast enhanced ultrasound examination. f/u: follow up.

Contrast-enhanced ultrasound examination

Two radiologists (000, and 000) conducted an ultrasound examination using a 2–9 MHz linear-array transducer of both US scanner A (9L-D, center frequency, 5.0 MHz, mechanical index (MI), 1.2 on B-mode imaging, and <0.2 on coded contrast imaging mode, dynamic range, 69 dB, gain, 70%, and US scanner B (LA2-9A, center frequency, 5.15 MHz, MI, 1.4 on B-mode imaging, and 0.07 on CEUS+ imaging mode, dynamic range, 35 dB, gain, 60%). Each operator obtained B-mode images and measured the tumor length at the maximum dimension before the CEUS examination. The SonoVue® (Bracco Suisse SA, Geneva, Switzerland) US contrast agent was used in this study. Cannulation was done in the tail vein of each rat with a 27-gauge needle. Bolus injection of 5 x 107 microbubbles (0.1 mL) was done through the tail vein by hand injection following 0.1 mL of saline flush. After microbubble injection, the CEUS data were obtained continuously for 90 seconds in each rat by each operator (Fig 2). For CEUS data acquisition, the coded contrast imaging with reduced MI (<0.2) was used by US scanner A, and CEUS+ with a MI level of 0.07 was used by US scanner B. The four, different contrast injections for each rat were performed at least 30 minutes apart in order to allow clearance of microbubbles from previous injections [1921].

Representative cases of CEUS examination of US scanner A (A, B, C) and US scanner B (D, E, F), demonstrating B-mode imaging (A, D), arterial phase (B, E), and delayed phase (C, F).
Fig 2

Representative cases of CEUS examination of US scanner A (A, B, C) and US scanner B (D, E, F), demonstrating B-mode imaging (A, D), arterial phase (B, E), and delayed phase (C, F).

Note–CEUS: contrast enhanced ultrasound examination. Numbers in figure indicates time from contrast injection.

Contrast-enhanced ultrasound imaging analysis

One radiologist (000) analyzed all of the CEUS datasets of three sessions using perfusion analysis software (VueBox ®, Bracco Suisse SA, Geneva, Switzerland). Each cine clip of CEUS data was assessed, and the polygonal region of interest (ROI) covering the entire tumor was drawn manually on the image (Fig 3). If there was a change in the tumor position due to respiratory motion during the scanning, the ROI was automatically calibrated by the software. When automatic calibration by software was insufficient, the ROI was adjusted manually. Time-intensity curves were automatically fitted to the log-normal model using the non-linear least-squares regression method. All of the following 11 perfusion parameters were automatically calculated: peak enhancement (PE); rise time; fall time; mean transit time (MTT); time to peak enhancement (TTP); wash-in rate (WiR); washout rate (WoR); wash-in area under the curve (WiAUC); wash-out area under the curve (WoAUC); wash-in and wash-out areas under the curve (WiWoAUC); and wash-in perfusion index (WiPI). Changes of perfusion parameters were analyzed to evaluate the treatment effect [1113].

Representative case of CEUS image analysis using perfusion analysis software (VueBox ®), ROI manually drawn over tumor (A), and corresponding time-intensity curve profile (B).
Fig 3

Representative case of CEUS image analysis using perfusion analysis software (VueBox ®), ROI manually drawn over tumor (A), and corresponding time-intensity curve profile (B).

Note–CEUS: contrast enhanced ultrasound examination. ROI: region of interest.

Histologic analysis

Tumor tissue was excised after the follow-up imaging study 14 days after the first sorafenib administration. Hematoxylin and eosin (H&E) stain was done to evaluate the morphologic features and the necrotic fraction of the tumor. The terminal, deoxynucleotidyl, transferase-mediated, dUTP nick end-labelling (TUNEL) staining using a detection kit (Millipore, Bedford, MA, USA) was performed to calculate the apoptosis index. The immunohistochemistry staining was performed using an antibody to CD31 (ab28364, 1:50 Abcam, Cambridge, UK) in order to obtain the mean vessel density (MVD). All stained tissue sections were scanned at x40 magnification by a Leica AS LMD laser microdissection microscope (Leica, Wetzlar, Germany) and saved as digital images (in Joint Photographic Experts Group format). Using Image J software (National Institutes of Health, Bethesda, MD, USA), the necrotic fraction (%), apoptosis index (%), and the MVD of each sample were calculated by one author (00) who was blinded to the treatment status of the rats. The necrotic fraction was calculated as the area of the largest cross-section of the entire tumor divided by the area of necrosis at lower-power field (x40). The apoptosis index was calculated as the averaged proportion of TUNEL-positive cells with respect to the total number of cells at high-power fields (x400) of five, random areas of each sample avoiding necrotic area. MVD was obtained by the maximum number of CD31-stained vessels among the randomly chosen five, higher vascular areas of each sample at high magnification (x200, 0.739 mm2) [2225].

Statistical analysis

The paired t-test was used to compare the perfusion parameters between two, different operators or two, different US scanners and to evaluate changes in the perfusion parameters between baseline and two weeks after in either the treatment or control group. The student t-test was used to compare perfusion parameters and histologic features between the treatment and control group. The Pearson correlation coefficient (r) was calculated between the perfusion parameters and the histologic features. For inter-scanner and inter-operator reproducibility, intra-class correlation coefficients (ICCs) with 95% confidence intervals (CIs) were obtained. An ICC of 0–0.39 indicated poor; 0.40–0.59, fair; 0.60–0.74, good; and 0.75–1.0, excellent agreement [26]. All statistical analyses were performed using commercially available software programs (SPSS version 21, SPSS, IBM, Armonk, NY, USA; or MedCalc version 18, MedCalc Software, Mariakerke, Belgium) and with a p-value less than 0.05 considered to indicate a statistically significant difference.

Results

Among 17 of the tumor-implanted rats, one rat was excluded from the reproducibility evaluation because of poor tumor enhancement during one of four CEUS sessions due to compromised vessel integrity. In total, 16 rats were assessed for inter-scanner and inter-operator reproducibility. For the treatment response evaluation, a total of 17 rats, including the treatment group (n = 8), and the control group (n = 9), were assessed. The average size of all tumors included in this study was 11.1±3.69 mm and the maximum size of tumors was 18.0 mm.

Inter-scanner reproducibility evaluation of each perfusion parameter

Table 1 summarizes the inter-scanner reproducibility of the perfusion parameters with two operators. There was a significant variation of the perfusion parameters between the two, different US scanners. Except for the mean transit time, all of the perfusion parameters obtained by the two, different US scanners demonstrated significant differences for at least one operator. The pairwise ICC of 11 perfusion parameters for two, different scanners ranged from <0.01 to 0.63. The pairwise ICC of the major perfusion parameters, such as WiAUC (0.01 and <0.01), WoAUC (0.01, and 0.02), and WiWoAUC (0.01 and 0.02), demonstrated poor agreement.

Table 1
Comparison with inter-scanner reproducibility of perfusion parameters obtained by two operators.
US scanner AUS scanner BPICC
PE (a.u)R11.30x103 ± 9.31x1021.63x105 ± 2.67x1050.028<0.01(-0.99,0.59)
R21.64x103 ± 1.43x1035.25x104 ± 4.32x1040.0280.03(-0.35,0.46)
WiAUC (a.u)R11.43x104 ± 1.05x1046.26x105 ± 7.71x1050.0060.01(-0.69,0.55)
R21.81x104 ± 1.34x1045.73x105 ± 8.05x1050.894<0.01 (-0.86,0.57)
RT (sec)R116.8 ± 7.819.68 ± 5.500.010<0.01 (-0.84,0.54)
R217.3 ± 7.179.49 ± 7.510.0020.63(-0.25,0.89)
MTT (sec)R11.64x102 ± 1.6986.4 ± 83.80.0830.31(-0.64,0.74)
R21.58x102 ± 1.611.47x102 ± 1.850.2080.51(-0.48,0.83)
TTP (sec)R120.4 ± 9.2615.8 ± 9.720.200<0.01 (-2.00,0.59)
R221.2 ± 8.4012.4 ± 9.450.0040.62(-0.22,0.88)
WiR (a.u)R11.47x102 ± 93.94.18x105 ± 9.69x1050.106<0.01 (-1.38,0.62)
R21.86x102 ± 2.069.85x103 ± 1.08x104<0.0010.03(-0.55,0.53)
WiPI (a.u)R18.71x102 ± 6.17x1021.00x105 ± 1.67x1050.031<0.01 (-1.01,0.59)
R21.10x103 ± 9.59x1023.44x104 ± 2.79x1040.0370.03(-0.34,0.46)
WoAUC (a.u)R14.20x104 ± 3.15x1041.50x106 ± 1.71x1060.0040.01(-0.63,0.53)
R26.25x104 ± 6.08x1041.08x106 ± 1.81x1060.5580.02(-1.04,0.60)
WiWoAUC (a.u)R15.63x104 ± 4.18x1042.21x106 ± 2.48x1060,0030.01(-0.61,0.53)
R28.05x104 ± 7.19x1041.52x106 ± 2.45x1060.4920.02(-0.99,0.60)
FT (sec)R152.6±25.023.9±17.40.0010.24(-0.31,0.65)
R253.2±25.627.3±24.70.0100.58(-0.23,0.86)
WoR (a.u)R131.5±25.61.60x104 ± 3.57x1040.094<0.01(-1.34,0.62)
R240.6±42.73.55x103 ± 5.00x103<0.0010.02(-0.80,0.57)

Note. − A: GE LOGIQ E9. B: Samsung RS80A. PE: peak enhancement. WiAUC: Wash-in area under the curve. RT: Rise time. MTT: mean transit time. TTP: Time to peak. WiR: Wash-in rate. WiPI: Wash-in Perfusion Index. WoAUC: Wash-out area under the curve. WiWoAUC: Wash-in and Wash-out area under the curve. FT: Fall Time. WoR: Wash-out rate. a.u: arbitrary units.R1: Radiologist 1, R2: Radiologist 2.

Inter-operator reproducibility evaluation of each perfusion parameters

There was no significant difference in each of the perfusion parameters between the two operators when using the same US scanner. Although the pairwise ICC of 11 perfusion parameters for two, different operators ranged widely from <0.01 to 0.93, the pairwise ICC of the major perfusion parameters, such as WiAUC (0.76 and 0.93), WoAUC (0.59 and 0.90), and WiWoAUC (0.65 and 0.88), showed fair to excellent agreement. The inter-operator reproducibility of all of the perfusion parameters is noted in Table 2.

Table 2
Comparison with inter-operator reproducibility of perfusion parameters using two kinds of US scanners.
US scannerRadiologist 1Radiologist 2PICC
PE (a.u)A1.30x103 ±9.31x1021.64x103 ± 1.43x1030.2770.65(0.04,0.88)
B1.63x105 ± 2.67x1055.25x104 ± 4.32 x1040.0880.30(-0.68,0.74)
WiAUC (a.u)A1.43x104 ± 1.05x1041.81x104 ± 1.34x1040.1630.76(0.36,0.92)
B6.26x105 ± 7.71x1055.73x105 ± 8.05x1050.6200.93(0.79,0.97)
RT (sec)A16.8±7.8117.3 ± 7.170.7720.77(0.33,0.92)
B9.68±5.509.49 ± 7.510.936<0.01(-2.40,0.65)
MTT (sec)A1.64x102 ± 1.69x1021.58x102 ± 1.61x1020.8760.66(-0.02,0.88)
B86.4 ± 83.81.47x102 ± 1.85x1020.276<0.01(-2.47,0.56)
TTP (sec)A20.4 ± 9.2621.2±8.400.6980.73(0.21,0.91)
B15.8 ± 9.7212.4±9.450.370<0.01(-3.04,0.53)
WiR (a.u)A1.47x102 ± 93.91.86x102 ± 2.06x1020.4100.52(-0.37,0.83)
B4.18x104 ± 9.69x1049.85x103 ± 1.08x1040.2050.05(-1.51,0.66)
WiPI (a.u)A8.71x102 ± 6.17x1021.10x103 ± 9.59x1020.2750.66(0.06,0.88)
B1.00x105 ± 1.67x1053.44x104 ± 2.79x1040.0980.33(-0.63,0.75)
WoAUC (a.u)A4.20x104 ± 3.15x1046.25x104 ± 6.08x1040.1300.59(-0.07,0.85)
B1.50x106 ± 1.71x1061.08x106 ± 1.81x1060.1250.90(0.72,0.97)
WiWoAUC (a.u)A5.63x104 ± 4.18x1048.05x104 ± 7.19x1040.1180.65(0.07,0.87)
B2.21x106 ± 2.48x1061.52x106 ± 2.45x1060.0990.88(0.65,0.96)
FT (sec)A52.6 ± 25.053.1 ± 25.60.9220.80(0.40,0.93)
B23.4 ± 17.427.3 ± 24.70.668<0.01(-2.73,0.61)
WoR (a.u)A31.4 ± 25.640.6 ± 42.70.4140.39(-0.77,0.79)
B1.60x104 ± 3.57x1043.55x103 ± 5.00x1030.1830.04(-1.47,0.66)

Note. − A: GE LOGIQ E9. B: Samsung RS80A. PE: peak enhancement. WiAUC: Wash-in area under the curve. RT: Rise time. MTT: mean transit time. TTP: Time to peak. WiR: Wash-in rate. WiPI: Wash-in Perfusion Index. WoAUC: Wash-out area under the curve. WiWoAUC: Wash-in and Wash-out area under the curve. FT: Fall Time. WoR: Wash-out rate. a.u: arbitrary units.

Therapeutic responses evaluation using CEUS after Sorafenib treatment

In the histologic analysis, there were significant differences in the necrotic fraction, apoptosis index, and MVD of the tumor between the treatment and the control groups. The treatment group showed significantly larger necrotic area (47.7% ± 6.87 vs. 31.3% ± 10.8), higher apoptotic cell counts (49.1% ± 15.0 vs. 16.1% ± 7.15), and fewer microvessels (0.53 ± 0.35 vs. 1.76 ± 0.71) within the tumor than the control group (p <0.05, Fig 4). Table 3 summarizes the comparison of the histologic features between the treatment and the control groups. In the CEUS examination, the tumor size had significantly increased after two weeks in both treatment groups (9.75mm ± 3.77 vs 13.9mm ± 7.72, P = 0.032) and the control group (12.3mm ± 3.35 vs 26.7mm ±9.15, P = 0.003). However, the changes of perfusion parameters between the two groups were different. In the treatment group, PE (2.50 x 103a.u ± 1.68x103 vs 5.55 x 102a.u ± 4.65 x 102), WiAUC (2.70 x 104 a.u ± 1.65 x 104 vs 6.61 x 103 a.u ± 5.57 x 103), WoAUC (8.00 x 104 a.u ± 4.83 x 104 vs 1.99x104 a.u ±1.71 x 104), and WiWoAUC (1.07 x 105 a.u ± 6.48 x 104 vs 2.65 x 104 a.u ± 2.25 x 104) were significantly decreased (p <0.05). On the contrary, in the control group, PE, WiAUC, WoAUC, and WiWoAUC showed no significant change after two weeks.

Representative cases of pathologic analysis, H&E (x40) (A and D), TUNEL (x400) (B and E), CD31 assay (x200) (C and F) of control group and sorafenib treated group.
Fig 4

Representative cases of pathologic analysis, H&E (x40) (A and D), TUNEL (x400) (B and E), CD31 assay (x200) (C and F) of control group and sorafenib treated group.

Note–H&E: hematoxylin and eosin stain. TUNEL: terminal deoxynucleotidyl transferase-mediated dUTP nick end-labelling staining.

Table 3
Comparison with histologic features between sorafenib treatment and control group.
Treatment (n = 8)Control (n = 9)P
Necrotic fraction (%)47.7±6.8731.3±10.80.002
Apoptosis index (%)49.1±15.016.1±7.15<0.001
Microvessel density (/0.739mm2)0.53±0.351.76±0.710.001

There was no correlation between the histologic features and the perfusion parameters, including the tumor size, PE, WiAUC, WoAUC, and WiWo AUC (S1 Table). In addition, WiR (2.92 x 102a.u ± 2.09 x 102 vs 53.4a.u ± 44.2), WiPI (1.72 x 103a.u ± 1.08 x 103 vs 3.71 x 102a.u ± 3.10 x 102), and WoR (55.0a.u ± 36.9 vs 12.1a.u ±10.4) were significantly decreased in the treatment group (p <0.05), and the rise time (17.8sec ± 7.09 vs 26.1sec ± 8.88, P = 0.040) was significantly increased in the control group (Table 4).

Table 4
Comparison with tumor size and perfusion parameter of baseline, and two weeks after treatment.
ControlTreatment
BaselineTwo weeksPBaselineTwo weeksP
Size (mm)12.3±3.3526.7±9.150.0039.75±3.7713.9±7.720.032
PE (a.u)1.15 x103±7.53x1029.43 x102± 7.81 x1020.6322.50 x103±1.68 x1035.55x102±4.65 x1020.010
WiAUC (a.u)1.26 x104±7.86x1031.32 x104±7.39 x1030.8752.70 x104±1.65 x1046.61 x103±5.57 x1030.009
RT (sec)17.8±7.0926.1±8.880.04016.0±3.8717.1±4.380.460
MTT (sec)2.64 x102±2.26 x1022.79 x102±2.12 x1020.8701.11 x102±7.21 x10213.4±74.10.432
TTP (sec)22.0±9.0834.4±18.80.05918.6±5.0820.4±5.250.312
WiR (a.u)2.19 x102±3.68 x10295.6±1300.4012.92 x102±2.09x10253.4±44.20.015
WiPI (a.u)7.90 x102±5.43x1026.50 x102±5.66x1020.6511.72 x103±1.08 x1033.71x 102±3.10x1020.010
WoAUC (a.u)3.83 x104±2.54 x1044.60 x104±2.55x1040.5928.00 x104±4.83 x1041.99 x104±1.71 x1040.009
WiWoAUC (a.u)5.09 x104±3.25x1045.92 x104±3.20x1040.6461.07x105±6.48 x1042.65 x104±2.25x1040.009
FT (sec)54.5±19.688.1±43.30.05552.3±10.051.9±14.70.867
WoR (a.u)25.4±17.914.6±13.30.18455.0±36.912.1±10.40.015

Note—PE: peak enhancement. WiAUC: Wash-in area under the curve. RT: Rise time. MTT: mean transit time. TTP: Time to peak. WiR: Wash-in rate. WiPI: Wash-in Perfusion Index. WoAUC: Wash-out area under the curve. WiWoAUC: Wash-in and Wash-out area under the curve. FT: Fall Time. WoR: Wash-out rate. a.u: arbitrary units.

Discussion

In our study, CEUS was useful in the therapeutic response evaluation after targeted therapy using perfusion parameters such as PE, WiAUC, WoAUC, and WiWoAUC. Inter-operator reproducibility was fair and excellent in WiWoAUC (ICC: 0.65 and 0.88) WiAUC (ICC: 0.76 and 0.93), and WoAUC (ICC: 0.59 and 0.90). However, various degrees of inter-scanner reproducibility, from poor to good (ICC: <0.01–0.63), were observed. Our results support the low inter-scanner exchangeability although acceptable inter-operator exchangeability of CEUS in perfusion parameters.

Standardization of CEUS perfusion parameters is essential for the clinical application. Reliable and reproducible quantification of the imaging biomarkers during follow-up is necessary for making a proper treatment plan for patients. In response to this need for standardization of the imaging biomarkers, the Radiological Society of North America organized the QIBA with the mission of improving the value and practicality of quantitative imaging biomarkers by reducing the variability across devices, patients, and time [27]. However there are only a few studies regarding the reproducibility of CEUS perfusion parameters in terms of inter-scanner and inter-operator. Zocco et al. investigated intra-observer reproducibility for the entire CEUS process after sorafenib treatment in HCC patients. The mean coefficient of variation (CV) of PE, AUC, TTP, and MTT ranged from 4.7% to 9.7% and is considered low-variance. The kappa values of five perfusion parameters were between 0.82 and 0.95, thus suggesting good to excellent agreement [10]. Ghulam et al. demonstrated excellent intra and inter-operator variability in measuring intraluminal thrombus volume (ICC: 0.95–0.99 and 0.92–0.98) and thickness (ICC: 0.86–0.94 and 0.88–0.98) of abdominal aortic aneurysms with 3D-CEUS [28]. Zoppellaro et al also reported good in intra‐operator (ICC: 0.929, p<0.001) and inter‐operator reproducibility (ICC: 0.926) of CEUS in myocardial contrast echocardiography [29]. However, they did not evaluate the inter-scanner reproducibility during the CEUS examination. In our study, the pairwise ICC of the inter-operator reproducibility during the CEUS examination for major perfusion parameters, including PE, WiAUC, WoAUC, and WiWoAUC, ranged from 0.59 to 0.90 for at least one scanner and thus suggesting fair to excellent agreement. However, the inter-scanner reproducibility of the four, major perfusion parameters were between <0.01 and 0.02, which were considered to be poor reproducibility. We believe this inter-scanner variability could be attributed to a number of systemic factors. According to recently published paper by Averkiou et al, one of the cause of the inter-scanner variability in especially of amplitude parameters such as PE and AUC is arbitrarily assigned absulute amplitude values by scanner developers. They also demonstrated much lower inter-scanner variability of time parameters such as RT and MTT than amplitude parameteres [30]. Different dynmaic range among scanners can also cause inter-scanner variability, because linearized log-compressed data are finally converted to arbitrary unit data by application of dyanmic range. In our study, we used default dynamic range optimized by the vendors, which were different from two scannars (69 and 35 dB). In addition, different mechanical index can result inter-scanner variability. Tang et al showed an increase of approximately 50 percent in the normalized echo signal power would be expected if the MI changes from 0.05 to 0.1 [4]. Finally, different central frequency of probe can cause inter-scanner variability due to high dependency of microbubble contrast agents on ultrasound frequency [31]. Our experience suggests that a CEUS examination with different US scanners during follow-up may provide incorrect information regarding the treatment response.

As CEUS provides quantitative tumor perfusion parameters with high sensitivity, this allows prediction of the early treatment response after targeted therapy [32]. After bolus injection of contrast microbubbles, a time-intensity curve showing average intensity in an ROI as a function of time is formed. Several perfusion parameters are derived from the time-intensity curve, and some parameters, such as PE and AUC, are more correlated to the local blood volume of the region, while other parameters, such as TTP and the rise time, are more correlated to blood flow. Therefore, the decrease in PE and AUC correlates to the reductions in tumor blood volume [1, 23, 32, 33]. Based on this fact, there are several previous studies. Lassau et al. demonstrated the significant correlation between perfusion parameters and treatment response after bevacizumab treatment in HCC patients. They demonstrated decreases in WiWoAUC, WiAUC, WoAUC, and TTP measured three days after treatment correlated with the Response evaluation criteria in solid tumors (RECIST) response at two months following treatment (P < 0.05) [24]. Zocco et al. also demonstrated the significant correlation between CEUS perfusion parameters and the treatment response in 28, advanced HCC patients treated with sorafenib. They demonstrated the percentage changes in PE, WiWoAUC, and WiR measured 15 days after treatment correlated with the RECIST response at two months (P < 0.05) [10]. In our study, perfusion parameters including PE (P = 0.01), WiAUC (P = 0.009), WiR, WiPI, WoAUC, WiWoAUC, and WoR demonstrated a significant decrease in the treatment group two weeks after sorafenib treatment (P < 0.05), although there was no significant change in the control group. In addition, more necrotic areas, more apoptotic cells, and fewer microvessels in the treatment group were confirmed in histologic analysis (P<0.001–0.002). These results agree with those of previous studies.

There are some limitations to our study. First, we manually injected microbubble contrast agent into each rat. Although all injections were performed by one person, this could affect the variability of the CEUS parameters. Second, the N1-S1 rat hepatoma tumors have a property of spontaneous regression and we used an immunosuppressant to prevent spontaneous regression of the tumor [22]. As the immunosuppressant may affect tumor vascularity, further studies regarding the effects of the immunosuppressant on tumor vascularity will be required. Third, this study was conducted with rats and the number of rats included in the study was small. Therefore, there is a limitation for applying the results directly to the human population. Furthermore, evaluation with a large population would clarify the results. Finally, we did not evaluate intra- or inter-observer variability during the CEUS imaging analysis using perfusion analysis software.

In conclusion, our results suggest that CEUS is useful for assessment of the treatment response after targeted therapy with fair to excellent inter-operator reproducibility. However, significant inter-scanner variability was observed. Therefore, the perfusion parameters obtained by different US scanners should not be used interchangeably in longitudinal follow-up.

References

ELeen, MAverkiou, MArditi, PBurns, DBokor, TGauthier, et al Dynamic contrast enhanced ultrasound assessment of the vascular effects of novel therapeutics in early stage trials. Eur Radiol. 2012;22(7):144250. Epub 2012/02/04. 10.1007/s00330-011-2373-2 .

ADizeux, TPayen, GBarrois, DLe Guillou Buffello, SLBridal. Reproducibility of Contrast-Enhanced Ultrasound in Mice with Controlled Injection. Mol Imaging Biol. 2016;18(5):6518. Epub 2016/04/15. 10.1007/s11307-016-0952-y .

AGuibal, LTaillade, SMule, EComperat, YBadachi, JLGolmard, et al Noninvasive contrast-enhanced US quantitative assessment of tumor microcirculation in a murine model: effect of discontinuing anti-VEGF therapy. Radiology. 2010;254(2):4209. Epub 2010/01/23. 10.1148/radiol.09090728 .

MXTang, HMulvana, TGauthier, AKLim, DOCosgrove, RJEckersley, et al Quantitative contrast-enhanced ultrasound imaging: a review of sources of variability. Interface focus. 2011;1(4):52039. Epub 2012/08/07. 10.1098/rsfs.2011.0026

MLamuraglia, SLBridal, MSantin, GIzzi, ORixe, AParadiso, et al Clinical relevance of contrast-enhanced ultrasound in monitoring anti-angiogenic therapy of cancer: current status and perspectives. Crit Rev Oncol Hematol. 2010;73(3):20212. Epub 2009/06/24. 10.1016/j.critrevonc.2009.06.001 .

JMLlovet, SRicci, VMazzaferro, PHilgard, EGane, J-FBlanc, et al Sorafenib in advanced hepatocellular carcinoma. New England journal of medicine. 2008;359(4):37890. 10.1056/NEJMoa0708857

NLassau, MLamuraglia, JLeclere, VRouffiac. [Functional and early evaluation of treatments in oncology: interest of ultrasonographic contrast agents]. J Radiol. 2004;85(5 Pt 2):70412. Epub 2004/07/09. 10.1016/s0221-0363(04)97651-2 .

MYChen, REBechtold, PDSavage. Cystic changes in hepatic metastases from gastrointestinal stromal tumors (GISTs) treated with Gleevec (imatinib mesylate). AJR Am J Roentgenol. 2002;179(4):105962. Epub 2002/09/20. 10.2214/ajr.179.4.1791059 .

SLavisse, PLejeune, VRouffiac, NElie, EBribes, BDemers, et al Early quantitative evaluation of a tumor vasculature disruptive agent AVE8062 using dynamic contrast-enhanced ultrasonography. Invest Radiol. 2008;43(2):10011. Epub 2008/01/17. 10.1097/RLI.0b013e3181577cfc .

10 

MAZocco, MGarcovich, ALupascu, EDi Stasio, DRoccarina, BEAnnicchiarico, et al Early prediction of response to sorafenib in patients with advanced hepatocellular carcinoma: the role of dynamic contrast enhanced ultrasound. J Hepatol. 2013;59(5):101421. Epub 2013/07/03. 10.1016/j.jhep.2013.06.011 .

11 

JMHudson, RKarshafian, PNBurns. Quantification of flow using ultrasound and microbubbles: a disruption replenishment model based on physical principles. Ultrasound Med Biol. 2009;35(12):200720. Epub 2009/10/14. 10.1016/j.ultrasmedbio.2009.06.1102 .

12 

MArditi, PJFrinking, XZhou, NGRognin. A new formalism for the quantification of tissue perfusion by the destruction-replenishment method in contrast ultrasound imaging. IEEE Trans Ultrason Ferroelectr Freq Control. 2006;53(6):111829. Epub 2006/07/19. 10.1109/tuffc.2006.1642510 .

13 

EQuaia, MSozzi, RAngileri, AGGennari, MACova. Time-Intensity Curves Obtained after Microbubble Injection Can Be Used to Differentiate Responders from Nonresponders among Patients with Clinically Active Crohn Disease after 6 Weeks of Pharmacologic Treatment. Radiology. 2016;281(2):60616. 10.1148/radiol.2016152461 .

14 

EJung, CRoss, JRennert, MScherer, SFarkas, Pvon Breitenbuch, et al Characterization of microvascularization of liver tumor lesions with high resolution linear ultrasound and contrast enhanced ultrasound (CEUS) during surgery: First results. Clinical hemorheology and microcirculation. 2010;46(2–3):8999. 10.3233/CH-2010-1336

15 

MHornung, EMJung, CStroszczynski, HJSchlitt, AAgha. Contrast-enhanced ultrasonography (CEUS) using early dynamic in microcirculation for localization of pathological parathyroid glands: First-line or complimentary diagnostic modality? Clinical Hemorheology and Microcirculation. 2011;49:8390. 10.3233/CH-2011-1459

16 

PLamby, LPrantl, CFellner, SGeis, EMJung. Post-operative monitoring of tissue transfers: Advantages using contrast enhanced ultrasound (CEUS) and contrast enhanced MRI (ceMRI) with dynamic perfusion analysis? Clinical Hemorheology and Microcirculation. 2011;48:10517. 10.3233/CH-2011-1405

17 

JRübenthaler, MReiser, VCantisani, DRjosk-Dendorfer, DAClevert. The value of contrast-enhanced ultrasound (CEUS) using a high-end ultrasound system in the characterization of endoleaks after endovascular aortic repair (EVAR). Clinical Hemorheology and Microcirculation. 2017;66:28392. 10.3233/CH-179102

18 

KMueller-Peltzer, GNegrao de Figueiredo, TGraf, JRübenthaler, DAClevert. Papillary renal cell carcinoma in contrast-enhanced ultrasound (CEUS)–A diagnostic performance study. Clinical Hemorheology and Microcirculation. 2019;71:15964. 10.3233/CH-189406

19 

HWang, DHristov, JQin, LTian, JKWillmann. Three-dimensional Dynamic Contrast-enhanced US Imaging for Early Antiangiogenic Treatment Assessment in a Mouse Colon Cancer Model. Radiology. 2015;277(2):42434. Epub 2015/05/29. 10.1148/radiol.2015142824

20 

MAPysz, KFoygel, CMPanje, ANeedles, LTian, JKWillmann. Assessment and monitoring tumor vascularity with contrast-enhanced ultrasound maximum intensity persistence imaging. Invest Radiol. 2011;46(3):18795. Epub 2010/12/15. 10.1097/RLI.0b013e3181f9202d

21 

JKWillmann, RHKimura, NDeshpande, AMLutz, JRCochran, SSGambhir. Targeted contrast-enhanced ultrasound imaging of tumor angiogenesis with contrast microbubbles conjugated to integrin-binding knottin peptides. J Nucl Med. 2010;51(3):43340. Epub 2010/02/13. 10.2967/jnumed.109.068007

22 

JZhou, WZheng, LCao, MLiu, FHan, ALi. Antiangiogenic tumor treatment: noninvasive monitoring with contrast pulse sequence imaging for contrast-enhanced grayscale ultrasound. Acad Radiol. 2010;17(5):64651. Epub 2010/03/13. 10.1016/j.acra.2010.01.008 .

23 

SLee, JHKim, JHLee, JHLee, JKHan. Non-invasive monitoring of the therapeutic response in sorafenib-treated hepatocellular carcinoma based on photoacoustic imaging. European Radiology. 2018;28(1):37281. 10.1007/s00330-017-4960-3

24 

N.Weidner Intratumor microvessel density as a prognostic factor in cancer. The American Journal of Pathology. 1995;147(1):919. PMC1869874.

25 

Y-iYamashita, MShimada, HHasegawa, RMinagawa, TRikimaru, THamatsu, et al Electroporation-mediated Interleukin-12 Gene Therapy for Hepatocellular Carcinoma in the Mice Model. Cancer Research. 2001;61(3):100512.

26 

JRLandis, GGKoch. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):15974. .

27 

DCSullivan, NAObuchowski, LGKessler, DLRaunig, CGatsonis, EPHuang, et al Metrology standards for quantitative imaging biomarkers. Radiology. 2015;277(3):81325. 10.1148/radiol.2015142202

28 

QMGhulam, KBredahl, BSandholt, MTaudorf, LLönn, LRouet, et al Contrast Enhanced Three Dimensional Ultrasound for Intraluminal Thrombus Assessment in Abdominal Aortic Aneurysms. Eur J Vasc Endovasc Surg. 2018;56(5):67380. Epub 2018/09/01. 10.1016/j.ejvs.2018.07.029 .

29 

GZoppellaro, LVenneri, RSKhattar, WLi, RSenior. Simultaneous Assessment of Myocardial Perfusion, Wall Motion, and Deformation during Myocardial Contrast Echocardiography: A Feasibility Study. Echocardiography. 2016;33(6):88995. 10.1111/echo.13190

30 

MAAverkiou, EKJuang, MKGallagher, MACuevas, SRWilson, RGBarr, et al Evaluation of the Reproducibility of Bolus Transit Quantification With Contrast-Enhanced Ultrasound Across Multiple Scanners and Analysis Software Packages—A Quantitative Imaging Biomarker Alliance Study. Investigative radiology. 2020;55(10):64356. 10.1097/RLI.0000000000000702

31 

Hoff L. Acoustic characterization of contrast agents for medical ultrasound imaging: Springer Science & Business Media; 2001.

32 

TKuzuya, MIshigami, YIshizu, THonda, KHayashi, YKatano, et al Early Clinical Response after 2 Weeks of Sorafenib Therapy Predicts Outcomes and Anti-Tumor Response in Patients with Advanced Hepatocellular Carcinoma. PLOS ONE. 2015;10(9):e0138776 10.1371/journal.pone.0138776

33 

C.Greis Quantitative evaluation of microvascular blood flow by contrast-enhanced ultrasound (CEUS). Clinical hemorheology and microcirculation. 2011;49(1–4):13749. 10.3233/CH-2011-1464