1、Ultrasound Imaging and Its Applications,Mingyue DingDepartment of Bio-medical Engineering“Image Processing and Intelligent control” Key Laboratory of Education Ministry2018/7/17,2,OUTLINES,1. What is ultrasound?2. History of the development of ultrasound imaging technique3. 2D ultrasound imaging4. 3
2、D ultrasound imaging5. 3D ultrasound imaging applications,3,What is SOUND?,Sound is a mechanical wave that we can hear A mechanical wave can be described by:Amplitude: aWavelength: Frequency: fSound speed: C,a,4,Sound Propagation Speed,Sound can be transmitted through any medium- gas, liquid, or sol
3、id.Sound speed through the medium depends on the compressibility of the medium. The speeds of some materials are shown in the table below. Sound speed in different materials (m/s),5,Properties of Sound Propagation,Sound at different frequency can be transmitted in the same medium at the same speed.T
4、he different medium has different speed for sound transmission with the same frequency.,6,What is ULTRASOUND?,Ultrasound is any sound with a frequency above the range of human hearing, approximately 20 KHz. The most often used frquency band in medical imaging is between 2 and 10 MHz. Sound speed for
5、mula: Suppose C to be 1540 m/s, the wavelengths in soft tissue are in the range of 0.77-0.154 mm. The high frequencies mean shorter wavelengths.,7,Principle of Ultrasound Imaging,8,Principle of Ultrasound Imaging,A pulse is propagated and its reflection is received, both by the transducer.Key assump
6、tion: - Sound waves have a nearly constant velocity of 1500 m/s in H2O.- Sound wave velocity in H2O is similar to that in soft tissue.Thus, echo time maps to depth.,9,Ultrasound Principle,10,Ultrasound Image (Embryo),11,Ultrasound: Resolution and Transmission Frequency,Tradeoff between resolution an
7、d attenuation - higher frequency shorter wavelength higher attenuationPower loss:Typical Ultrasound Frequencies: Deep Body 1.5 to 3.0 MHzSuperficial Structures 5.0 to 10.0 MHze.g. 15 cm depth, 2 MHz, 60 dB round tripWhy not use a very strong pulse?Ultrasound at high energy can be used to ablate (kil
8、l) tissue.Cavitation (bubble formation)Temperature increase is limited to 1 C for safety.,12,Frequency Used in US Imaging,To have enough resolution for the observation of human organs, a frequency higher than 0.15 MHz , a wavelength less than 1.0cm, has to be used.Also the frequency will determine t
9、he depth of imaging, the lower the frequency, the big the depth will be.For abdominal imaging, a frequency between 1.0-3.0MHz has to be used.For eye examination, a frequency as high as 20 MHz is used.For IVUS imaging, 40 MHz is used.,13,History of the Development of Ultrasound (I),Karl Theodore Duss
10、ik, a neurologist/ psychiatrist from The University of Vienna, Austria was regarded as the first physician to have employed ultrasound in medical diagnosis: locate brain tumor and the cerebral ventricles by measuring the transmission of ultrasound beam through the skull in 1942.The earliest use of u
11、ltrasound is in therapy instead of diagnosis: Destroy the basal ganglia in patients with Parkinsonism (William Fry, Russell Meyers) Treatment of patients with rheumatic arthritis (Jerome Gersten, 1953),14,History of the Development of Ultrasound (II),Systematic investigations into using ultrasound a
12、s a diagnostic tool was made by George Ludwig, a physician at the Naval Research Institute in Bethseda, Maryland in the experiments on animal tissues using pulse-echo ultrasound. “SONICS-techniques for the use of sound and ultrasound in engineering and science” (Theodore Hueter, Richard Bolt) book p
13、ublished in 1954.,15,History of the Development of Ultrasound (III),After the Korean war, John Julian Wild and John Reid built a linear hand-held B-mode instrument and become the first publication on intensity-modulated cross-section ultrasound imaging.They also invented A-mode trans-vaginal and tra
14、ns-rectal scanning transducers in 1955.,16,History of the Development of Ultrasound (IV),The “Pan scanner” developed in 1957 by Douglass Howry at the University of Colorado, USA.Problem:Immerse totally or partially in water,17,History of the Development of Ultrasound (V),In 1962, the first commercia
15、lly available , hand-held articulated arm compound contact scanner was produced by engineers William Wright and Edward Meyerdink in USA.The work of Howry and his team is the most important pioneering work in B-mode ultrasound imaging and contact scanning that we have today.,18,Pulse-echo Ranging,App
16、lications:BatsSonar system Detects submarinesSONAR-Sound Navigation And Ranging.,19,2D Ultrasound Imaging,A-mode ultrasoundHorizontal axis is used to represent time while the vertical axis of the signal is to represent the amplitude of the signal.,20,2D Ultrasound Imaging,B-model ultrasound To use t
17、he brightness of the screen to display the amplitude of the signal. The greater the amplitude, the greater the brightness of the spot.,21,2D Ultrasound Imaging,B-model ultrasound scan: Sector scanLinear scanPPI (plan position indicator),Sector,Linear,PPI,22,M-mode ultrasoundAlso called Motion ultras
18、ound,23,2D Ultrasound Imaging,Doppler ultrasound,24,Ultrasound Doppler Transducer,25,Ultrasound Doppler Principle,26,Ultrasound Doppler Image,27,2D Ultrasound Machine,28,Ultrasound Imaging,Why use ultrasound? Low cost and portable system Safest imaging modality Fast, real-time imaging Suitability fo
19、r viewing the soft tissues and organs such as prostate, liver, heart, lung ,29,Limitations of 2D Ultrasound Imaging,2D technique must build the 3D image mentally leads to inaccuracy & variability leads to long proceduresSpatially flexible technique difficulties in reproducing same view difficulties
20、in patient follow-up difficulties in interventional procedures,30,3D Ultrasound: Side-fire scan,3D Reconstruction,31,Rotational Mover (Side-Fire),32,Parallel Scanning,33,3D Carotid US: Freehand scan,34,Scanning mode in 3D ultrasound,Mechanical scanning Parallel scanning Rotational scanning Fan scann
21、ing Random scanning, free hand scanning Real time 3D volume probe: 2D array transducer volume probe,35,Parallel scanning,36,Side-fire Scanning,37,Random scanning with a localization system,38,Intravascular Ultrasound Imaging,39,IVUS Catheter Configuration,40,The Analysis of IVUS Image,41,Angiography
22、 VS IVUS,42,Disease can only be identified by IVUS,43,The IVUS Catheter Usage in USA and World,44,IVUS Applications,45,Measurement of Plaque,46,4D IVUS,47,3D US application: fetus defect detection,Born infant,3D fetus image,48,49,3D Prostate Ultrasound Image by using transrectal transducer,50,Prosta
23、te Brachytherpy:Segmented prostate,51,Continuity Based 3D Prostate Segmentation in US Image,52,Needle Detection in 3D,53,Plaque segmentation:Carotid 3D US image,54,Volume of plaque: 964 mm3,Plaque segmented from the 3D US Carotid image,55,3D US Guided Breast Biopsy Apparatus,56,Interface used in our
24、 RF Ablation system,57,3D Rotational Scanning Probe,58,3D US Imaging System based on Rotational Scanning,59,Reconstruction comparison of pork liver：Sideview,Traditional method,Our method,60,Reconstruction comparison of pork liver：Topview,Traditional method,Our method,61,Water image acquired at three
25、 different times,62,Pin inserted into water at three different times,63,Pin segmented result,Before insertion,Detected pin,After insertion,64,3D Ultrasound Application: Prostate Brachytherapy,Prostate cancer is the second leading cause death of northern American menThe American Cancer Institute esti
26、mates 230,110 new case, 29,900 dead in 2004. Canadian Cancer Society estimates 20,100 new cases, 4,200 dead in 2004.Prostate cancer is curable at early stage.,65,Standard Treatments of Prostate Cancer,Watchful waiting:Most patients request or need treatment. Radical prostatecotomy: Gold standard but
27、 with significant morbidity, such as incontinence and impotence. External beam radiation, such as IMRT:Long treatment time, kill the normal tissue.Prostate brachytherapy: Short stay, safe for normal tissue,66,Brachytherapy Operation,67,Side-fire Scanned Transrectal Probe,68,Needle Tracking and Guida
28、nce Under 3D Ultrasound Imaging,Need to know where the needle is and where it will go.Determine the tip position of the needle.The processing has to be performed in real-time.,69,Oblique Needle Insertion,70,Why is Needle Segmentation in US Images Difficult?,Ultrasound image speckle & shadows Large 3
29、D image 357 326 352 1 byte = 40 MBHigh accuracy required Real-time processing (30 fps, or 33 ms per image),71,Motivation for Our 3D Needle Segmentation,Needle is conspicuous in a projected image.Line object can be reconstructed from two orthogonal projectionsApproximate needle insertion point and di
30、rection is known,72,Flowchart for our 3D Needle Segmentation,Steps 1 & 2,Step 3,Step 4,73,Step 1: Volume Rendering (Ray Casting),Cast rays through 3D image to image plane,Voxels,I n-1 , ,I 0,74,Step 1: Volume Rendering,Front-to-back ray tracing equations:Gray level distribution of needle voxels: Gau
31、ssian transfer functions:Luminance c ( I )Opacity ( I ),75,Example of Volume Rendering,With rendering,Without rendering,Agar phantom,76,Step 2: Volume Cropping,Complex background, large volumeEstimate needle position / orientation from a priori knowledge: Manual insertion Motorized mechanical device
32、 Localizing system (e.g. magnetic tracking)Simplifies background, reduces volume,Insertion point,Actual needle,Original volume,Cropped volume,Needle tip,Approximate needle,The cropped volume dimensions aredetermined from a priori knowledgeof the approximate insertion point, theapproximate needle dir
33、ection P, andthe maximum inserted needle length,78,(c) Cropped volume of (a),(b) Rendered result of (a),(d) Rendered result of (c),Effect of Volume Cropping & Rendering,(a) Original turkey breast image,79,Step 3: 2D Needle Segmentation,We used:Global thresholding + flood-filling algorithm for object
34、s with simple echogenicityReal-Time Hough Transform (RTHT) for objects with complex echogenicity,80,Step 4: 3D Needle Reconstruction,3D needle reconstruction is based on two orthogonal projections Both projection directions are chosen to be orthogonal to the approximate needle directionEach projecti
35、on is orthographic, i.e. the cast rays are parallel,81,3D NEEDLE RECONSTRUCTION,Actual needle,Approximate needle,Y,X,Z,R,Q,P,Two coordinate systems:(X, Y, Z) : 3D image (P, Q, R) : projection,P ,P,82,3D Needle Reconstruction,P,Q,R,2D needle direction,P,83,3D Needle Reconstruction Demo,84,Patient Pro
36、state Needle Segmentation,85,3D Needle Tracking in Agar,86,Prostate Segmentation in 3D Ultrasound Images,Motivation:The prostate boundary and volume are needed to assign the patient to the appropriate therapy.The volume of the prostate is required to determine the dosimetry distribution and radioact
37、ive seed locations.,87,Our Approach: Sliced Based3D Prostate Segmentation,Step 1,Step 3,Step 4,yes,no,Step 2,88,Step 1: 3D Image Re-slicing,Parallel re-slicing:Problem: At the ends, only a small portion of the prostate is visible.Rotational re-slicing:The prostate shapes and sizes in the re-sliced i
38、mages are similar.,89,3D Image Re-slicing,(a) Parallel re-slicing,(b) Rotational re-slicing,90,Step 2: Cardinal-Spline Initialization Model,Cardinal-spline:Why we chose the Cardinal-spline? No control points are needed, Easy to determine the spline coefficients, Passing through the initial points ex
39、actly, and The number of initial points can be varied.,91,Step 3: Contour Deformation,Refine the boundary in the initial 2D slice using DDC method (Lobregt, et al, A Discrete Dynamic Contour Model, IEEE Trans. MI, 14, 12-24, 1995) Extend 2D segmentation to 3D: Propagate the prostate contour in initi
40、al slice to an adjacent slice in both directions. Refine the contours and repeat contour propagation until all slices are segmented.,92,Step 4: 3D Prostate Reconstruction,Sliced based reconstruction: All 2D contours are represented by vertices 3D reconstruction using triangular mesh Prostate volume
41、calculation:where the prostate is composed of m faces, Fj ;Fj has area vector , at a representative vertex, .,93,3D Prostate Segmentation Demo,94,Seed Segmentation in 3D Ultrasound Images,Motivation: Calculate the dose distribution during or after the seed implantationChallenges: tiny dimension: 4.5
42、mm long cylinder with a diameter of 0.8mm. Low contrast Large number : 70-140,95,3D Prostate Ultrasound Image with Seeds,96,Thresholding Based on Tri-bar Projection Model,Pre-known information: Shape of seed Approximate orientation of the seedsTri-bar projection model : Project along the bar Calcula
43、te the average and the standard deviation in the projected image X axis Z axis Y axis,Y,Z,X,97,3D Agar-seed Ultrasound Image,3D image after rendering,Tri-bar segmentation,98,Seed Segmentation Demo,99,Patient Seed US Image Thresholding,Original projection,After thresholding,100,3D Ultrasound Application:Breast Biopsy,Agar phantom,Patient breast biopsy,101,Thank you!,
