[ 0035 ] fig1 illustrates a process using an ultrasound ( us ) system of the type that is commonly used for ultrasound imaging of internal organs such as the heart but is modified so it can be used in an mri environment . for example , any part of the us system that can generate radio frequency ( rf ) interference with the mri system is suitably shielded electrically to prevent undesirable rf emissions , and any part of the us system that could be undesirably affected by the mri &# 39 ; s magnetic field is made of non - magnetic materials and / or is suitably shielded magnetically . the us system is used as is conventional with such systems to form us images of the heart at a position and orientation in a defined coordinate system that matches that of the mri system . using known edge detection algorithms and , if needed , a designation by an operator of a point or line on an us image displayed on a monitor , a suitably programmed computer processes the us images to detect the position of a relevant portion of the heart essentially in real time . for example , the instantaneous position of a particular coronary artery might be of interest in a given case , and this is what the computer tracks through the real time us images . in other cases , the position of a point or area on the heart wall may be of interest , and this is what is tracked through the us images . positional information derived from tracking through the us images is provided to the mri system , for example to serve in making relevant changes in the mri pulse sequence that is used , in order to make sure that the mri system acquires mri data from a volume that includes the tracked portion of the heart , despite motion of that portion relative to the mri magnet and coils . stated differently , the mri parameters are changed essentially in real time such that the portion of the heart that is of interest in the given case and the mri coils involved in the collection of mri data appear to be fixed relative to each other despite the heart motion . the flow chart of fig1 illustrates steps in this process in an appropriate sequence , showing that the position data from an us image derived in step a is used to alter an mri pulse sequence accordingly , and after step f another us image is used for more changes in the mri pulse sequence to take into account the newly us - imaged position of the heart portion of interest . the position information obtained through the us measurements or imaging in step c in fig1 can be used for one or more of : ( 1 ) changing the position of the mi imaging volume so it includes the organ portion of interest despite positional changes of that organ portion relative to the mr magnet ; ( 2 ) rejection mi signals if heart contraction occurs and is detected through the us system ; ( 3 ) rejecting mri data if the organ portion of interest has moved outside a desirable range in position ; and ( 4 ) changing the phase of the mri signal . in fig2 an us probe that can comprise one or more us transducers is acoustically coupled with the body of a person in an mri scanner . the us probe measures parameters such as the position , orientation , velocity and / or morphological changes in an organ of interest such as the heart of some other organ , using known us methods and edge designation and detection methods . information related to the parameters measured with the us probe in real time is delivered at unit a to a computer that processes it to make it useful for altering mri parameters in a way to essentially remove the effect of motion of the heart or other organ of interest on the mri image . in response to this information regarding changes in mri parameters , unit a sends appropriate mri control parameters to the mri system to effectively maintain the imaging volume at the moving organ of interest . in addition , mri parameters and / or mri data can be used at unit b to control the us probe and / or us system , for example to generate an us image at a time matching an mri pulse sequence of some other mri event or parameter . in fig3 a number of us probes p 1 through pn are acoustically coupled with a biological structure ( e . g ., a patient ) in an mri scanner and provide us information to a us data processing device that is coupled with or integrated with an mri control computer . this device / computer responds to the us information from the probes to control the mri scanner , and the mri scanner in turn provides mri data acquisition signals and / or gating timing to the same device / computer for processing into mri images and / or control purposes . in fig4 a number of us probes p 1 through pn are acoustically coupled with a body in an mri scanner and each is coupled in two way communication with a respective us device to receive controls therefrom and to provide us data from the body thereto . the us devices can be known devices that control us transducers and process us data for us imaging or other purposes , and they in turn provide information based on the input thereto from the us probes to a computer that converts it to information for controlling mri parameters . this information is supplied to an mri hardware control that in turn supplies control signals to the mri scanner to control its operation such that the active mri imaging volume tracks the motion of the organ of interest essentially in real time . in fig5 a , an mri scanner 1 illustrated in cross - section has a patient table 2 supporting a person 3 whose heart 4 is being imaged with an us probes 5 and 6 that can emit fan beams of us energy in direction perpendicular to each other or at some other angle to each other . a spacer such as a soft gell bag can acoustically couple the us probes to the person . fiber optic cables 8 can connect the probes to the outside to deliver information from and to the probes , and power can be supplied to the probes through suitably shielded connections . an rf filter 9 can be used to reduce rf interference with the mri scanner . mechanical arms 10 can couple the probes to the mri scanner to follow the motion and orientation of the probes relative to the scanner , or some other system , such as an acoustical or optical tracking system , can be used to provide information regarding the current position and orientation of the probes . this position and orientation information is used to ensure that the beams of us energy and the mri volume of interest match in space so that the us information can be used to guide the mri data acquisition such that it acquires data from the same portion of the same organ despite relative motion between the magnet and the organ . in fig5 b , which connects to the illustration of fig5 a through the same rf filter , as illustrated , us devices a process the us data from probes 5 and 6 and provide us image information to create and display a respective image from each probe at a display device b and / or to provide signals directly to an edge detection computer program or device c . information regarding the current position of an organ of interest derived from the us information by program or device c , such as displacements of the organ of interest in space and velocities of such displacements , is supplied to mri control programs or devices d that in response generate altered scan parameters such as gradient coil controls and rf pulse controls that ensure that the mri imaging volume tracks the moving organ of interest . the us derived parameters provided by program or device c can include parameters describing displacement of the organ of interest ( e . g ., δx . δy , δz ), velocity information regarding movement of the organ of interest ( e . g ., v x , v y , v z ), and / or position information regarding the organ of interest . in fig6 the heart motion of a patient between two us measurement is designated by the vector δr and the corresponding altered mri scan parameters are illustrated at the right hand side as frequency changes δf 1 and delta δf 2 for the 90 ° and 180 ° rf pulses of an mri pulse sequence . these frequency changes change the position in space of the mri imaging volume by the same vector δr to track the position of the heart with the mri scan volume . the letters a through d designate successive us images , where the heard displacement δr is the displacement from one of these images to the next . the displacement of an mr the imaging volume of interest is illustrated as the change from the solid lines to the dash lines at upper right in fig6 . [ 0044 ] fig7 illustrates an mri system in which us probes p 1 through pn are tracked with laser beams from emitters secured to the mri scanner so that the positions and orientations of the us probes can be determined in real time relative to the mri scanner as the probes may move in space , for example if they are directly coupled with a patient and breathing motion moves the probes relative to the mri scanner . the us probe positions are tracked with laser position monitors which update the reference frames of the probes in a computer in the illustrated us device to which the us probes are connected . in fig8 us data and mri data are recorded during mri data acquisition and then decisions are made based on the us data to accept or reject mri data for mri image reconstruction . the accepted mri data are used in further processing for image reconstruction . as illustrated , us and mr data of a patient body are acquired concurrently , with one or more us probes whose position relative to the mri magnet and hardware is tracked via a probe holding device . the us data is initially processed at an us device and then delivered to the mri computer , which also receives the mr data from the same patient . both the us data and the mri data are stored , keeping track of temporal correspondence therebetween . the us signal that is stored can be one or both of us images taken at respective times or other us measurements that relate to positions of the relevant patient organ at different times . if a selected range of acceptable positions of the body organ of interest relative to the mr magnet are preset , the us signal can be processed to mark us signals acquired when the body organ is outside the expected positional range . in fig8 these us signals are marked with the symbol “*” and correspond in time to respective mri signals . those mri signals can be disregarded when using ft or some other method to form an mr image from the stored mri data . in fig9 us and mri data from a body ( a patient ) also are acquired and recorded , preferably concurrently , using an mri scanner and one or more us probes as earlier discussed . the us data is evaluated in the illustrated us device and / or mri computer for a displacement vector δr , which in turn is used to modify the phase and / or amplitude of the mri data acquired at or near the time of a corresponding us image or set of us data , using the illustrated mri computer . the modified mri data is used to reconstruct an mri image . as illustrated , if the heart is the organ of interest , us images of the heart are obtained in time intervals t 1 , t 2 , t 3 , . . . , t n and corresponding mri signals are acquired in the same time intervals . the us data can be used to image the heart in each of the data acquisition time intervals . if the center of each us image is identified with the marker “+” and the distance from this marker to a selected portion of the heart is measured as the displacement vector δr , a phase shift and / or an amplitude modulation of the time - related mri data can be carried out , and the so - shifted or modified mri data can be used to reconstruct one or more mri images using known reconstruction algorithms . in fig1 , us data is used to guide an mri scanner during multiple breath holding periods of k - space data acquisition . in this example , the position of the diaphragm is measured in the us image in each breath holding interval . the displacement vector δr representing displacement of the diaphragm between breath holding periods is used to alter parameters in the mri control computer , which in turn alter the location of other features of subsequent mri signals . as illustrated in this example , a patient is in an mri magnet and one or more us probes measure the location of a selected part of the patient &# 39 ; s diaphragm with respect to a reference fixed relative to the magnet . the us data is delivered to the illustrated us device , which produces an us image for each breath holding interval during which mri data is acquired . two such breath - hold images are illustrated — b . h . 1 and b . h . 2 . as illustrated by the respective arrows in each us image , the patient &# 39 ; s diaphragm is at a different positions , displaced by a displacement vector δr from one image to the other . the δr displacement information is delivered to the illustrated mri control computer , which calculates and implements corresponding corrections δg , δφ , and δrf in the magnetic gradients , phase and radio frequency pulses such that the mr imaging volume is at the correct position in space in the magnet to image the organ of interest in each breath holding period , or to repeat the mri signal . in fig1 , us and mri data are concurrently acquired . resulting us and mri images are fused into a composite image . as illustrated , a body is in an mri scanner , on a suitable patient table , and one or more us probes are used to derive information for one or more us images while the mri scanner is used to derive data for one of more mr images . the illustrated us device produces the desired image ( s ) while the illustrated mri computer produces the desired mr image ( s ). the two types of images are fused ( combined ) into a single displayed image , in a display device provided with toggling capability so that the user has the choice of viewing the combined image or either of the mr and us images . while specific examples have been illustrated above , it should be clear that many more examples will be apparent to those skilled in the art than utilize the disclosed approaches and principles and that features of one or more of the examples discussed above can be combined with features of others of those examples , and that many currently known or developed in the future processes and equipment can be used in carrying out the invention defined by the appended claims as they may be revised and clarified in prosecution of this patent application .
a process and system acquiring both ultrasound and mri data from a patient in an mri scanner and using one to automatically guide or improve the other . the ultrasound data can track the motion of an organ such as a cardiac artery or the diaphragm and the resulting motion information can automatically guide mri data acquisition to keep the imaging volume at the organ or interest , or can be used to accept or reject mri data in the process of forming an mri image , based on whether the organ of interest was within an acceptable range of positions . conversely , the mri unit can guide the ultrasound data acquisition so it is properly timed or otherwise controlled in accordance with mri data acquisition .