Adding Sounds to Simulated Ultrasound Examinations
A system for performing audio-enhanced, simulated ultrasound examinations may generally include an ultrasound simulation device having at least one processor and associated memory. The memory may store pre-recorded audio-enhanced ultrasound data for at least one internal organ. The audio-enhanced ultrasound data may include a moving ultrasound image of the at least one internal organ along with synced audio data associated with auscultatory sounds generated by the at least one internal organ depicted within the moving ultrasound image. In addition, the system may include a display and a speaker coupled to the ultrasound simulation device. The display may be configured to display the moving ultrasound image as a trainee is performing the simulated ultrasound examination. The speaker may be configured to broadcast the synced audio data simultaneously with the display of the moving ultrasound image.
The present subject matter relates generally to simulated ultrasound examinations and, more particularly, to a system and method for performing simulated ultrasound examinations using audio-enhanced ultrasound data.
BACKGROUND OF THE INVENTIONWithout actually performing procedures often in patients, it is difficult for a health care worker, such as a physician, to maintain the high degree of skill needed to perform these procedures or to implement new methods, operations and procedures. In addition, there is currently no way for physicians to realistically evaluate different approaches to treatment options for patient-specific situations prior to actually performing the procedures or examinations on the patient.
Systems for simulating medical procedures have provided important training tools that allow physicians to develop skills that can be transferred to the operating room. Such systems allow health care workers to practice the delicate eye-hand coordinated movements needed to navigate medical devices while viewing scanned images of a patient's anatomy on a display screen. However, current systems fail to include the sounds necessary for suitable ultrasound training.
BRIEF DESCRIPTION OF THE INVENTIONAspects and advantages of the invention will be set forth in part in the following description, or may be obvious from the description, or may be learned through practice of the invention.
In one aspect, the present subject matter is directed to a system for performing audio-enhanced, simulated ultrasound examinations. The system may generally include an ultrasound simulation device having at least one processor and associated memory. The memory may store pre-recorded audio-enhanced ultrasound data for at least one internal organ. The audio-enhanced ultrasound data may include a moving ultrasound image of the at least one internal organ along with synced audio data associated with auscultatory sounds generated by the at least one internal organ depicted within the moving ultrasound image. In addition, the system may include a display and a speaker coupled to the ultrasound simulation device. The display may be configured to display the moving ultrasound image as a trainee is performing the simulated ultrasound examination. The speaker may be configured to broadcast the synced audio data simultaneously with the display of the moving ultrasound image.
In another aspect, the present subject matter is directed to a method for performing audio-enhanced, simulated ultrasound examinations. The method may generally include receiving, with a computing device, an indication that a simulated ultrasound examination is to be performed, wherein the simulated ultrasound examination is associated with an internal organ. In addition, the method may include displaying a moving ultrasound image of the internal organ and broadcasting synced audio data simultaneously with the display of the moving ultrasound image, wherein the audio data corresponds to auscultatory sounds generated by the internal organ depicted within the moving ultrasound.
Other exemplary aspects of the present disclosure are directed to devices, systems, and methods for performing simulating ultrasound examinations.
These and other features, aspects and advantages of the present invention will become better understood with reference to the following description and appended claims. The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention.
A full and enabling disclosure of the present invention, including the best mode thereof, directed to one of ordinary skill in the art, is set forth in the specification, which makes reference to the appended figures, in which:
Reference now will be made in detail to embodiments of the invention, one or more examples of which are illustrated in the drawings. Each example is provided by way of explanation of the invention, not limitation of the invention. In fact, it will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the scope or spirit of the invention. For instance, features illustrated or described as part of one embodiment can be used with another embodiment to yield a still further embodiment. Thus, it is intended that the present invention covers such modifications and variations as come within the scope of the appended claims and their equivalents.
In general, the present subject matter is directed to systems and methods for performing simulated ultrasound examinations using audio-enhanced ultrasound data. Specifically, in several embodiments, initial ultrasound data may be collected from actual patients or other human subjects using an ultrasound unit, together with a unidirectional microphone, to observe and examine the functioning of an internal body part, such as an internal organ. For example, the ultrasound unit and associated microphone may be used to collect a moving ultrasound image of a patient's heart along with the auscultatory sounds simultaneously generated by the heart. The resulting audio file and video image(s) produced during the examination may then be combined (e.g., using a digital recorder) to generate a moving ultrasound image(s) with accompanying, fully synched, audio sound of the examined heart.
The audio-enhanced ultrasound data collected during actual ultrasound examinations may then be utilized as a training/learning tool during the performance of manikin-based ultrasound simulations. For example, the audio-enhanced ultrasound data may be stored within an ultrasound simulation device used to facilitate the performance of simulated ultrasound examinations. In such instance, as the trainee conducting the simulated examination moves the associated ultrasound probe to a location on the manikin's body at which a given internal organ would otherwise be located within a patient, the audio-enhanced ultrasound data associated with such internal organ may be displayed/broadcasted to the trainee. Specifically, the moving ultrasound image(s) of the functioning internal organ may be displayed on a display associated with the ultrasound simulation device while the synced audio may be simultaneously broadcast via a speaker(s) associated with the ultrasound simulation device. As a result, an improved, more realistic learning experience may be provided to the trainee that allows for enhanced instruction regarding the physiologic and pathophysiologic functions of human organs, the use of clinical ultrasound as an aid in diagnosis and treatment and the required methodology to become competent in the application of ultrasound technology when conducting a physical exam.
It should be appreciated that, although the present subject matter will be described herein with reference to the performance of simulated ultrasound examinations using manikins, the audio-enhanced ultrasound data described herein may generally be utilized with any suitable type of ultrasound learning or training, including computer simulations performed on a given computing device (e.g., a desktop, laptop, tablet, smartphone, etc.) without the use of manikin and recorded simulations displayed to the trainee via any suitable video format (e.g., a DVD).
Referring now to
As shown in
It should be appreciated that, in several embodiments, the ultrasound probe 108 used to perform the simulated ultrasound examination may correspond to an actual ultrasound probe configured to be used with any suitable clinical ultrasound unit. Alternatively, the ultrasound probe 108 may correspond to any other suitable object that can be held by the trainee during the performance of the simulated ultrasound examination. For instance, in one embodiment, the ultrasound probe 108 may correspond to a handheld device that is capable of detecting its location relative to the manikin 110 (e.g., by being configured to receive signals from suitable positioning devices implanted within or otherwise associated with the manikin 110). In such an embodiment, the ultrasound probe 108 may be configured to transmit suitable signals to the ultrasound simulation device 102 corresponding to the specific location of the probe 108 relative to the manikin 110. The ultrasound simulation device 102 may then determine which audio-enhanced ultrasound data to display/broadcast to the trainee base on the position of the probe 108.
As an alternative to determining which audio-enhanced ultrasound data to display/broadcast based on signals received from the ultrasound probe 108, the ultrasound simulation device 102 may be configured to select the appropriate data to output based on any other suitable input signal or means. For instance, the trainee may indicate that he/she desires to perform a simulated ultrasound examination on a particular organ by providing a suitable input to the ultrasound simulation device 102 (e.g., by using an input device(s) coupled to the ultrasound simulation device 102, such as a keyboard 112, a mouse or any other suitable input device). The ultrasound simulation device 102 may then display/broadcast the audio-enhanced ultrasound data associated with the internal organ selected based on the trainee's input(s).
Referring now to
In several embodiments, the ultrasound simulation device 102 may correspond to any suitable processor-based device known in the art, such as a computing device or any suitable combination of computing devices. Thus, as shown in
As shown in
It should be appreciated that, in several embodiments, audio-enhanced ultrasound data may be stored within the memory device(s) 122 of the ultrasound simulation device 102 that is associated with a plurality of different internal organs. For example, audio-enhanced ultrasound data may be obtained from actual ultrasound examinations performed on a patient's heart, lungs, bowels, blood vessels and/or any other suitable internal organ. In such instance, each recording made of a given internal organ may be stored within the memory device(s) 122 as separate data file, with each data file including a moving ultrasound image(s) of the examined organ together with its synced audio data.
It should also be appreciated that a plurality of different data files may be stored within the memory device(s) 122 for a given internal organ. For instance, audio-enhanced ultrasound data associated with a particular organ may be collected from a plurality of patients having differing medical conditions. In such instance, the audio-enhanced ultrasound data collected from the patients may be selected for inclusion within the ultrasound simulation device 102 based on its ability to assist the trainee in recognizing and diagnosing specific medical conditions. For instance, a plurality of different data files associated with examinations of a human heart may be stored within the memory device(s) 122, with each data file including visual and/or audible evidence of a specific medical condition. As a result, a trainee may, for example, be exposed to multiple different medical conditions for each internal organ being examined, thereby enhancing the overall learning experience for the trainee.
Additionally, it should be appreciated that, as an alternative to the collecting the audio-enhanced ultrasound data from actual ultrasound examinations, all or a portion of such data may be computer-generated. For example, in one embodiment, an actual moving ultrasound image of a given internal organ may be combined with computer-generated audio that mimics the sound generated by the organ.
Referring still to
As indicated above, the ultrasound simulation device 102 may generally be configured to output audio-enhanced ultrasound data associated with a given internal organ via the display 104 and associated speaker(s) 106. Specifically, when the trainee desires to perform a simulated ultrasound examination on a particular organ, the ultrasound simulation device 102 may be configured to output a moving ultrasound image of the organ for presentation on the display 104 while simultaneously broadcasting the associated auscultatory sounds via the speaker(s) 106, thereby allowing the trainee to perform both a visual and audible examination on the organ.
Additionally, as shown in
Moreover, the ultrasound simulation device 102 may also be coupled to any other suitable input device(s) 126. For example, as indicated above, in one embodiment, the ultrasound probe 108 used to perform the simulated ultrasound examination may be communicatively coupled to the ultrasound simulation device 102. In such an embodiment, the ultrasound probe 108 may be configured to transmit input signals to the ultrasound simulation device 102 associated with the position of the probe 108 relative to the manikin 110. For instance, the ultrasound probe 108 may transmit a signal to the ultrasound simulation device 102 indicating that the probe 108 is positioned directly over the manikin 110 at a location corresponding to the location of a human liver. In such instance, the ultrasound simulation device 102 may then output a moving ultrasound image of a liver together with its synced audio data.
It should be appreciated that the various components shown in
Referring now to
As shown in
Additionally, at (204), the method 200 includes receiving an indication that a simulated ultrasound examination of a particular internal organ is to be performed. In general, the ultrasound simulation device 102 may be configured to receive any suitable input signal providing an indication that a trainee desires to perform a simulated ultrasound examination. For example, in one embodiment, the indication may correspond to an input signal provided by the trainee (e.g., via a keyboard, mouse or any other suitable input device) that instructs the ultrasound simulation device 102 to open a particular software program stored on the device 102 that allows for the performance of simulated ultrasound examinations. Alternatively, the indication may correspond to an input signal provided by the trainee that instructs the ultrasound simulation device 102 to initiate a simulated ultrasound examination. For instance, the trainee may provide an input signal instructing the device 102 to initiate a simulated ultrasound examination for a particular organ, such as by using a keyboard or mouse coupled to the ultrasound simulation device 102 to select an organ to be examined. In another embodiment, such input signal may derive from the ultrasound probe 108 that is to be used to perform the simulated ultrasound examination. For example, the trainee may place the ultrasound probe 108 at a particular location on the manikin 110 in order to indicate to the ultrasound simulation device 102 that a simulated ultrasound examination of the organ associated with the selected location on the manikin 110 is desired to be performed.
Referring still to
In addition, at (208), the method 200 includes broadcasting synced audio data of the internal organ simultaneously with the display of the moving ultrasound image. Specifically, as indicated above, the ultrasound simulation device 102 may be communicatively coupled to a speaker(s) 106 configured to output audio associated with the auscultatory sounds generated by the organ depicted in the moving ultrasound image as such ultrasound image was being initially being recorded. As a result, by simultaneously broadcasting the synced audio data with the displayed ultrasound image, the trainee may be allowed to conduct both a visual and audible examination of the associated internal organ.
It should be appreciated that, although the present subject matter has generally been described herein with reference to performing simulated ultrasound examinations on internal organs by combining moving ultrasound images of the organs together with their synced audio data, the disclosed system 100 and method 200 may generally be used to perform any suitable simulated ultrasound examination. For example, recordings of vascular sounds, fetal sounds, and/or the like may be combined with their corresponding moving ultrasound images to produce audio-enhanced ultrasound data, which may then be used during the performance of a simulated ultrasound examination. It should be also be appreciated that, in addition to simulated ultrasound examinations on humans, the disclosed system 100 and method 200 may also be utilized to perform audio-enhanced, simulated ultrasound examinations on animals.
This written description uses examples to disclose the invention, including the best mode, and also to enable any person skilled in the art to practice the invention, including making and using any devices or systems and performing any incorporated methods. The patentable scope of the invention is defined by the claims, and may include other examples that occur to those skilled in the art. Such other examples are intended to be within the scope of the claims if they include structural elements that do not differ from the literal language of the claims, or if they include equivalent structural elements with insubstantial differences from the literal languages of the claims.
Claims
1. A system for performing audio-enhanced, simulated ultrasound examinations, the system comprising:
- an ultrasound simulation device configured to assist in the performance of a simulated ultrasound examination, the ultrasound simulation device including at least one processor and associated memory, the memory storing audio-enhanced ultrasound data for at least one internal organ, the audio-enhanced ultrasound data including a moving ultrasound image of the at least one internal organ along with synced audio data, the synced audio data including auscultatory sounds generated by the at least one internal organ depicted within the moving ultrasound image;
- a display coupled to the ultrasound simulation device, the display being configured to display the moving ultrasound image as a simulated ultrasound examination is performed; and
- a speaker coupled to the ultrasound simulation device, the speaker being configured to broadcast the synced audio data as the simulated ultrasound examination is performed.
2. The system of claim 1, wherein the audio-enhanced ultrasound data includes moving ultrasound images and corresponding synced audio data for a plurality of different internal organs.
3. The system of claim 1, wherein the at least one internal organ comprises a first internal organ, wherein the audio-enhanced ultrasound data includes a plurality of different moving ultrasound images for the first internal organ along with synced audio data associated with the auscultatory sounds generated by the first internal organ within each moving ultrasound image.
4. The system of claim 3, wherein each corresponding pair of moving ultrasound images and synced audio data contains at least one of visual evidence or audible evidence of a different medical condition associated with the first internal organ.
5. The system of claim 1, wherein the at least one internal organ comprises a heart.
6. The system of claim 1, wherein the at least one internal organ comprises at least one of a heart, a lung or bowels.
7. The system of claim 1, further comprising an ultrasound probe.
8. The system of claim 7, wherein the ultrasound probe is coupled to the ultrasound simulation device, the ultrasound probe being configured to transmit signals to the ultrasound simulation device associated with a position of the ultrasound probe relative to an associated manikin.
9. The system of claim 1, wherein at least a portion of the audio-enhanced ultrasound data is computer-generated.
10. A method for performing audio-enhanced, simulated ultrasound examinations, the method comprising:
- receiving, with a computing device, an indication that a simulated ultrasound examination is to be performed, the simulated ultrasound examination being associated with an internal organ;
- retrieving, with the computing device, audio-enhanced ultrasound data for the internal organ, the audio-enhanced ultrasound data including a moving ultrasound image of the internal organ along with synced audio data, the synced audio data including auscultatory sounds generated by the internal organ depicted within the moving ultrasound image;
- transmitting, with the computing device, the moving ultrasound image for display as the simulated ultrasound examination is being performed; and
- transmitting, with the computing device, the synced audio data for broadcast as the simulated ultrasound examination being performed,
- wherein, when the moving ultrasound image is displayed and the synced audio data is simultaneously broadcast as the simulated ultrasound examination is being performed, the auscultatory sounds generated by the internal organ depicted within the moving ultrasound image are synchronized with the associated movements of the internal organ as displayed.
11. The method of claim 10, further comprising receiving the audio-enhanced ultrasound data for storage within memory of the computing device.
12. The method of claim 10, wherein at least a portion of the obtained audio-enhanced ultrasound data is computer-generated.
13. The method of claim 10, wherein the audio-enhanced ultrasound data includes moving ultrasound images and corresponding synced audio data for a plurality of different internal organs.
14. The method of claim 10, wherein the audio-enhanced ultrasound data includes a plurality of different moving ultrasound images for the internal organ along with synced audio data associated with the auscultatory sounds generated by the internal organ with each moving ultrasound image.
15. The method of claim 11, wherein each corresponding pair of moving ultrasound images and synced audio data contains at least one of visual evidence or audible evidence of a different medical condition associated with the internal organ.
16. The method of claim 10, wherein the simulated ultrasound examination is being performed using an ultrasound probe with an associated manikin, further comprising receiving, with the computing device, input signals from the ultrasound probe associated with a position of the ultrasound probe relative to the manikin.
17. The method of claim 10, wherein the at least one internal organ comprises at least one of a heart, a lung or bowels.
18. The method of claim 10, further comprising displaying the moving ultrasound image on a display coupled to the computing device.
19. The method of claim 10, further comprises broadcasting the synced audio data with a speaker coupled to the computing device.
Type: Application
Filed: Nov 28, 2018
Publication Date: Mar 28, 2019
Inventors: Richard Hoppmann (Columbia, SC), Debra Krotish (Blythewood, SC), Michael S. Riffle (Swansea, SC), Victor Rao (Columbia, SC), Stephen Harris (Cayce, SC), Duncan Howe (Hopkins, SC), Mary Elizabeth Poston (Columbia, SC)
Application Number: 16/202,292