MEDICAL INFORMATION PROCESSING APPARATUS AND MEDICAL INFORMATION PROCESSING METHOD
A medical information processing apparatus includes processing circuitry configured to acquire status information indicating a status of a plurality of medical devices connected to each other via a network and/or a status around the plurality of medical devices, generate, based on the status information, operation information indicating an operation to be performed on the medical device, and control a display unit so as to display the generated operation information.
Latest Canon Patents:
- PROCESSING APPARATUS AND PROCESSING METHOD
- MEDICAL INFORMATION PROCESSING DEVICE, MEDICAL INFORMATION PROCESSING METHOD, AND STORAGE MEDIUM
- CELL CULTURE APPARATUS AND CELL CULTURE METHOD
- TRANSPORT RACK, AUTOMATIC ANALYZING APPARATUS, AND AUTOMATIC ANALYZING SYSTEM
- CELL CULTURE APPARATUS AND CELL CULTURE METHOD
This application is based upon and claims the benefit of priority from the prior Japanese Patent Application No. 2022-184219, filed on Nov. 17, 2022, the entire contents of which are incorporated herein by reference.
FIELDEmbodiments disclosed in the present specification and drawings relate to a medical information processing apparatus and a medical information processing method.
BACKGROUNDIn the case of performing an inspection using a medical device such as an X-ray computed tomography (CT) device, semi-automation has been advanced in order to enhance inspection efficiency and perform inspection with high reproducibility. In addition, remote operation of the medical device via a communication network is also in progress.
With such a change in an inspection method, it is considered that a user (an operator) of the medical device, such as a radiographer, remotely operates a plurality of medical devices alone. However, it is significantly difficult for one user to perform the inspection of a plurality of medical devices in parallel.
Hereinafter, an embodiment of a medical information processing apparatus will be described with reference to the drawings. The embodiment described below is configured as a system including a plurality of devices, i.e., a server and a terminal, but the embodiment is not limited to this. That is, the medical information processing apparatus according to the embodiment may be configured as a single device that includes the functions of the server in the terminal. It is noted that, in the following description, components having substantially the same functions and configurations are denoted by the same reference numerals, and redundant description will be made only when necessary.
A medical information processing apparatus 1 according to an embodiment is configured to be able to collectively manage a plurality of medical devices connected via a communication network. In addition, as described later, the medical information processing apparatus 1 is configured to automatically select a medical device to be operated by a user (an operator) and a medical process (hereinafter, also simply referred to as “process”) to be executed by the medical device, and to present the medical device and the process to the user.
The medical information processing apparatus 1 is configured to acquire status information indicating a status of a plurality of medical devices and/or a status around the plurality of medical devices and to present, to the user (operator), operation information generated based on the status information. The operation information indicates an operation to be performed on the medical device. Here, the “operation” that the user performs on the medical device may include not only (direct) operations on the medical device but also operations performed via the medical device. As an example of the latter, the user may instruct (operate) a local staff working in a room with a medical device by having a display on the medical device show an operation to be performed by the local staff (e.g., moving a patient).
In addition to the status information, the medical information processing apparatus 1 may also acquire information being fed back or notified to the user from the local staff and/or an operating instruction from the local staff. In this case, the operation information may be generated based on the acquired information and/or the operating instruction.
As illustrated in
The server 10 generates a medical operations execution plan based on various types of information to be described later. The medical operations execution plan is a plan for executing a plurality of workflows related to medical operations in parallel using the plurality of medical devices 31, 32, and 33.
The terminal 20 is a terminal operated by a user U (a radiographer or the like) who remotely operates the plurality of medical devices 31, 32, and 33. The terminal 20 is disposed in an operation room for operating the plurality of medical devices 31, 32, and 33. For example, the terminal 20 is disposed in a centralized support center existing in a place remote from the medical devices 31, 32, and 33. It is noted that the plurality of medical devices 31, 32, and 33 may be disposed in a plurality of rooms (inspection rooms) in one hospital respectively, or may be disposed in a plurality of hospitals respectively.
The medical devices 31, 32, and 33 are X-ray computed tomography devices (CT devices) in the present embodiment. It is noted that the medical device may be another inspection device such as a magnetic resonance imaging device (an MRI device), an X-ray diagnostic device, a positron emission tomography (PET) device, or an ultrasonic diagnostic device. In addition, the medical device is not limited to the inspection device, and may be a device for treatment (such as a surgical robot).
Although not illustrated herein, the medical information processing apparatus 1 may include an electronic medical record system, a reconstruction server that reconstructs a diagnostic image from imaging data, a picture archiving and communication system (PACS; a medical image management system), and the like. In addition, the medical information processing apparatus 1 may include a camera of a room in which the medical device is installed, a shared monitor of an inspection waiting room, and the like.
As illustrated in
The memory 11 is connected to the processing circuit 15 and stores various types of information (for example, CT image data acquired from the reconstruction server or the PACS) used in the processing circuit 15. The memory 11 is implemented by, for example, a random access memory (RAM), a semiconductor memory element such as a flash memory, a hard disk, an optical disk, or the like.
Furthermore, the memory 11 stores various programs necessary for the processing circuit 15 to execute each function, various data processed by the programs, and the like. It is noted that the various types of data handled in the present specification are typically digital data.
The display 12 includes, for example, a liquid crystal display, a cathode ray tube (CRT) display, or the like. The input interface 13 receives various input operations, converts the received input operations into electrical signals, and outputs the electrical signals to the processing circuit 15. The input interface 13 is implemented by, for example, a mouse, a keyboard, a touch panel, a button, a trackball, a manual switch, a foot switch, a joystick, or the like. It is noted that, when the server 10 and the terminal 20 are integrated with each other, the display 12 and the input interface 13 function as the display 22 and the input interface 23 of the terminal 20.
The communication interface 14 implements various communication protocols according to a form of an in-hospital network. The communication interface 14 implements communication with other systems and devices via the in-hospital network according to the various communication protocols. In the present embodiment, the server 10 is connected to the in-hospital network via the communication interface 14, and communicates with the terminal 20 and the medical devices 31, 32, and 33. Furthermore, the server 10 communicates with other systems and devices such as the electronic medical record system and the PACS as necessary.
The processing circuit 15 is a calculation circuit that performs various calculations and controls the operation of the server 10. The processing circuit 15 generates the medical operations execution plan based on the workflow allocated to the medical devices 31, 32, and 33. In addition, the processing circuit 15 generates information to be displayed on the terminal 20 based on information (a CT image and the like) acquired from the medical devices 31, 32, and 33, the reconstruction server, and the like, and transmits the generated information to the terminal 20.
In order to implement such a function, as illustrated in
In the present embodiment, each processing function executed by a corresponding one of the information acquisition function 15a, the medical operations execution plan generation function 15b, and the screen data generation function 15c is stored in the memory 11 in the form of a program executable by a computer. The processing circuit 15 is a processor, and implements a function corresponding to each program by reading and executing the program from the memory 11. In other words, the processing circuit 15 in a state of reading each program has each function indicated in the processing circuit 15 of
It is noted that
Next, details of each processing function will be described.
The information acquisition function 15a acquires various types of information. For example, information on the workflow allocated to the medical devices 31, 32, and 33 is acquired from the electronic medical record system or the like. In addition, the information acquisition function 15a acquires various types of information (device screen information and the like) from the medical devices 31, 32, and 33 and the PACS. Furthermore, the information acquisition function 15a may acquire information photographed by a camera provided in a room (an inspection room, a diagnostic room, a treatment room, an operating room for surgery or the like) in which the medical device is installed, biological information (pulse, body temperature, and the like) obtained from an inspection device attached to a patient, and specimen inspection result information such as a blood gas inspection, central inspection, and inspection of a respiratory rate.
The information acquisition function 15a acquires status information indicating a status of the medical devices 31, 32 and 33 and/or a status around the medical devices 31, 32, 33. The information acquisition function 15a functions as a status information acquisition unit. The information indicating status of the medical devices 31, 32 and 33 is, for example, information indicating an operating status or an operating phase (e.g., whether an inspection has been completed or not) of the medical devices 31, 32 and 33. The information indicating status around the medical devices 31, 32 and 33 is, for example, an image showing state of a room where the medical device 31, 32 or 33 is installed, the image being captured by a camera installed in the room.
The information acquisition function 15a also acquires workflow information indicating a plurality of medical processes executed in parallel on the plurality of medical devices 31, 32 and 33. The workflow information may be obtained from the medical operations execution plan. In this case, the operation information may be generated based on the workflow information and the status information.
The medical operations execution plan generation function 15b generates a medical operations execution plan for executing a plurality of workflows in parallel using the plurality of medical devices 31, 32, and 33. As illustrated in
The timing specification function 151 specifies, for each of the plurality of workflows, a timing at which a process of a certain medical device can transition to a process of another medical device. For example, in a case where the medical device is a CT device, the timing specification function 151 specifies, as a transitionable timing, each of a timing before main scanning is performed, a timing at which main scanning is in progress, and a timing after post-processing is completed. Details of a timing specification method will be separately described.
The time calculation function 152 calculates a process execution time of each process included in the plurality of workflows and a grace time between processes. The process execution time is a time required for executing the process. The grace time between the processes is a time allowed until the user returns to a work of a first medical device after leaving the work of the first medical device in a case where a process of the first medical device transitions (moves) to a process of a second medical device.
For example, the time calculation function 152 calculates the process execution time and the grace time based on at least one of performance information of the medical devices 31, 32, and 33, patient individual information, characteristic information of the user, and a protocol. In a case where the medical devices 31, 32, and 33 are CT devices, the performance information of the medical devices includes an imaging time, a reconstruction time, and the like for each plan, and the patient individual information is a past inspection or a treatment record of a patient and includes an imaging time in the past inspection, a time required for post-processing, and the like. The characteristic information of the user is characteristic information of a technician or the like who operates the medical device, and includes information such as a proficiency level, an operation speed, a preference, and the like with respect to the medical device. The proficiency level may be, for example, information evaluated for each inspection, each portion, and each device. The operation speed may be learned from past operation results. The user preference is information such as a preference regarding a transition speed (fast/normal/slow) of the process. It is noted that the patient individual information and the user characteristic information may be acquired from the server (the PACS or the like). The protocol is, for example, an imaging protocol of the CT device. The imaging protocol may be estimated from inspection contents by the medical device.
The operation order determination function 153 determines an operation order for the user to sequentially operate the plurality of medical devices 31, 32, and 33 based on the calculated process execution time and grace time, and the specified timing. According to the determined operation order, when the user sequentially operates the plurality of medical devices 31, 32, and 33, a plurality of workflows can be executed in parallel by the plurality of medical devices. Details of an operation order determination method will be separately described with reference to
The screen data generation function 15c generates screen data (display information) for displaying, on the display of the terminal 20, the information acquired by the information acquisition function 15a and the information generated by the processing circuit 15 such as the medical operations execution plan. The generated screen data is transmitted to the terminal 20 via the communication interface 14.
The screen data generating function 15c generates operation information indicating operations to be performed on the medical devices 31, 32 and 33 based on the status information acquired by the information acquiring function 15a. That is to say, the screen data generating function 15c functions as an operation information generating unit. The screen data generating function 15c also generates screen data for displaying the generated operation information on the display of the terminal 20. For example, the screen data generating function 15c generates, based on the status information, information included in a timeline TL, a side view SV, an operation view OV, an execution status ES and a process flow PF described below as the operation information.
The screen data generation function 15c may generate, when there are a plurality of the operations to be performed on the plurality of medical devices 31, 32 and 33, a plurality of pieces of the operation information based on the status information. Each of the pieces of the operation information is generated for a corresponding one of the operations. In this case, the display control function 25b of the terminal 20 may be configured to control a display 22 so as to display the plurality of pieces of operation information side by side on a time axis. The side view SV described later may be displayed in this manner. The display control function 25b may also be configured to control the display 22 so as to display the plurality of pieces of operation information side by side in a timeline. The timeline TL described later may be displayed in this manner.
As illustrated in
The display 22 displays timelines of a plurality of workflows, device information on the medical devices, and the like based on the screen data received from the server 10. In the present embodiment, the display 12 is formed of, for example, a liquid crystal display, a cathode ray tube (CRT) display, or the like.
The input interface 23 receives various input operations from the user, converts the received input operations into electrical signals, and outputs the electrical signals to the processing circuit 25. The input interface 23 is implemented by, for example, a mouse, a keyboard, a touch panel, a trackball, a manual switch, a foot switch, a button, a joystick, or the like.
The communication interface 24 implements various communication protocols according to the form of the in-hospital network. The communication interface 24 implements communication with another device such as the server 10 via the in-hospital network according to various communication protocols.
The processing circuit 25 is a calculation circuit that performs various calculations, and includes a medical operations execution plan acquisition function 25a that acquires the medical operations execution plan from the server 10, and a display control function 25b that controls display contents of the display 22. The medical operations execution plan acquisition function 25a is an example of a medical operations execution plan acquisition unit, and the display control function 25b is an example of a display control unit.
Next, an example of a sequence between the server 10 and the terminal 20 will be described with reference to
Next, an example of step S1 of generating the medical operations execution plan according to the present embodiment will be described with reference to
The workflow WF21 includes processes P21, P22, P23, and P24, and the workflow WF22 includes processes P25, P26, P27, and P28. The processes P21 and P25 are patient positioning, the processes P22 and P26 are scanning planning, the processes P23 and P27 are main scanning, and the processes P24 and P28 are post-processing.
Similarly, the workflow WF31 includes processes P31, P32, P33, and P34, and the workflow WF32 includes processes P35, P36, P37, and P38. The processes P31 and P35 are patient positioning, the processes P32 and P36 are scanning planning, the processes P33 and P37 are main scanning, and the processes P34 and P38 are post-processing.
It is noted that the workflows WF11, WF21, WF22, WF31, and WF32 may be workflows having different contents.
The timing specification function 151 specifies, for each of the plurality of workflows, a timing at which a process of a certain medical device can transition to a process of another medical device (step S11). For example, when the medical device is a CT device, the timing specification function 151 specifies, as a transitionable timing, each of a timing between scanning planning and main scanning, a timing at which execution of the main scanning is in progress, and a timing after post-processing is completed.
An example of a detailed processing flow in step S11 will be described with reference to
The timing specification function 151 determines whether there is a workflow for which the transitionable timing has not been specified yet (step S111). When there is an unspecified workflow (S111: Yes), one unspecified workflow is selected (step S112). For example, in a case where a plurality of workflows are allocated to each of the medical devices A, B, and C, as illustrated in
In step S113, the timing specification function 151 initializes a value of an index. Here, a value of an index i is set to 1.
The timing specification function 151 determines whether transition to a process of a workflow related to another medical device can be performed during execution of the i-th process of the workflow selected in step S112 (step S114). For example, when the i-th process is main scanning, since the user's hand is available until the i-th process ends, the timing specification function 151 determines, as the transitionable timing, a period during which the i-th process is executed.
The timing specification function 151 determines whether transition to the process of another medical device can be performed between the i-th process and the (i+1)-th process of the workflow selected in step S112 (step S115). For example, when the i-th process is a post-processing process or the (i+1)-th process is a main scanning process, the timing specification function 151 determines, as the transitionable timing, a timing after the end of the i-th process. It is noted that the execution order of step S114 and step S115 may be reversed. After step S115 ends, the value of the index i is increased by one (step S116), and it is determined whether the value of the index i is equal to N (step S117). Here, N is the number of processes included in the workflow. When the value of the index i is equal to N (S117: Yes), the process proceeds to step S118. Conversely, when the value of the index i is not equal to N (S117: No), the process returns to step S114.
In step S118, the timing specification function 151 determines whether transition to the process of the workflow related to another medical device can be performed during execution of an N-th process (that is, a final process) of the workflow selected in step S112. This step has the same processing contents as those of step S114. After step S118, the process returns to step S111.
Through the above processing flow in
The time calculation function 152 calculates the process execution time of each process included in the plurality of workflows and the grace time between processes (step S12). Specifically, the time calculation function 152 calculates the time required for executing the processes P11 to P14, the processes P21 to P28, and the processes P31 to P38 included in the workflows WF11, WF21, WF22, WF31, and WF32, respectively. For example, the process execution time of the process P11 (patient positioning) of the workflow WF11 is calculated based on the patient individual information (such as the time required for positioning in the past inspection), the process execution time of the process P12 (scanning planning) is calculated based on the imaging protocol and the characteristic information of the user (the proficiency level, the operation speed, and the like), the process execution time of the process P13 (main scanning) is calculated based on the performance information of the medical device 31 (the imaging time, the reconstruction time, and the like), and the process execution time of the process P14 (post-processing) is calculated based on the characteristic information of the user (such as the proficiency level).
In addition, the time calculation function 152 calculates the grace time for each transitionable timing specified in step S11. For example, when a timing between the process P12 and the process P13 of the workflow WF11 is specified as the transitionable timing, the time calculation function 152 calculates the grace time based on the time (that is, the execution time of the process P13) from the end of the process P12 to the end of the process P13. In this case, a time obtained by adding a predetermined time to the executable time of the process P13 may be set to the grace time. For example, the grace time may be determined in consideration of the past operation speed of the user in the same type of medical operations.
The operation order determination function 153 determines an operation order for the user to sequentially operate the plurality of medical devices 31, 32, and 33 based on the timing, the process execution time, and the grace time (step S13). For example, the operation order determination function 153 determines the operation order in consideration of the transitionable timing specified in step S11, and the execution time of each process and the grace time at the transitionable timing calculated in step S12. The operation order is desirably determined so that the operation rates of the medical devices 31, 32, and 33 are as high as possible. For example, the operation order is determined such that the standby time of the user is shortened such that the parallel operation time of the medical devices 31, 32, and 33 is lengthened. It is noted that it is not necessary to set the operation order to transition at all timings specified by the timing specification function 151, and the timing may be selected depending on the purpose such as the operation rate. In this way, the medical operations execution plan in which the execution order of each process is optimized is generated.
It is noted that the operation order determination function 153 may determine the operation order for the user to sequentially operate the plurality of medical devices 31, 32, and 33 only based on the timing without using the process execution time and the grace time, and generate the medical operations execution plan. In this case, for example, the execution time of the same type of process is assumed to be the same between the workflows, and the grace time is assumed to be a constant time corresponding to the type of the next process.
As described above, the medical operations execution plan generation function 15b of the server 10 generates the medical operations execution plan based on a timing specified for each of the plurality of workflows, in which a process of a certain medical device can transition to a process of another medical device at the timing. That is, by using the transitionable timing specified in each workflow, it is possible to generate the medical operations execution plan for executing the plurality of workflows in parallel using the plurality of medical devices.
Furthermore, in the present embodiment, it is possible to generate a more efficient medical operations execution plan by calculating the process execution time of each process in the plurality of workflows and the grace time between processes and considering these times.
Furthermore, in the present embodiment, the process execution time and the grace time can be calculated more accurately by using at least one of the performance information of the medical device, the patient individual information, the characteristic information of the user, and the protocol.
It is noted that the medical operations execution plan generation function 15b may re-generate the medical operations execution plan as necessary. For example, the medical operations execution plan generation function 15b may re-generate the medical operations execution plan in a case where the user executes an unscheduled process that is not included in the medical operations execution plan, in a case where the process of the medical operations execution plan is completed later or earlier than scheduled, or in a case where the condition of a patient suddenly changes. In addition, the medical operations execution plan generation function 15b may re-generate the medical operations execution plan in a case where an abnormal finding is found by an inspection using the medical device and an additional inspection (an additional order) is approved by a doctor.
Furthermore, the medical operations execution plan generation function 15b may re-generate the medical operations execution plan at all times or every time a certain period of time elapses while the medical operations execution plan is being executed.
In a case where the medical operations execution plan is re-generated as described above, the medical operations execution plan may be generated after excluding a process or a workflow that has already been completed. In addition, when a delay in the process is detected, the medical operations execution plan may be re-generated. For example, a longer grace time may be set, or the medical operations execution plan may be changed to prioritize other processes. It is noted that the delay in the process is detected from, for example, a difference between a current process progress status grasped from a camera or the like provided in a room in which the medical device is installed and an initial schedule grasped from an inspection template or the like. In this manner, it is possible to correct a trajectory by reviewing the medical operations execution plan and to suppress or prevent the medical operations execution plan from deviating from the actual progress of the medical operations.
In addition, the medical operations execution plan generation function 15b may generate the medical operations execution plan so as to prevent a process having a high risk of interruption of the inspection or the treatment from being continuously performed. For example, the medical operations execution plan generation function 15b may generate the medical operations execution plan so as to prevent main scanning of the plurality of medical devices from being continuously performed.
<Display Screen of Terminal 20>
A description will be given as to an example of a screen displayed on the display of the terminal 20 based on the generated medical operations execution plan with reference to
As illustrated in
In the timeline TL, a plurality of workflows executed in parallel by the medical devices A, B, and C are collectively displayed in one timeline. Specifically, as illustrated in
Each process displayed in the timeline TL may be displayed in a different display mode depending on the type (kind) of the process. For example, a color in an arrow indicating the process may be changed depending on the type of process, such as a blue color for patient care, a red color for scanning planning, an orange color for main scanning, and a green color for post-processing. In
Each process displayed in the timeline TL may be displayed in a different display mode depending on the status of the process. The status of the process includes wait for execution, execution in progress, completion, and the like. The process being executed includes a process (such as scanning planning) in which the user needs to operate the medical device and a process (such as main scanning) in which the user does not need to operate the medical device. For example, the color of an edge (a frame) of the arrow indicating the process may be changed depending on the status of the process. In
When there is an unscheduled process in the processes displayed in the timeline TL, the process may be displayed in a mode different from other processes. For example, the inside of an arrow indicating the unscheduled process is displayed in a color (a purple color or the like) different from the other colors. Furthermore, a frame (a red color or the like) of the color different from the other colors may be provided. In addition, when there is a related process added with the unscheduled process, the process may be displayed in a mode different from other processes.
It is noted that information indicating the current time point may be displayed in the timeline TL as indicated by a vertical line in
In this manner, the display of the timeline TL (such as the color of the arrow of the process) is updated in real time according to the progress of the medical operations execution plan. By viewing the timeline TL, the user can easily grasp what kind of workflow (the process) is scheduled in which medical device, the workflow of the plurality of medical devices, and the execution order of the processes.
In the side view SV, the plurality of medical devices are displayed in the operation order. The side view SV is displayed based on the medical operations execution plan received from the server 10. In
In the side view SV, the medical device 32 (a medical device B) which is currently being operated by the user, a medical device C to be operated next, and a medical device A to be operated next are displayed together with identification information. The identification information of the medical device is an icon indicating the medical device in
In the side view SV, a device screen or an external image of the medical device may be displayed in association with each medical device displayed in the operation order. In
The side view SV may display, for each of the plurality of medical devices A, B, and C, a remaining time of the process being executed or a time until the start of the process scheduled to be executed in the medical device. In
The remaining time may be displayed numerically on each timer. In
It is noted that the side view SV may be displayed such that it is possible to grasp the type of the process being executed for each of the medical devices A, B, and C. For example, in the side view SV, a region where the device screen or the external image is displayed may be surrounded by a frame of a color corresponding to the process type, or the color of the timer may be the same as the color corresponding to the process type. In the example of
In addition, in
In addition, in
In addition, in the side view SV, only information on a medical device which is currently being operated by the user may be displayed, or only information on a medical device to be operated by the user next may be displayed.
Further, the side view SV is not limited to the case of being displayed in the side region of the display of the terminal 20, and may be displayed at any position.
In the operation view OV, the device screen of the medical device which is currently being operated by the user is displayed. In
In this manner, the information displayed in the operation view OV is updated in real time according to the progress of the medical operations execution plan. By viewing the operation view OV, the user can easily grasp the order of the medical devices operated by the user (which medical device should be operated now, which medical device should be operated next, and the like), the type of process for each medical device, the elapsed time of the process being executed, the time until the process starts, and the like.
In the execution status ES, progress information indicating the execution status of the workflow for each of the plurality of medical devices A, B, and C is displayed. In
In the inspection progress, information (automatic/non-automatic information) indicating whether the process is automatically performed by the medical device, that is, whether the process is a process operated by the user may be displayed in addition to the name of the process being executed. In
In addition, in the execution status ES, interruption risk information indicating a risk that the process being executed is interrupted is displayed. The interruption risk information includes a possibility and a reason that the process being executed is interrupted. In
Furthermore, in the example of
In addition, in the execution status ES, inspection room status information indicating the status of the inspection room in which the medical device is installed is displayed. The inspection room status information is information indicating the status of the patient and the inspection room photographed by the camera (such as a real-time camera) of the inspection room. For example, information on the inspection room status, such as minute body movement of the patient and the technician responding to a sudden change of the patient, is displayed. The inspection room status information is an example of status information in the claims.
It is noted that, as illustrated in
In this manner, the information displayed in the execution status ES is updated in real time according to the progress of the workflow, the state of the patient, the status of the inspection room, and the like. By viewing the execution status ES, the user can easily grasp the execution status of the workflow, the status of the site, and the state of the patient even in a case where the medical device is at a remote location. As a result, it can be determined whether a user or a local staff in charge needs to intervene.
It is noted that, as illustrated in
In addition, in the execution status ES, necessity of intervention of the user or the local staff in charge may be displayed.
In the process flow PF, the essential work and flow of the process which is currently being operated are displayed.
It is noted that, in the process flow PF, the display modes may be different from each other, for example, colors may be changed so that the work being executed can be distinguished from other works. In
As described above, in the screen 11, the timeline TL, the side view SV, the operation view OV, the execution status ES, and the process flow PF are arranged in one screen as the operation information. As a result, the user can easily and intuitively grasp the plurality of parallel workflows, the operation order of the user, the screen of the device which is currently being operated, the execution status of each workflow, the essential work and flow of the process which is currently being operated, and the like. In addition, by referring to the operation information, the user can efficiently perform the remote operation on the plurality of medical devices in parallel and give an appropriate instruction to the local staff in charge.
It is noted that it is not essential to display all of the timeline TL, the side view SV, the operation view OV, the execution status ES, and the process flow PF on one screen, and some of them may be displayed on the screen.
Next, a second screen example will be described with reference to
It is noted that, in the operation views (in
In addition, the operation views OV1, OV2, and OV3 may be displayed such that it is possible to grasp the type of the process being executed. For example, a region in which the operation views OV1 to OV3 are displayed may be surrounded by a frame of a color corresponding to the process type, or a color of the timer may be the same as the color corresponding to the process type. In
In addition, in the screen 12, the operation views are arranged from the upper side to the lower side of the screen in the operation order of the medical device, but the present invention is not limited thereto. For example, a number indicating the operation order may be displayed in association with each operation view, or the operation order may be known by a display mode (a color, an effect, and the like) of the frames F1 to F3 of the operation view. For example, the frame of the operation view of the medical device to be currently operated may be set to a red color.
In addition, in
It is noted that a display (a display unit) on which the above-described screen is displayed is not limited to the display of the terminal 20. The display may be a display (such as a stand tablet) provided in the medical devices 31, 32, and 33, a portable information terminal (such as a smartphone of the user and/or the local staff), and/or a display (a shared monitor) in a room in which the medical device is installed. By sharing the screen of the terminal 20 with the local staff in charge, it is possible to smoothly execute the workflow and to facilitate communication between the user and the local staff in charge when trouble occurs. Furthermore, the local staff in charge can provide the user with on-site information, consultation, advice, and the like as necessary.
A message (“please move a patient”, “monitoring of an inspection room is being performed”, and the like) from the user may be displayed on the displays provided in the medical devices 31, 32, and 33. The message may be made by voice via a speaker or the like of the medical device. This allows the local staff in charge to easily grasp what needs to be done at the present time point and the current status.
As explained above, the medical information processing apparatus according to the present embodiment acquires status information indicating a status of the plurality of medical devices and/or a status around the plurality of medical devices, generates operation information based on the acquired status information, and displays the generated operation information on the display unit. This allows, for example, a user such as a technician to remotely operate a plurality of medical devices efficiently and appropriately. It can also support appropriate communication between the user and the local staff.
Furthermore, in the present embodiment, the medical operations execution plan for executing a plurality of workflows in parallel by the plurality of medical devices is generated, and the medical device (that is, the medical device, which is an operation target of the user) to be operated by the user and the process executed by the medical device are displayed based on the medical operations execution plan. As a result, the user such as the technician can easily grasp the medical device to be operated and the process executed by the medical device. As a result, it is possible for the user to perform medical operations by the plurality of medical devices in parallel.
In the above embodiment, the medical information processing apparatus 1 is configured as a system including the server 10 and the terminal 20, but it is not limited to this. The medical information processing apparatus may be configured as a single device that includes the functions of the server 10 in the terminal 20.
It is noted that the term “processor” used in the above description means, for example, a central processing unit (CPU), a graphics processing unit (GPU), or circuits such as an application specific integrated circuit (ASIC) or a programmable logic device (for example, a simple programmable logic device (SPLD), a complex programmable logic device (CPLD), and a field programmable gate array (FPGA)). The processor implements a function by reading and executing a program stored in the memories 11 and 21. It is noted that, instead of storing the program in the memory 11, the program may be directly incorporated in the circuit of the processor. In this case, the processor implements the function by reading and executing the program incorporated in the circuit. It is noted that the processor is not limited to a case of being configured as a single processor circuit, and a plurality of independent circuits may be combined to be configured as one processor to implement the function. Furthermore, a plurality of components in
Although several embodiments have been described above, these embodiments have been presented only as examples, and are not intended to limit the scope of the invention. The novel devices and methods described herein can be implemented in a variety of other forms. In addition, various omissions, substitutions, and changes can be made to the forms of the device and the method described in the present specification without departing from the gist of the invention. The appended claims and equivalents thereto are intended to include such forms and modifications as fall within the scope and spirit of the invention.
(Supplementary Note 1)
A medical information processing apparatus including:
-
- a status information acquisition unit configured to acquire status information indicating a status of a plurality of medical devices connected to each other via a network and/or a status around the plurality of medical devices;
- an operation information generation unit configured to generate, based on the status information, operation information indicating an operation to be performed on the medical device; and
- a display control unit configured to control a display unit so as to display the generated operation information.
(Supplementary Note 2)
The medical information processing apparatus according to Supplementary note 1, in which:
-
- the operation information generation unit is configured to generate, when there are a plurality of the operations to be performed on the plurality of medical devices, a plurality of pieces of the operation information based on the status information, in which each of the pieces of the operation information is generated for a corresponding one of the operations; and
- the display control unit is configured to control the display unit so as to display the plurality of pieces of operation information side by side on a time axis.
(Supplementary Note 3)
The medical information processing apparatus according to Supplementary note 2, in which the display control unit is configured to control the display unit so as to display the plurality of pieces of operation information side by side in a timeline.
(Supplementary Note 4)
The medical information processing apparatus according to Supplementary note 3, in which the display control unit is configured to control the display unit so as to display, on the timeline, information for identifying a medical process being executed.
(Supplementary Note 5)
The medical information processing apparatus according to Supplementary note 1 or 2, further including a workflow information acquisition unit configured to acquire workflow information indicating a plurality of medical processes executed in parallel in the plurality of medical devices,
-
- in which the operation information generation unit is configured to generate, based on the workflow information and the status information, the operation information.
(Supplementary Note 6)
The medical information processing apparatus according to Supplementary note 5, in which the respective medical processes of a plurality of workflows executed in parallel by the plurality of medical devices have different display modes depending on a type of the medical process and/or a status of the medical process.
(Supplementary Note 7)
The medical information processing apparatus according to Supplementary note 1, in which the display control unit is configured to display, on the display unit, the plurality of medical devices in an operation order.
(Supplementary Note 8)
The medical information processing apparatus according to Supplementary note 1, in which a type of a medical process being executed is displayed so as to be recognizable for each of the plurality of medical devices.
(Supplementary Note 9)
The medical information processing apparatus according to Supplementary note 1, in which the display control unit is configured to cause the display unit to display, for each of the plurality of medical devices, a remaining time or an elapsed time of a process being executed or a time until a start of a process scheduled to be executed by the medical device.
(Supplementary Note 10)
The medical information processing apparatus according to Supplementary note 1, in which the display control unit is configured to display, on the display unit, a device screen or an external image of each of the medical devices in association with each of the medical devices displayed in an operation order.
(Supplementary Note 11)
The medical information processing apparatus according to Supplementary note 1, in which the display control unit is configured to display, on the display unit, a device screen of a medical device currently being operated among the plurality of medical devices.
(Supplementary Note 12)
The medical information processing apparatus according to Supplementary note 1, in which the display control unit is configured to display, on the display unit, a device screen or an external image of each medical device in association with the plurality of medical devices.
(Supplementary Note 13)
The medical information processing apparatus according to Supplementary note 1, in which the display control unit is configured to display, on the display unit, an execution status of a workflow for each of the plurality of medical devices.
(Supplementary Note 14)
The medical information processing apparatus according to Supplementary note 13, in which the execution status includes progress information indicating a process being executed by the plurality of medical devices.
(Supplementary Note 15)
The medical information processing apparatus according to Supplementary note 14, in which the progress information includes information indicating whether a medical process being executed is automatically performed by the medical device.
(Supplementary Note 16)
The medical information processing apparatus according to Supplementary note 13, in which the execution status includes interruption risk information indicating a risk of interruption of a medical process being executed.
(Supplementary Note 17)
The medical information processing apparatus according to Supplementary note 13, in which the execution status includes inspection room status information indicating a status of an inspection room having the medical device installed therein.
(Supplementary Note 18)
The medical information processing apparatus according to Supplementary note 13, in which the execution status includes biological information of a patient.
(Supplementary Note 19)
The medical information processing apparatus according to Supplementary note 1, in which the display control unit is configured to display, on the display unit, an essential work and a flow in a process of the medical device currently being operated.
(Supplementary Note 20)
The medical information processing apparatus according to Supplementary note 1, in which the display unit is a display provided in at least one of a terminal for operating the plurality of medical devices, a portable information terminal of an operator who operates the plurality of medical devices, the medical device, or a room having the medical device installed therein.
(Supplementary Note 21)
The medical information processing apparatus according to Supplementary note 5, further including a medical operations execution plan generation unit configured to generate a medical operations execution plan, in which the medical operations execution plan is generated based on a timing at which a process of a certain medical device is allowed to transition to a process of another medical device, in which the timing is specified for each of a plurality of workflows executed in parallel by the plurality of medical devices.
(Supplementary Note 22)
The medical information processing apparatus according to Supplementary note 21, in which the medical operations execution plan generation unit includes:
-
- a timing specification unit configured to specify the timing for each of the plurality of workflows;
- a time calculation unit configured to calculate a process execution time of each process included in the plurality of workflows and a grace time between the processes; and
- an operation order determination unit configured to determine, based on the timing, the process execution time, and the grace time, an operation order to sequentially operate the plurality of medical devices.
(Supplementary Note 23)
The medical information processing apparatus according to Supplementary note 22, in which the time calculation unit is configured to calculate the process execution time and the grace time based on at least one of performance information of the medical device, patient individual information, characteristic information of an operator who operates the plurality of medical devices, and a protocol.
(Supplementary Note 24)
The medical information processing apparatus according to Supplementary note 21, in which the medical operations execution plan generation unit is configured to generate the medical operations execution plan so as to prevent processes having a high risk of interruption from being continuously executed.
(Supplementary Note 25)
The medical information processing apparatus according to Supplementary note 21, in which the medical operations execution plan generation unit is configured to re-generate, when an unscheduled process that is not included in the medical operations execution plan is executed or when the process included in the medical operations execution plan is completed later or earlier than scheduled, the medical operations execution plan.
(Supplementary Note 26)
The medical information processing apparatus according to Supplementary note 21, in which the medical operations execution plan generation unit is configured to re-generate, when an abnormal finding is found by an inspection by the medical device and an additional inspection is approved, the medical operations execution plan.
(Supplementary Note 27)
The medical information processing apparatus according to Supplementary note 21, in which the medical operations execution plan generation unit is configured to re-generate, when a process delay is detected, the medical operations execution plan.
(Supplementary Note 28)
A medical information processing method including:
-
- acquiring status information indicating a status of a plurality of medical devices connected to each other via a network and/or a status around the plurality of medical devices;
- generating, based on the status information, operation information indicating an operation to be performed on the medical device; and
- controlling a display unit so as to display the generated operation information.
Claims
1. A medical information processing apparatus comprising:
- processing circuitry configured to
- acquire status information indicating a status of a plurality of medical devices connected to each other via a network and/or a status around the plurality of medical devices;
- generate, based on the status information, operation information indicating an operation to be performed on the medical device; and
- control a display unit so as to display the generated operation information.
2. The medical information processing apparatus of claim 1, wherein the processing circuitry is further configured to:
- generate, when there are a plurality of the operations to be performed on the plurality of medical devices, a plurality of pieces of the operation information based on the status information, in which each of the pieces of the operation information is generated for a corresponding one of the operations; and
- control the display unit so as to display the plurality of pieces of operation information side by side on a time axis.
3. The medical information processing apparatus of claim 2, wherein the processing circuitry is further configured to control the display unit so as to display the plurality of pieces of operation information side by side in a timeline.
4. The medical information processing apparatus of claim 3, wherein the processing circuitry is further configured to control the display unit so as to display, on the timeline, information for identifying a medical process being executed.
5. The medical information processing apparatus of claim 1, wherein the processing circuitry is further configured to:
- acquire workflow information indicating a plurality of medical processes executed in parallel in the plurality of medical devices; and
- generate, based on the workflow information and the status information, the operation information.
6. The medical information processing apparatus of claim 5, wherein the respective medical processes of a plurality of workflows executed in parallel by the plurality of medical devices have different display modes depending on a type of the medical process and/or a status of the medical process.
7. The medical information processing apparatus of claim 1, wherein the processing circuitry is further configured to cause the display unit to display, for each of the plurality of medical devices, a remaining time or an elapsed time of a process being executed or a time until a start of a process scheduled to be executed by the medical device.
8. The medical information processing apparatus of claim 1, wherein the processing circuitry is further configured to display, on the display unit, a device screen or an external image of each of the medical devices in association with each of the medical devices displayed in an operation order.
9. The medical information processing apparatus of claim 1, wherein the processing circuitry is further configured to display, on the display unit, a device screen of a medical device currently being operated among the plurality of medical devices.
10. The medical information processing apparatus of claim 1, wherein the processing circuitry is further configured to display, on the display unit, an execution status of a workflow for each of the plurality of medical devices.
11. The medical information processing apparatus of claim 10, wherein the execution status includes progress information indicating a process being executed by the plurality of medical devices.
12. The medical information processing apparatus of claim 10, wherein the execution status includes interruption risk information indicating a risk of interruption of a medical process being executed.
13. The medical information processing apparatus of claim 10, wherein the execution status includes biological information of a patient.
14. The medical information processing apparatus of claim 1, wherein the display unit is a display provided in at least one of a terminal for operating the plurality of medical devices, a portable information terminal of an operator who operates the plurality of medical devices, the medical device, or a room having the medical device installed therein.
15. A medical information processing method comprising:
- acquiring status information indicating a status of a plurality of medical devices connected to each other via a network and/or a status around the plurality of medical devices;
- generating, based on the status information, operation information indicating an operation to be performed on the medical device; and
- controlling a display unit so as to display the generated operation information.
Type: Application
Filed: Nov 17, 2023
Publication Date: May 23, 2024
Applicant: CANON MEDICAL SYSTEMS CORPORATION (Otawara-shi)
Inventor: Yohei KAMINAGA (Otawara)
Application Number: 18/512,120