Patent ID: 12193873

DETAILED DESCRIPTION

Certain embodiments may be found in a method and system for acquiring standard ultrasound scan plane views. Various embodiments have the technical effect of acquiring a 3D image of the object being scanned by the probe during a detected period of inactivity of the object to provide a 3D volume map representing the position of the ultrasound probe relative to the object for presentation on a display.

The foregoing summary, as well as the following detailed description of certain embodiments will be better understood when read in conjunction with the appended drawings. To the extent that the figures illustrate diagrams of the functional blocks of various embodiments, the functional blocks are not necessarily indicative of the division between hardware circuitry. Thus, for example, one or more of the functional blocks (e.g., processors or memories) may be implemented in a single piece of hardware (e.g., a general purpose signal processor or a block of random access memory, hard disk, or the like) or multiple pieces of hardware. Similarly, the programs may be stand alone programs, may be incorporated as subroutines in an operating system, may be functions in an installed software package, and the like. It should be understood that the various embodiments are not limited to the arrangements and instrumentality shown in the drawings. It should also be understood that the embodiments may be combined, or that other embodiments may be utilized and that structural, logical and electrical changes may be made without departing from the scope of the various embodiments. The following detailed description is, therefore, not to be taken in a limiting sense, and the scope of the present disclosure is defined by the appended claims and their equivalents.

As used herein, an element or step recited in the singular and proceeded with the word “a” or “an” should be understood as not excluding plural of said elements or steps, unless such exclusion is explicitly stated. Furthermore, references to “an exemplary embodiment,” “various embodiments,” “certain embodiments,” “a representative embodiment,” and the like are not intended to be interpreted as excluding the existence of additional embodiments that also incorporate the recited features. Moreover, unless explicitly stated to the contrary, embodiments “comprising,” “including,” or “having” an element or a plurality of elements having a particular property may include additional elements not having that property.

Also as used herein, the term “image” broadly refers to both viewable images and data representing a viewable image. However, many embodiments generate (or are configured to generate) at least one viewable image. In addition, as used herein, the phrase “image” is used to refer to an ultrasound mode such as B-mode (2D mode), M-mode, three-dimensional (3D) mode, CF-mode, PW Doppler, CW Doppler, MGD, and/or sub-modes of B-mode and/or CF such as Shear Wave Elasticity Imaging (SWEI), TVI, Angio, B-flow, BMI, BMI_Angio, and in some cases also MM, CM, TVD where the “image” and/or “plane” includes a single beam or multiple beams.

Furthermore, the term processor or processing unit, as used herein, refers to any type of processing unit that can carry out the required calculations needed for the various embodiments, such as single or multi-core: CPU, Accelerated Processing Unit (APU), Graphics Board, DSP, FPGA, ASIC or a combination thereof.

It should be noted that various embodiments described herein that generate or form images may include processing for forming images that in some embodiments includes beamforming and in other embodiments does not include beamforming. For example, an image can be formed without beamforming, such as by multiplying the matrix of demodulated data by a matrix of coefficients so that the product is the image, and wherein the process does not form any “beams”. Also, forming of images may be performed using channel combinations that may originate from more than one transmit event (e.g., synthetic aperture techniques).

In various embodiments, ultrasound processing to form images is performed, for example, including ultrasound beamforming, such as receive beamforming, in software, firmware, hardware, or a combination thereof. One implementation of an ultrasound system having a software beamformer architecture formed in accordance with various embodiments is illustrated inFIG.1, such as those examples disclosed in US Patent Application Publication Nos. US2020/0289096, entitled Method And System For Providing Standard Ultrasound Scan Plane Views Using Automatic Scan Acquisition Rotation And View Detection, the entirety of which is hereby expressly incorporated herein by reference for all purposes.

FIG.1is a block diagram of an exemplary ultrasound system that is operable to acquire standard ultrasound scan plane views, in accordance with various embodiments. Referring toFIG.1, there is shown an ultrasound system100. The ultrasound system100comprises a transmitter102, an ultrasound probe104, a transmit beamformer110, a receiver118, a receive beamformer120, A/D converters122, a RF processor124, a RF/IQ buffer126, a user input module130, a signal processor132, an image buffer136, a display system134, a memory unit/archive138, and a training engine160.

The transmitter102may comprise suitable logic, circuitry, interfaces and/or code that may be operable to drive an ultrasound probe104. The ultrasound probe104may comprise a two dimensional (2D) array of piezoelectric elements. The ultrasound probe104may comprise a group of transmit transducer elements106and a group of receive transducer elements108, that normally constitute the same elements. In certain embodiment, the ultrasound probe104may be operable to acquire ultrasound image data covering at least a substantial portion of an anatomy, such as the heart, a blood vessel, or any suitable anatomical structure. The ultrasound probe104can be any suitable ultrasound probe operable to acquire ultrasound scan planes at different rotational and/or tilt angles without physically moving the ultrasound probe. In an exemplary embodiment, the ultrasound probe104may include a one dimensional transducer array that can be mechanically oriented in a plurality of orientations by a motor in response to instructions from the signal processor132. In a preferred embodiment, the probe104includes a 2D array of ultrasound elements operable to electronically transmit ultrasonic signals and acquire ultrasound data in any orientation in three dimensional space, called a four dimensional (e4D) matrix probe. For example, the e4D ultrasound probe104may be the GE 4Vc-D four dimensional (4D) matrix cardiac probe. The processing of the acquired images in any steered direction can be performed partially or completely by probe-internal sub-aperture processing, by system side software beamforming, or by beamforming in hardware. In an exemplary embodiment, the acquired scan planes are either 2D images and/or thin slab images. For example, thin slab images may be acquired using multi-line acquisition (MLA) where a plurality of transmit beams are arranged spatially along a plane and multiple receive beams for each transmit beam are received orthogonal to a plane width of the transmit beams. In various embodiments, a thickness of the thin slab images may be 7 millimeters or less. The system100can additionally acquire 3D/volumetric ultrasound images of the anatomy or object using a similar process to that utilized for the acquisition of the slab images.

The transmit beamformer110may comprise suitable logic, circuitry, interfaces and/or code that may be operable to control the transmitter102which, through a transmit sub-aperture beamformer114, drives the group of transmit transducer elements106to emit ultrasonic transmit signals into a region of interest (e.g., human, animal, underground cavity, physical structure and the like). The transmitted ultrasonic signals may be back-scattered from structures in the object of interest, like blood cells or tissue, to produce echoes. The echoes are received by the receive transducer elements108.

The group of receive transducer elements108in the ultrasound probe104may be operable to convert the received echoes into analog signals, undergo sub-aperture beamforming by a receive sub-aperture beamformer116and are then communicated to a receiver118. The receiver118may comprise suitable logic, circuitry, interfaces and/or code that may be operable to receive the signals from the receive sub-aperture beamformer116. The analog signals may be communicated to one or more of the plurality of A/D converters122.

The plurality of A/D converters122may comprise suitable logic, circuitry, interfaces and/or code that may be operable to convert the analog signals from the receiver118to corresponding digital signals. The plurality of A/D converters122are disposed between the receiver118and the RF processor124. Notwithstanding, the disclosure is not limited in this regard. Accordingly, in some embodiments, the plurality of A/D converters122may be integrated within the receiver118.

The RF processor124may comprise suitable logic, circuitry, interfaces and/or code that may be operable to demodulate the digital signals output by the plurality of A/D converters122. In accordance with an embodiment, the RF processor124may comprise a complex demodulator (not shown) that is operable to demodulate the digital signals to form I/Q data pairs that are representative of the corresponding echo signals. The RF or I/Q signal data may then be communicated to an RF/IQ buffer126. The RF/IQ buffer126may comprise suitable logic, circuitry, interfaces and/or code that may be operable to provide temporary storage of the RF or I/Q signal data, which is generated by the RF processor124.

The receive beamformer120may comprise suitable logic, circuitry, interfaces and/or code that may be operable to perform digital beamforming processing to, for example, sum the delayed channel signals received from RF processor124via the RF/IQ buffer126and output a beam summed signal. The resulting processed information may be the beam summed signal that is output from the receive beamformer120and communicated to the signal processor132for image generation and presentation on the display system134. In accordance with some embodiments, the receiver118, the plurality of A/D converters122, the RF processor124, and the beamformer120may be integrated into a single beamformer, which may be digital. In various embodiments, the ultrasound system100comprises a plurality of receive beamformers120.

The user input module130may be utilized to input patient data, scan parameters, settings, select protocols and/or templates, select one or more desired standard views, provide a command for storing a displayed scan plane, and the like. In an exemplary embodiment, the user input module130may be operable to configure, manage and/or control operation of one or more components and/or modules in the ultrasound system100. In this regard, the user input module130may be operable to configure, manage and/or control operation of the transmitter102, the ultrasound probe104, the transmit beamformer110, the receiver118, the receive beamformer120, the RF processor124, the RF/IQ buffer126, the user input module130, the signal processor132, the image buffer136, the display system134, and/or the archive138. The user input module130may include button(s), rotary encoder(s), a touchscreen, motion tracking, voice recognition, a mousing device, keyboard, camera and/or any other device capable of receiving a user directive. In certain embodiments, one or more of the user input modules130may be integrated into other components, such as the display system134, for example. As an example, user input module130may include a touchscreen display.

In various embodiments, a protocol and/or one or more desired standard views may be selected during or at the onset of an imaging procedure in response to a directive received via the user input module130. For example, an ultrasound operator may identify a transthoracic echocardiogram acquired at an apical window protocol at an onset of an imaging procedure via the user input module130. The protocol may include a number of pre-defined standard views, such as a four chamber (4CH) view, a two chamber (2CH) view, an apical long axis (APLAX) view, a parasternal long axis (PLAX) view, a parasternal short axis (PSAX) view; and the like. The selected protocol may be provided via the user input module130to the signal processor132so that the signal processor132may apply view detection processing and acquisition rotation and/or tilt parameters. The view detection processing applied by the signal processor132may automatically detect each of the standard views. The acquisition rotation and/or tilt parameters may be applied by the signal processor132to automatically rotate and/or tilt scan plane acquisition to acquire each of the standard views once the ultrasound probe104is properly positioned at the apical window.

The signal processor132may comprise suitable logic, circuitry, interfaces and/or code that may be operable to process ultrasound scan data (i.e., summed IQ signal) for generating ultrasound images for presentation on a display system134. The signal processor132is operable to perform one or more processing operations according to a plurality of selectable ultrasound modalities on the acquired ultrasound scan data. In an exemplary embodiment, the signal processor132may be operable to perform display processing and/or control processing, among other things. Acquired ultrasound scan data may be processed in real-time during a scanning session as the echo signals are received. Additionally or alternatively, the ultrasound scan data may be stored temporarily in the RF/IQ buffer126during a scanning session and processed in less than real-time in a live or off-line operation. In various embodiments, the processed image data can be presented at the display system134and/or may be stored at the memory unit/archive138. The archive/memory unit138may be a local archive, a Picture Archiving and Communication System (PACS), or any suitable device for storing images, executable commands and functions of the image processing unit132, and/or related information.

Referring now toFIGS.1and2, the system100additionally includes a motion detection system180, which can be formed as a part of the signal processor132or as a separate component of the system100that has access to the ultrasound scan data from the probe104. In the illustrated exemplary embodiment of the method of operation200of the motion detection system180inFIG.2, the motion detection system180is capable of analyzing data regarding the object being imaged that is obtained directly from the imaging system100and/or from a separate medical sensing and/or diagnostic system, such as an electrocardiogramatem400that is operably connected to the processor132/motion detection system180, or that is included as a component part of the motion detection system180for the automatic detection of QRS complexes, which are utilized to calculcate the heart rate of the patient, and then estimating the timing of the diastasis interval using by known emprical formulas, in order to determine and/or estimate a period of inactivity of the object based on a determined movement pattern of the object. The motion detection system180can utilize various types of data concerning the object in order to make this determination and/or estimation of the most inactive time frame(s) within the movement cycle(s) of the object imaged by the ultrasound imaging system100, including but not limited to electrocardiograph data and/or ultrasound scan data. In one exemplary embodiment, the electrocardiograph data and/or ultrasound scan data is obtained in real time in order to determine a movement pattern of the object, and whether motion within the object being scanned has paused for a repeatable inactivity time frame. The motion detection system180can perform this task in any of a number of suitable manners, techniques and/or processes, and in an exemplary embodiment does so through the use of one or more of a pattern recognition algorithm, a neural network, machine learning and/or an artificial intelligence (AI)190forming a part of the motion detection system180and having executable functions/information stored on the image processor132, within the memory unit138, or in any other suitable location or manner for the operation of the AI application190.

In block202of one exemplary embodiment of the method200, the system180/AI190initially reviews the electrocardiograph ad/or ultrasound scan data and determines if all or any relevant portions of the object being scanned have temporarily stopped moving based on the representations of the various portions of the object in the electrocardiograph data, e.g., the PR and/or ST segments of the detected electrocardiogram of a cardiac object, the detected interval between the U wave and the P wave, and/or ultrasound scan data, e.g., little or no movement of the object between successive/multiple 2D images generated by the image processor132. More specifically, the system180/AI190analyzes the object movement data, e.g., electrocardiogram and/or ultrasound scan data, in order to determine any repeating pattern of time frames within the movement cycle of the object in which the object is minimally moving or is not moving, e.g., is stationary.

For example, when object being scanned is the heart of a patient, the image processor132will provide 2D images from the ultrasound scan data of the heart in motion corresponding to the cardiac cycle for the heart, i.e., the motion of the heart through the systole and diastole portions of the cardiac cycle. With the ultrasound scan data for the cardiac cycle provided, the system180/AI190can review the ultrasound scan data/2D images in order to locate those 2D images in which the heart is not moving/has only minimal motion. These 2D images correspond to the rest period within the cardiac cycle when the heart is inactive or moving only minimally, i.e., the portion of the cardiac cycle for the imaged heart during which diastasis occurs. This ultrasound scan data can be utilized alone by the system180/AI190, in combination with electrocardiograph data from an external or an internal electrocardiogramatem400or can use only the electrocardiograph data to make this determination.

Proceeding to block204, the system180/AI190can then use the information provided by the electrocardiography and/or image data to determine/detect the approximate length of the window/time frame for the inactivity the object, e.g., when the heart is in diastasis. During this inactivity time frame, the ultrasound scan data being obtained by the probe104is largely similar to the ultrasound scan data obtained both immediately prior to and after the detected time frame. As a result, the ultrasound scan data obtained via the probe104during the detected inactivity time frame can readily be omitted from any real time 2D images provided by the signal processor132as being closely duplicative of the ultrasound scan data/2D images from immediately prior to and immediately after the inactivity time frame.

Further, the ultrasound scan data/2D images from immediately prior to and immediately after the inactivity time frame can be stitched together and/or interpolated by the system180/AI190in block206in order to provide a seamless appearance to the 2D images generated by the signal processor132from the ultrasound scan data and presented on the display system134without any significant temporal resolution loss in the displayed 2D images. In an exemplary embodiment, the system180/AI190can stitch or interpolate the scan data for the ultrasound image immediately prior to the inactivity time frame with the scan data for the ultrasound image immediately following the inactivity time frame to create an inactivity time frame ultrasound image for presentation on the display system134during the inactivity time frame.

After determining the inactivity time frame, and after or concurrently with the stitching of the ultrasound scan data/images immediately prior to and immediately after the inactivity time frame, in block208the system180/AI190proceeds to operate the probe104during the inactivity time frame to obtain a 3D volume/image300(FIG.3) of the object being scanned. In an exemplary embodiment of its operation, the system180/AI190can determine the inactivity time frame in a first number of movement cycles of the object, e.g., a first cardiac cycle, and can operate the probe104to obtain the 3D volume300during the inactivity time frame of a second or any subsequent movement cycle of the object.

Once obtained, the system180/AI190proceeds in block210to use the 3D/volumetric ultrasound scan data obtained during the inactivity time frame to generate a 3D volume300(FIG.3) representation of the object. In alternative embodiments, the 3D volume300is presented on the display system134, but can also remain internal to the system180/AI190.

As the 3D volume300corresponds to the object being scanned, in block212, the system180/AI190can calibrate and/or determine the location of the scan plane302for the ultrasound image304within the 3D volume. With this calibration, the system180/AI190can present the 3D volume300on the display system134with a representation of the actual scan plane302currently being obtained by the probe104in relation to the position of the probe104relative to the 3D volume300, as well as any modification due to the current operational scan parameters, settings, protocols and/or templates employed with the probe104.

As illustrated inFIG.3, the representation302of the scan plane on the 3D volume300, such as a line or a plane intersecting the 3D volume300, can be presented on the display134in an optional step of block214to provide the operator with a visual indication/representation of the scan plane302in association with the real time 2D image(s)304presented on the display system134. The 3D volume300and scan plane representation302thus enable the operator to have a real time localization of the position of the displayed 2D image304relative to the object/3D volume being scanned, such that the operator has a visual indication of the current scan plane representation302relative to a desired scan plane of a standard view (which can optionally be represented on the 3D volume300with a separate scan plane indicator306), or of the necessary adjustment of the position of the probe104relative to the object/3D volume300to decrease or eliminate and foreshortening in the displayed 2D image(s)304.

The operation of the system180/AI application190in blocks208-214can be repeated during successive cycles/during the inactivity time frames within successive cycles in order to update the representation on the display system134of the current scan plane representation302relative to the 3D volume300and any desired scan plane indicator306to provide guidance for movement of the probe104to the operator to the location to obtain the desired standard view of the object.

In addition, with the generation of the 3D volume300during the inactivity time frame, the ultrasound scan data and scan planes from multiple 2D acquisitions/image304of the object, e.g., heart, obtained at any of the apical, parasternal, and any other view windows, can be precisely calibrated with regard to their relative locations to one another utilizing the known locations of the scan plane representations302of the individual 2D images304relative to the one or more 3D volumes300that are obtained. Thus, the correlation of the scan plane representations302/2D images304through the 3D volume(s)300enables the transformation of the ultrasound scan data from multiple views/2D images304, and optionally in conjunction with the 3D volume(s)300, into a single shared vector space (not shown) comprising the combined scan data from the calibrated 2D images304to describing the dimensions and motion of the scanned object, which in the exemplary embodiment is the heart. This vector space is a representation of an object (i.e. the heart) as a series of vectors describing the edges and other important features of the object in a common 3D coordinate system. The edges and features are extracted and combined from multiple 2D images corresponding to multiple views of the object so the vector space summarizes all known information on the object. In alternative embodiments of the system180/AI application190and its operation where the 3D volume300is not presented in the display134, as the 3D volume in all embodiments is stored in conjunction with the 2D image(s)304, for subsequent measurements of the object the stored 3D volume300can be used to align the current 2D image(s)/ultrasound sector304with other/subsequent 2D image(s)304/ultrasound sector obtained of the object using the probe104positioned at different positions, directions and/or angles relative to the object.

For example, with reference toFIG.4, a vector space401representing a left ventricle myocardium is illustrated that is created from the alignment of an apical long axis (APLAX) ultrasound image/ultrasound sector402and parasternal long axis (PLAX) ultrasound image/ultrasound sector403using a 3D volume300obtained of the left ventricle myocardium. The 3D volume300is obtained during the inactivity period determined for the object (i.e., the diastasis of the heart) during the imaging procedure utilized for obtaining the images402and403. By aligning/registering the 3D volumes300obtained during various diastasis periods at different image angles/positions with each other, the APLAX image402and the PLAX image403can be aligned with one another in a 3D space using the aligned 3D volumes300. InFIG.4, the alignment of the views402and403results in the creation of the vector space representation401of the left ventricle myocardium. From this vector space401, various measurements of the object represented by the vector space representation401can be obtained, such as a thickness measurement404, instead of being obtained from one of the individual ultrasound images/sectors402or403, which can result in a more accurate measurement.

The written description uses examples to disclose the invention, including the best mode, and also to enable any person skilled in the art to practice the invention, including making and using any devices or systems and performing any incorporated methods. The patentable scope of the invention is defined by the claims, and may include other examples that occur to those skilled in the art. Such other examples are intended to be within the scope of the claims if they have structural elements that do not differ from the literal language of the claims, or if they include equivalent structural elements with insubstantial differences from the literal language of the claims.