Patent ID: 11961624
Assignee: nan
Field: Audio-visual technology (Electrical engineering)
Classification: CPC G  A  H | IPC G  H

Claim 0:
1. A network system enabling multichannel multiplexed communications, collaboration, consultation and instruction, as well as recursive cognitive enrichment and collaborative knowledge exchange, with streaming imagery data during collaboration sessions, practiced by and among at least one or more participant cognitive collaborants, including persons, machines, devices, neural networks, robots and algorithms, and heterogeneous networked teams composed thereof, the network system enabling both synchronous and asynchronous multimodal clinical communications, collaboration, consultation and instruction, including recursive cognitive enrichment and collaborative knowledge exchange, with streaming imagery data during various stages of medical disease and injury management, including detection, diagnosis, prognosis, treatment, measurement, monitoring and reporting, as well as workflow optimization with operational analytics for outcomes, performance, results, resource utilization, resource consumption and costs, allowing each participant cognitive collaborant to capture, retrieve and concurrently view at least one source of streaming medical modality imagery data, and at least one or more sources of heterogeneous streaming imagery data, medical and non-medical streaming imagery data, and combinations thereof including images, video, modality imagery, audio, video and haptic wave forms and files, multiomic—phenotypic, genomic, metabolomic, pathomic, radiomic, radiopathomic and radiogenomic—maps and clinical data sets, biometric maps and movies, hapmaps, heat maps, data stream visualizations, structured reports, interactive media reports, including interactive multimedia reporting clinical documents and key performance indicators, including indicators of quality of care, as well as indicators of clinical, operational and financial performance, both live and archived streaming imagery data, enabling both synchronous and asynchronous multimodal clinical communications, collaboration, consultation and instruction, as well as recursive cognitive enrichment and collaborative knowledge exchange, with streaming imagery data in collaboration sessions practiced by and among at least one or more participant cognitive collaborants during various stages of medical disease and injury management, including detection, diagnosis, prognosis, treatment, measurement, monitoring and reporting, as well as workflow optimization with operational analytics for outcomes, performance, results, resource utilization, resource consumption and costs, each participant cognitive collaborant able to view, curate, annotate and tag the heterogeneous streaming imagery data, comprising
a tele-visual imagery informatics management system including,
at least one or more tele-visual imagery informatics management system clini-docks, wherein each clini-dock is adapted for independent acquisition and transmission of signals from other sources of streaming imagery data at native, enhanced or reduced resolutions and native enhanced or reduced frame rates, used for the acquisition and transmission of, live or archived streaming imagery data, including images, video, modality imagery, audio, video and haptic wave forms and files, multiomic—phenotypic, genomic, metabolomic, pathomic, radiomic, radiopathomic and radiogenomic—maps and clinical data sets, biometric maps and movies, hapmaps, heat maps, data stream visualizations, structured reports, interactive media reports, including interactive multimedia reporting, clinical documents and key performance indicators, including indicators of quality of care, as well as indicators of clinical, operational and financial performance, analog or digital video signals in standard or non-standard resolutions, medical or non-medical imagery, in compressed or uncompressed imagery formats;

at least one or more tele-visual imagery informatics management system clini-pod network servers, wherein each server is a neurosynaptic network node comprising at least one streamer, splitter, router, server and storage device
enabling at least one or more participant cognitive collaborants, including persons, machines, devices, neural networks, robots and algorithms, and heterogeneous networked teams composed thereof, to concurrently view, communicate, collaborate, consult and instruct among participant cognitive collaborants, including curation, annotation and tagging, using at least one or more sources of streaming imagery data acquired and transmitted by tele-visual imagery informatics management system clini-docks, including live streaming imagery data, archived streaming imagery data, appended streaming imagery metadata, including appended semantic metadata and annotations, cognitive collaborant annotations, and archived collaborated imagery files during a synchronous or asynchronous collaboration session,
establishing and maintaining channel communications for each and all of the sources of streaming imagery data for at least one or more participant cognitive collaborant during a collaboration session,
enabling at least one or more participant cognitive collaborants in at least one or more locations, to concurrently view, communicate, collaborate, consult and instruct among participant cognitive collaborants using at least one or more sources of live streaming imagery data, archived streaming imagery data, appended streaming imagery metadata, cognitive collaborant annotations, and archived collaborated imagery files, including curation, annotation and tagging from each participant cognitive collaborant during a collaboration session,
managing and controlling at least one or more associated databases, and privileges for authorization, authentication, identity management, security, access, publication and distribution for viewing, communicating, collaborating, consulting and instructing among participant cognitive collaborants, including managing and controlling security tokens providing access for cognitive collaborants maintained in security metadata repositories, blockchain metadata repositories and blockchain data ledgers,
managing and controlling privileges for at least one or more participant cognitive collaborants to view, curate, annotate, tag, encapsulate, save, store, retrieve and distribute live streaming imagery data, archived streaming imagery data, appended streaming imagery metadata, including appended semantic metadata and annotations, cognitive collaborant annotations, and archived collaborated imagery files for each participant cognitive collaborant during collaboration sessions,
enabling both synchronous and asynchronous bidirectional communications with combinations of at least one or more local area networks, at least one or more wide area networks, including internet, and at least one or more streaming imagery data repositories during at least one or more collaboration sessions,
enabling identification, tracking and monitoring of participant cognitive collaborants by assignment of unique colors for annotations of streaming imagery data, archived collaborated imagery files and cognitive collaborant annotations, including telestrations, drawings, illustrations, alpha-numeric text annotations, image annotations, wave form annotations, voice annotations, video annotations, augmented reality imagery annotations, 3D/4D imagery annotations, haptic annotations, document annotations, outcomes annotations, performance annotations, results annotations, resource consumption annotations, resource utilization annotations and costs annotations,
enabling colorized telestration, annotation and masking of colorized attention maps and colorized prediction bases for explainable artificial intelligence by participant cognitive collaborants by assignment of unique colors for annotations of streaming imagery data, archived collaborated imagery files and cognitive collaborant annotations, including telestrations, drawings, illustrations, alpha-numeric text annotations, image annotations, wave form annotations, voice annotations, video annotations, augmented reality imagery annotations, 3D/4D imagery annotations, haptic annotations, document annotations, outcomes annotations, performance annotations, results annotations, resource consumption annotations, resource utilization annotations and costs annotations; and

at least one or more tele-visual imagery informatics management system clini-ports allowing at least one or more participant cognitive collaborants, each,
capturing live streaming imagery data, capturing associated live streaming imagery metadata, including semantic metadata and annotations, retrieving archived streaming imagery data, retrieving archived associated imagery metadata, including archived semantic metadata and annotations, and transporting live streaming imagery data, transporting associated live streaming imagery metadata, including semantic metadata and annotations, and transporting live streaming imagery data, associated live streaming metadata, including semantic metadata and annotations, archived streaming imagery data, associated archived streaming metadata, including archived semantic metadata and annotations, into collaboration sessions,
concurrently viewing, communicating, collaborating, consulting and instructing among participant cognitive collaborants using at least one or more sources of streaming imagery data,
curating, annotating and tagging streaming imagery data, including telestrations, drawings, illustrations, alpha-numeric text annotations, voice annotations, video annotations, augmented reality imagery annotations, 3D/4D imagery annotations, haptic annotations, document annotations, outcomes annotations, performance annotations, results annotations, resource consumption annotations, resource utilization annotations and costs annotations, and
encapsulating streaming imagery data and associated streaming imagery metadata, including semantic metadata and annotations, together with cognitive collaborant annotations in native, single file format structures, and saving said streaming imagery data and said associated streaming imagery metadata, including semantic metadata and annotations, together with said cognitive collaborant annotations in at least one or more collaborated imagery files during collaboration sessions, including asynchronous or synchronous collaborations with at least one or more participant cognitive collaborants,
communicating, collaborating, consulting and instructing, including viewing, curating, annotating and tagging, using at least one or more sources of streaming imagery data shared among at least one or more participant cognitive collaborants with a multi-channel stream viewer that enables capture, retrieval and concurrent viewing of both live and archived medical imagery streams together with associated metadata, including semantic metadata and annotations, during various stages of medical disease and injury management, including detection, diagnosis, prognosis, treatment, measurement, monitoring and reporting, as well as workflow optimization with operational analytics for outcomes, performance, results, resource utilization, resource consumption and costs,
independently adding sources of streaming imagery data, adjust, enhance or reduce resolutions or frame rates of streaming imagery data with a multi-channel communications control interface, and independently view those additional channels of streaming imagery data and independently select which of those channels to bring into a collaboration session,
conveying instructions with two way communications among participant cognitive collaborants, including source channel selection, for viewing, curating, annotating and tagging imagery data streams with telestrations, drawings, illustrations, alpha-numeric text annotations, image annotations, wave form annotations, voice annotations, image annotations, wave form annotations, video annotations, augmented reality imagery annotations, 3D/4D imagery annotations, haptic annotations, document annotations, outcomes annotations, performance annotations, results annotations, resource consumption annotations, resource utilization annotations and costs annotations, and not reliant upon any external communications network.