Patent ID: 11876877
Assignee: THE UNITED STATES OF AMERICA, AS REPRESENTED BY THE SECRETARY OF THE NAVY
Field: Digital communication (Electrical engineering)
Classification: CPC H | IPC G  H

Claim 0:
1. A computer-implemented method to shape traffic in a dynamic network, comprising:
measuring network states comprising
a queue-size history,
a measure of QoS mapped to a queue status metric,
a measure of congestion, and
an available transmission bandwidth;

classifying each of a plurality of packets into one of a plurality of traffic types based on quality-of-service (QoS) requirements;
defining a decision epoch interval;
determining a policy with a plurality of neural networks and with a deep reinforcement learning agent that maximizes entropy-regularized long-term reward and produces a plurality of weighted fair-queuing (WFQ) weights based on an observation of the state of the queues at the decision epoch intervals; and
using the policy to allocate predefined portions of the available transmission bandwidth across the plurality of traffic types by defining each type with a WFQ weight.