Abstract:
The invention relates to a method for establishing deterministic communication routes in a large computer network, wherein all affected end systems and switches of the computer network have a global time and a deterministic communication route is generated on the basis of an existing communication route between two or more end systems of the computer network in that a time-triggered connection manager (TTCM) of an end system
       reserves the deterministic communication route in a reservation phase by sending a reservation message to each network switch of the existing communication route up to the reservation commitment time (KZPT),   and then confirms this deterministic communication route in an accept phase by sending an accept message to the network switches of the existing communication route before the KZPT.

Description:
FIELD OF THE INVENTION 
       [0001]    The invention relates to a method for establishing deterministic communication routes in a large computer network, wherein all affected end systems and switches of the computer network have a global time. 
         [0002]    The invention also relates to such a computer network and to end systems and switches of such a computer network. 
       INTRODUCTION 
       [0003]    The present invention lies in the field of computer technology. The invention describes an innovative method for establishing time-controlled (time-triggered) routes in a large computer network in accordance with a self-organising method. 
         [0004]    In many applications of large computer networks, the availability of a deterministic communication route with guaranteed bandwidth and minimal delay of the messages between end systems is advantageous. For example, the immediacy of the response to a request of the remote partner is a key parameter of the service quality (QoS) in a videoconference system. In a smart grid, in which periodic sensor data has to be transmitted over long physical distances, the transmission duration between the decentral sub-systems and the central control room determines, to a significant extent, the dead time of a control circuit closed via the communication system and therefore the quality of the control. 
         [0005]    A large computer network is generally understood to mean a network in which there is no central authority controlling the entire network. An example for a large computer network is the Internet. 
         [0006]    A minimal delay—and therefore the optimal latency—of a transmission along a given route is achieved when the transmission paths of a message are phase-synchronous along this route, which is formed of transmission segments and switches. Unnecessary residence times of the messages in the communication system are thus prevented. Such a phase-synchronous transmission of the messages requires all affected end systems and switches to have a global time with known precision. This time base is to be fault-tolerant [6]. 
       OBJECT OF THE INVENTION 
       [0007]    The object of the present invention is to dynamically establish a deterministic time-controlled communication route between two or more end systems along a given route for a data stream in a large computer network by means of a decentralised self-organising method. 
         [0008]    This object is achieved with a method as mentioned in the introduction in that, in accordance with the invention, a deterministic communication route is generated on the basis of an existing communication route between two or more end systems of the computer network in that a time-triggered connection manager (TTCM) of an end system
       reserves the deterministic communication route in a reservation phase by sending a reservation message to each network switch of the existing communication route up to the reservation commitment time (KZPT),   and then confirms this deterministic communication route in an accept phase by sending an accept message to the network switches of the existing communication route before the KZPT.       
 
         [0011]    It is particularly advantageous here if the time-triggered connection manager (TTCM) of an end system firstly tests the feasibility of the deterministic communication route with respect to the respective network switch in a request phase, before the reservation phase, by sending requests to each network switch, then reserves the deterministic communication route in a reservation phase by sending a reservation message to each network switch of the existing communication route up to the KZPT, and then confirms this deterministic communication route in an accept phase by sending an accept message to the network switches of the existing communication route before the KZPT. 
         [0012]    To solve the above-stated object, in accordance with the invention the parameters of the desired time-controlled route (start time of the provision of the route, end time of the provision of the route, desired bandwidth) are determined by the requesting end system and are communicated to the switches provided in the route. The switches check which time-controlled service quality can be provided in the requested time interval and reserve this service up to a commitment time (KZPT) contained in the request, that is to say the moment up to which the reservation is guaranteed. Here, depending on the utilisation of the switches, a different residence period of the messages in the individual switches may occur. In an iterative method, it is now attempted to minimise the residence periods of the messages in the switches by changing the phase position and the message length, such that a good service quality is achieved. When the requesting end system accepts the guaranteed service quality, it must output a binding service order by means of an accept message before the KZPT and can then use this service in the reserved interval. 
         [0013]    Neither the patent literature [1-5] nor the academic literature discloses information concerning the dynamic structure of a time-controlled route in a large computer network, such as the Internet. 
       SUMMARY OF THE INVENTION 
       [0014]    The present invention thus discloses an innovative method for dynamically establishing a deterministic route with specified service parameters along an existing route in a large computer network. Here, there is no precondition of a central planning authority. In a self-organising method, the switches arranged along the route calculate the parameters of the time-controlled route corresponding to the request. 
         [0015]    Further advantageous embodiments of the method according to the invention are described hereinafter and can be provided additionally, alternatively or in any combination with one another. Here, it may be that
       each network switch independently performs the reservation up to the KZPT in accordance with the reservation message directed thereto from the TTCM and communicates the guaranteed TVD in the provision period and also the NVD and proposals for reducing the TVD to the requesting TTCM, and, following acceptance of the reservation by the TTCM by means of an accept message, confirms the reservation by sending an accept reply message to the TTCM;   a switch rejects a reservation when it has not received an accept message from the TTCM requesting the reservation before the KZPT;   a switch deletes a reservation for a time-controlled route after the EZPT;   the TTCM modifies the reservation request on the basis of the information concerning the quality of the route and proposals for reducing the TVD received by the TTCM from the switches involved in the route and prompts further iterations in order to establish a time-controlled route via the same switches;   the TTCM cancels the iterations when a sought-after quality of the route has been achieved or when a maximum number of iterations has been executed;   the time-controlled route has a multi-point topology;   in a large network a number of TTCMs can establish deterministic communication routes at the same time, and the requests of the TTCMs are processed in the switched in accordance with the temporal order of the BZPT of the reservation message;   a switch, due to a reservation message having a later BZPT which conflicts with a reservation having an earlier BZPT, cancels the reservation having the later BZPT;   the message traffic between the TTCM and the switches is secured by cryptographic methods.       
 
         [0025]    The object stated in the introduction is additionally achieved by a network switch for use in an above-described method and by a TTCM for use in an above-mentioned method. 
         [0026]    The TTCM is preferably part of an end system. 
         [0027]    The object is additionally achieved by a computer network, in particular a large computer network comprising end systems and switches, which is configured to carry out an above-described method. 
     
    
     
       BRIEF DESCRIPTION OF THE DRAWING 
         [0028]    The present invention will be explained in more detail on the basis of the following drawing, in which 
           [0029]      FIG. 1  shows a cyclical illustration of the progress of real time, and 
           [0030]      FIG. 2  shows the structure of a small part of a large network and a route between two end systems. 
       
    
    
     DETAILED DESCRIPTION OF THE INVENTION 
       [0031]      FIG. 1  shows the progress of real time in cycles. In this illustration, the progress of real time is illustrated in the form of periods and phases, In  FIG. 1  time proceeds in the clockwise direction  1110 . The start of a period is synchronised at the time  100  with the global time. An event that occurs within a period (for example the event  101 ) is characterised by the specification of the angle, that is to say the phase, between the start of the period  100  and the event  101 . When the time has passed through a full period—that is to say an angle of 360 degrees—the subsequent period thus starts. In the subsequent period, the time-controlled actions have the same phase as in the previous period. The cyclical image of the progress of real time is particularly well suited for illustrating periodic processes as occur in time-controlled real-time systems. 
         [0032]      FIG. 2  shows a small part of a large computer network. In  FIG. 2  the five end systems  210 ,  211 ,  212 ,  213 ,  214  and the four switches  220 ,  221 ,  222 ,  223  are illustrated. In addition, the route  230  from the end system  210  via the switches  220 ,  221 ,  222 ,  223  to the end system  213  is shown in in  FIG. 2 . 
         [0033]    The progress of a message transmission over time along the route  130  is illustrated in  FIG. 1 . At the time  101 , the end system  210  (the transmitting computer node) starts with the transmission of a message. At the time  102 , following the start latency, the first bit of this message arrives at the switch  220 . The message resides in the switch up to the time  103 , at which the first bit of the message leaves the switch  220  in the direction of the switch  221 . At the time  104 , the first bit of the message arrives at the switch  221 . The period between the event  102  and the event  104  is referred to in a simplified manner as the residence time of the message in the switch  102 . This term (residence time) not only comprises the actual residence time in the switch, but also the time for the transport of the first bit of the message via the communication channel to the following message receiver. The described procedure, repeated up to the time  108 , at which the message arrives at the switch  223  immediately before the receiving end system  213 . Following the residence time in the switch  223 , the first bit of the message arrives at the end system  213  at the time  110 . The transmission of the message is concluded at the time  111 , that is to say the time at which the last bit of the message has arrived at the end system  213 . The interval (110, 111) is referred to as end latency. 
         [0034]    Further terms that are used in this document will be explained hereinafter. A time-controlled route between two end systems is characterised by the exact specification of the phase and period [sec] at the start of the route, the phase and period at the end of the route, and the length [bit] of a time-controlled message. These parameters determine the real-time properties of a route. The bandwidth [bit/second] of the time-controlled route is given from 
         [0000]      bandwidth=(length of a message)/period. 
         [0035]    A desired bandwidth can be achieved either by short messages with short period (or high frequency) or longer messages with longer periods. 
         [0036]    A time-controlled route is structured in physical segments, which are connected via switches. The physical bandwidths along a time-controlled route may be different in the individual segments. The minimum period required by the first bit of a time-controlled message in order to pass from arrival in one switch to arrival in the subsequent switch (or the end system) is referred to as the necessary residence time of the message (NVD) in the switch. The actual residence time required by a time-controlled message in order to pass from arrival in one switch to arrival in the subsequent switch (or the end system) is referred to as the actual residence time (TVD) of the message in the switch. The difference between the necessary residence time and the actual residence time is referred to as the slack of the message. In an optimal time-controlled route, the sum of the slacks in all switches is equal to zero. 
         [0037]    When there is a direct physical connection between the end systems, the latency of a message transmission is given by 
         [0000]      latency=start latency+end latency 
         [0038]    The latency of a time-controlled message along a time-controlled route with N switches is given over channels with identical physical bandwidth by 
         [0000]      actual latency=start latency+TVD in all N switches+end latency 
         [0000]      minimal latency=start latency+NVD in all N switches+end latency 
         [0039]    The quality of a time-controlled route is expressed by the ratio 
         [0000]      quality=(actual latency)/(minimal latency). 
         [0040]    In the ideal case, this ratio is one. 
         [0041]    When the end system  210  intends to establish a time-controlled route for a data stream along the route  230 , the following three-stage method is preferably performed. 
         [0042]    In the first phase (start phase), the time-triggered connection manager (TTCM) of the end system  210  sends a non-binding request with following content to all switches arranged in the route
       desired time-controlled bandwidth of the route   start time of the provision of the route AZPT   end time of the provision of the route EZPT       
 
         [0046]    The switches arranged in the route, that is to say in  FIG. 2  the four switches  220 ,  221 ,  222 ,  223  check which TWD the switch can guarantee in the provision time (that is to say the interval between the start time (AZPT) of the provision of the route and the end time of the provision of the route (EZPT)) and which NVD would be possible in the best case. The TTCM decides on the basis of this information whether an establishment of a time-controlled route along the existing route appears to be expedient or whether a new route has to be sought. 
         [0047]    When the TTCM decides to establish a time-controlled route along the existing route, the second phase (reservation phase) thus starts. The TTCM sends a reservation message with the following content
       desired time-controlled bandwidth of the route   start time of the provision of the route AZPT   end time of the provision of the route EZPT   commitment time of the reservation KZPT   formation time BZPT of the reservation message   start phase and start message length
 
to all switches arranged in the route. The formation time of the reservation message BZPT is the time at which the reservation message was formed. The switches arranged in the route, that is to say in  FIG. 2  the four switches  220 ,  221 ,  222 ,  223 , process this reservation message sequentially in the order in which they occur in the route  230  and reserve the time-controlled connection for the provision time. The last switch in the route from the view of the TTCM, that is to say switch  223  in  FIG. 2 , communicates the successful reservation to the TTCM by means of a confirmation message, in which the guaranteed TVD and NVD in each switch of the route is contained. Furthermore, any switch may present proposals for reducing the TVD in this switch by changing the phase and period (or the message length). After receipt of this information by the TTCM, the TTCM can change the phase and message length in order to reduce the TVDs in the switches in a next iteration of the reservation.
       
 
         [0054]    When the quality of the connection has reached a previously determined level of quality or when a maximum number of iterations has been executed, the TTCM transmits the result to the end user for the decision. 
         [0055]    When the end user accepts the result, the third phase (accept phase) then starts. In the accept phase, an accept message is transmitted by the TTCM to all involved switches before the KZPT in order to confirm the reservation of the time-controlled route. The switch responds with an accept reply message. When no accept message arrives at a switch before the KZPT, the (preliminary) reservation is deleted. 
         [0056]    When a time-controlled route for the specified provision period has been reserved, the route from the switch to the EZPT is deleted autonomously (that is to say at the end of the provision period). 
         [0057]    When a route does not have a point-to-point, but a multi-point topology, the TTCM thus receives the information of all switches arranged in the multi-point route. The TTCM then decides whether a further iteration is necessary on the basis of this information. 
         [0058]    In a large network, in which many end users and switches are provided, a number of TTCMs may be active simultaneously. A deadlock may be reached as a result of uncoordinated parallel reservations. The deadlock is prevented by placing all reservations in a temporal order on the basis of the formation time BZPT of the reservation message contained in the reservation message. When a reservation in a switch, due to a reservation message having a later BZPT, is in conflict with a reservation having an earlier BZPT, the reservation having the later BZPT is thus to be cancelled by the switch. Due to the global time provided, all decisions in the network can thus be placed in a temporal order consistently, such that conflicts can be resolved consistently. Simultaneity can be eliminated by placing the TTCMs in a sequence. 
         [0059]    In order to prevent an intruder from falsely making reservations, the reservation traffic between the TTCM and the switches can be secured by cryptographic methods. 
         [0060]    The proposed innovative method functions in accordance with the fate-sharing model of Clark [7], which mandates that all key state data of a connection are managed in the endpoints of the connection and there is no central authority in the network managing all time-controlled connections. The method builds on the published standards of Ethernet, TT Ethernet [1,8] and IEEE 1588 clock synchronisation [9] and can therefore be incorporated into existing networks without substantial modifications. 
         [0061]    The method disclosed here for self-organising establishment of time-controlled routes in a large computer network brings large economical advantages, since the quality and therefore the applicability of modern network technology is considerably extended. 
       ABBREVIATIONS USED 
       [0062]      
         [0000]    
       
         
               
               
             
           
               
                   
               
             
             
               
                 AZPT 
                 start time of the provision time 
               
               
                 BZPT 
                 formation time of the reservation message 
               
               
                 EZPT 
                 end time of the provision period 
               
               
                 KZPT 
                 commitment time of the reservation 
               
               
                 NVD 
                 necessary residence period of a TT message in a switch 
               
               
                 TT 
                 time-triggered 
               
               
                 TTCM 
                 time-triggered connection manager 
               
               
                 TVD 
                 actual residence time of a TT message in a switch 
               
               
                   
               
             
          
         
       
     
       CITED LITERATURE 
       [0063]    [1] U.S. Pat. No. 7,839,868. Kopetz, H. Communication method and system for the transmission of time-driven and event-driven Ethernet messages. Granted Nov. 23, 2010. 
         [0064]    [2] US 20100220744, Ungerman, J., Intelligent Star Coupler for time-triggered communication protocol and method for communicating between nodes with a network using a time triggered protocol. Publication Date Sep. 2, 2010. 
         [0065]    [3] US 20060242252, Jiang, S., Extensible Scheduling of Messages on Time-Triggered Busses. 
         [0066]    Publication Date Oct. 26, 2006. 
         [0067]    [4] US 20110066854; Poledna, S., Method for Secure Dynamic Bandwidth Allocation in TT Ethernet. Publication Date Mar. 17, 2011 
         [0068]    [5] US 20110032833 Zhang et al. Optimizing of Traffic Routing for Data Center Services. Publication Date Feb. 10, 2011 
         [0069]    [6] Kopetz, H. Real-Time Systems, Design Principles for Distributed Embedded Applications. Springer Publishing House. 2011. 
         [0070]    [7] Clark, D. (1988). The Design Philosophy of the DARPA Internet Protocols. Computer Communication Review. Vol. 18(4). (pp. 106-114). 
         [0071]    [8] SAE Standard AS6802 von TT Ethernet. URL: http://standards.sae.org/as6802 
         [0072]    [9] IEEE 1588 Standard for a Precision Clock Synchronization Protocol for Network Measurement and Control Systems. URL: http://www.ieee1588.com/