Completion performance analysis for internet services

One preferred embodiment of the present invention provides a system and method for analyzing the completion performance of newsgroup services. Briefly described, in architecture, one embodiment of the system, among others, includes a newsgroup evaluation system configured to determine a completion rate for a newsgroup server. The completion rate is saved and displayed to a user. Methods and other systems are also provided.

TECHNICAL FIELD

The present invention is generally related to the Internet and, more particularly, is related to systems and methods for analyzing the performance of Internet services.

BACKGROUND OF THE INVENTION

An Internet service provider (ISP) typically provides a core group of Internet utilities and service to its customers. Core services often include newsgroups along with Email, World Wide Web (WWW), File Transfer Protocol (FTP), Telnet, Internet Relay Chat (IRC), etc. Newsgroups typically include a collection of topical message boards that ISP customers may post to and read messages from. The most widely available distribution of newsgroups is Usenet.

Usenet currently refers to a collection of approximately 90,000 newsgroups and is operated on thousands of newsgroup servers over the Internet or on networks employing the network news transfer protocol (NNTP). To distribute messages or articles within the network, a local newsgroup server for an ISP communicates with other newsgroup servers and compares newsgroup databases. A newsgroup server requests and receives from other servers any messages that the newsgroup server does not have. An ISP customer or newsgroup user may then access his or her local newsgroup server and retrieve messages from the local newsgroup server.

Articles or messages submitted to newsgroups are designed for discussion and are only accepted as text files. However, a binary file can be posted to newsgroups by converting the binary file to a text file. One way to post a binary file on a newsgroup is to use a program supporting UUEncode. UUEncode encodes binary data into a text message that may be posted on a newsgroup. Once posted, a user may retrieve the article or posting from the newsgroup to his or her computer and reconvert the file back to binary data using a UUDecode program. MIME (Multipurpose Internet Mail Extensions), a method used to add binary attachments to email, is another process for encoding binary data into a text message.

Newsgroups are organized into hierarchies based on subject distinctions. For example, several newsgroups are dedicated to binary postings. Binary postings tend to be very large as compared to text postings and do not transmit easily. In fact, some newsgroup servers prohibit posting of articles that are larger than a specific size. Therefore, a system called “Multipart Message” may be used to break up a large binary message into smaller message parts. In the system, many small messages are posted to a newsgroup, rather than one large message. A user may then retrieve all the message parts and reassemble them into a single binary file. A multipart message is identified by examining the end of a message's subject line. All the parts of a multipart message will have a subject line that ends with [xx/yy]. For example, the first part of a 10 part message will end with [01/10] and the fifth part will end with [05/10], etc.

To retrieve or download messages, a user may use a separate newsreader program or a WWW browser with an inbuilt newsreader. The newsreader accesses the ISP's local newsgroup server, enabling a user to pull down as many newsgroups and articles as the user desires. However, to make newsgroups available to users, the ISP's newsgroup server has to dedicate hard drive space for storage. Accordingly, newsgroup articles are only available to users for a limited time before they are deleted to make room for new article postings.

Completion refers to how often all parts of a multipart binary message are available at the same time at one newsgroup. Since all parts of a multipart message are needed to completely reassemble a binary file, it is important for all the parts to be accessible in a newsgroup. Therefore, a completion rate may be specified as a percentage of all the multipart files that are present in a newsgroup at the same time. If a newsgroup has a poor completion rate, then a user probably cannot successfully retrieve and enjoy much of the content in the newsgroup.

Therefore, for an ISP to assess the quality of newsgroup service that it provides to its customers, an ISP needs a legitimate way to test the characteristics of newsgroup service. Thus, a heretofore unaddressed need exists in the industry to address the aforementioned deficiencies and inadequacies.

SUMMARY OF THE INVENTION

Preferred embodiments of the present invention provide a system and method for analyzing completion performance of newsgroup services. Briefly described, in architecture, one embodiment of the system, among others, can be implemented as follows. A newsgroup server supplies newsgroup access to an Internet service provider (ISP). To evaluate the performance of the newsgroup service, a newsgroup evaluation system communicates with the Internet service provider and performs an evaluation task on the newsgroup server to determine completion performance.

One preferred embodiment of the present invention can also be viewed as providing methods for analyzing the completion performance of a newsgroup service. In this regard, one embodiment of such a method, among others, can be broadly summarized by the following steps: determining a completion rate for a newsgroup server; and saving the completion rate.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

Depicted inFIG. 1is a representative embodiment of a system for newsgroup performance analysis100of the present invention. As shown inFIG. 1, system100includes a newsgroup evaluation system110that is adapted to monitor the quality of service being provided by a newsgroup provider to an ISP. The newsgroup provider supplies newsgroup service to an ISP by providing the ISP access to a newsgroup server120that stores messages posted directly to the server via ISP network140or stores messages received from the newsgroup network130. As described in greater detail hereinafter, the newsgroup evaluation system110acquires objective information from the newsgroup server120that is relevant to evaluating the quality of service being provided by the newsgroup provider to an ISP. In this regard, the newsgroup evaluation system110communicates with the newsgroup server120via an ISP network140. As described in greater detail hereinafter, the newsgroup evaluation system110generates output data in various formats based upon the intent of the user.

The ISP network140is the communication network available to an ISP and its customers. Typically, the ISP network140provides access to Internet services such as email, FTP, WWW, IRC, etc. and newsgroups via the newsgroup server120. The newsgroup server120stores and forwards newsgroup articles throughout the newsgroup network130that the newsgroup server120receives from other newsgroup servers or that the newsgroup server120receives from a local user posting. The newsgroup network130is composed of newsgroup servers120that provide access to a collection of newsgroups, such as Usenet. Newsgroup network130may be any type of newsgroup network such as the Internet or a network employing a newsgroup protocol such as, Network News Transfer Protocol (NNTP), for example.

The newsgroup evaluation system110has access to the newsgroup server120. Typically, access is provided through the ISP network140. The newsgroup evaluation system110evaluates the performance of a newsgroup service provider by monitoring the quality of newsgroup services being provided. In particular, the newsgroup evaluation system110analyzes the completion rate of the newsgroup server120.

The newsgroup evaluation system110of the present invention can be implemented in software, firmware, hardware, or a combination thereof. Preferably, the newsgroup evaluation system110is implemented in software, as an executable program, and is executed by a special or general purpose digital computer, such as a personal computer, workstation, minicomputer, or mainframe computer. An example of a general purpose computer that can implement the newsgroup evaluation system of one preferred embodiment of the present invention is shown inFIG. 2.

Generally, in terms of hardware architecture, as shown inFIG. 2, the computer200includes a processor202, memory204, and one or more input and/or output (I/O) devices206(or peripherals) that are communicatively coupled via a local interface208. The local interface208can be, for example but not limited to, one or more buses or other wired or wireless connections, as is known in the art. The local interface208may have additional elements, which are omitted for simplicity, such as controllers, buffers (caches), drivers, repeaters, and receivers, to enable communications. Further, the local interface may include address, control, and/or data connections to enable appropriate communications among the aforementioned components.

The processor202may be a hardware device for executing software that can be stored in memory204. The processor202can be any custom made or commercially available processor, a central processing unit (CPU) or an auxiliary processor among several processors associated with the computer200, and a semiconductor based microprocessor (in the form of a microchip) or a macroprocessor.

The memory204can include any one or combination of volatile memory elements (e.g., random access memory (RAM, such as DRAM, SRAM, etc.)) and nonvolatile memory elements (e.g., ROM, hard drive, tape, CDROM, etc.). Moreover, the memory204may incorporate electronic, magnetic, optical, and/or other types of storage media. Note that the memory204can have a distributed architecture, where various components are situated remote from one another, but can be accessed by the processor202.

The software in memory204may include one or more separate programs, each of which comprises an ordered listing of executable instructions for implementing logical functions. In the example ofFIG. 2, the software in the memory204includes the newsgroup evaluation system110and an operating system (O/S)210. The operating system210essentially controls the execution of other computer programs, and provides scheduling, input-output control, file and data management, memory management, and communication control and related services.

The newsgroup evaluation system110may be a source program, executable program (object code), script, or any other entity comprising a set of instructions to be performed. If the newsgroup evaluation system110is a source program, then the program needs to be translated via a compiler, assembler, interpreter, or the like, which may or may not be included within the memory204, so as to operate properly in connection with the O/S210. Furthermore, the newsgroup evaluation system110can be written as (a) an object oriented programming language, which has classes of data and methods, or (b) a procedure programming language, which has routines, subroutines, and/or functions, for example but not limited to, C, C++, Pascal, Basic, Fortran, Cobol, Perl, Java, and Ada.

The I/O devices206may include input devices, for example but not limited to, a keyboard, mouse, scanner, digital camera, multi-function device, digital sender, microphone, etc. Furthermore, the I/O devices206may also include output devices, for example but not limited to, a printer, display, etc. Finally, the I/O devices206may further include devices that communicate both inputs and outputs, for instance but not limited to, a modulator/demodulator (modem; for accessing another device, system, or network), a radio frequency (RF) or other transceiver, a telephonic interface, a bridge, a router, etc.

If the computer200is a PC, workstation, or the like, the software in the memory204may further include a basic input output system (BIOS) (omitted for simplicity). The BIOS is a set of essential software routines that initialize and test hardware at startup, start the O/S210, and support the transfer of data among the hardware devices. The BIOS is stored in ROM so that the BIOS can be executed when the computer200is activated.

When the computer200is in operation, the processor202is configured to execute software stored within the memory204, to communicate data to and from the memory204, and to generally control operations of the computer200pursuant to the software. The newsgroup evaluation system110and the O/S210, in whole or in part, but typically the latter, are read by the processor202, perhaps buffered within the processor202, and, then executed.

When the newsgroup evaluation system110is implemented in software, as is shown inFIG. 2, it should be noted that the newsgroup evaluation system110can be stored on any computer readable medium for use by or in connection with any computer related system or method. In the context of this document, a computer readable medium is an electronic, magnetic, optical, or other physical device or means that can contain or store a computer program for use by or in connection with a computer related system or method. The newsgroup evaluation system110can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions.

In an alternative embodiment, where the newsgroup evaluation system110is implemented in hardware, the newsgroup evaluation system110can be implemented with any or a combination of the following technologies, which are each well known in the art: a discrete logic circuit(s) having logic gates for implementing logic functions upon data signals, an application specific integrated circuit (ASIC) having appropriate combinational logic gates, a programmable gate array(s) (PGA), a field programmable gate array (FPGA), etc.

The flowcharts ofFIGS. 3-7show the functionality of a representative implementation of the newsgroup evaluation system110of the present invention. It should also be noted that in some alternative implementations the functions noted in the various blocks may occur out of the order depicted in the flowcharts ofFIGS. 3-7. For example, two blocks shown in succession inFIG. 3may, in fact, be executed substantially concurrently. Alternatively, the blocks may sometimes be executed in the reverse order depending upon the functionality involved.

As depicted inFIG. 3, the functionality of a representative embodiment of the newsgroup evaluation system110or method300may be construed as beginning at block310. In block310, a newsgroup server120supplying newsgroup service is provided. In block320, evaluation parameters for an evaluation task are designated. The evaluation task involves the determination of a completion rate for the newsgroup server120. The completion rate is the percentage of all the parts of multipart articles that are present on the newsgroup server120. Evaluation parameters include the criteria for determining this completion rate.

One of the criteria in the evaluation parameters is the minimum completion limit for a newsgroup. The completion limit is the minimum acceptable completion rate for a newsgroup. For example, a completion limit of 85% signifies that 85% of multipart articles in a newsgroup should have all their parts present. Additional evaluation parameters include the name of a newsgroup to be examined; and the minimum size limit of a newsgroup. These evaluation parameters will be discussed in more detail hereinafter.

In block330, a request is generated to perform the evaluation task on the newsgroup server120. The request may be made by a command from a user such as a keystroke from a keyboard or a mouse input. In some embodiments of the invention, a user may schedule for requests of evaluation tasks to be generated. For example, a user may schedule an evaluation task to be performed at the same time every week, several times an hour, etc. Then on the scheduled time and day, a request will automatically be generated for performance of the evaluation task.

Once a request is received in block340, a newsgroup is selected to be the subject of the evaluation task, as depicted in block350. In the evaluation parameters, a particular newsgroup may be designated. Therefore, a known newsgroup that has numerous multipart postings may be desired to be the subject of the evaluation task. As depicted in block360, the evaluation task is performed on the selected newsgroup by determining a completion rate for the newsgroup. An alternative newsgroup could also be designated in the evaluation parameters for performing an evaluation task if an evaluation task cannot be performed on a primary newsgroup.

Evaluation parameters may further include a newsgroup size limit to ensure that a newsgroup has a large number of postings before an evaluation task will be performed. For example, a newsgroup size limit may be set at 100 postings which is an average of 20 postings a day for a retention period of 5 days. If a newsgroup does not satisfy the newsgroup size limit, then the evaluation task would not be performed, since it might be felt that there are not enough articles in the newsgroup to obtain a completion rate.

Referring now to the flowchart ofFIG. 4, the performance of the evaluation task360is described in greater detail for a representative implementation of the invention. In block410, a completion rate is calculated for the selected newsgroup. One manner of determining the completion rate for a particular newsgroup is for the newsgroup evaluation system110to retrieve the list of the newsgroup's article heading, including the subject of each article. From each article's subject heading, the newsgroup evaluation system110can ascertain: (a) if the article is part of a multipart article; (b) the number of parts in the multipart article; and (c) the particular part number the article is, if the article is part of a multipart article. Therefore, the newsgroup evaluation system110can ascertain how many multipart articles are in the newsgroup and can also ascertain how many of these multipart articles have all of their smaller parts present in the newsgroup. A completion rate can then be calculated reflecting the percentage of multipart articles that are complete and can be successfully reassembled in the newsgroup.

After the completion rate is calculated, the completion rate is compared to the minimum completion limit and is assessed a completion grade, as shown in block420. The minimum completion limit is specified in the evaluation parameters. Once the completion rate for a newsgroup is calculated, the completion rate may be compared to the minimum completion limit for the newsgroup. If the completion rate is less than the minimum completion limit, then a completion grade of FAILURE is assessed to the completion rate. Otherwise, a completion grade of PASSING is assessed. In an earlier example, the minimum completion limit for a newsgroup was 85%. Therefore, if the completion rate for a newsgroup is calculated to be 60%, the completion rate is less than the minimum completion limit for that newsgroup. Accordingly, the completion rate is a FAILURE. In block430, the results of the evaluation task comparison are saved.

Referring now to the flowchart ofFIG. 5, the saving of the results from the evaluation task430is described in greater detail for a representative implementation of the invention. In block510, the completion rate and grade for the newsgroup is stored on a storage medium such as a hard drive of a computer. In one embodiment, the completion rate and the completion grade are logged as an entry in a record-keeping database located on the hard drive of the computer. In addition to the completion rate, other information, such as the name of the newsgroup that was the subject of the evaluation task, and the date and time the completion rate was determined, can also be stored. In block520, the results of the evaluation task are displayed to a user of the newsgroup evaluation system110.

Referring now to the flowchart ofFIG. 6, the displaying of the results from the evaluation task520is described in greater detail for a representative implementation of the invention. In block610, the completion rate of the evaluation task and the completion grade are displayed to the user after the evaluation task is completed. Depending upon the intent of the user, the completion rate and grade may be displayed with other relevant information such as the date and time the evaluation task was completed. A user may also retrieve prior results from evaluation tasks since, earlier completion rates and grades are stored on a storage medium.

The completion rates may be presented to a user in a visual pictorial form, such as a graph, table, or chart. InFIG. 6, block620depicts the completion rate being plotted on a graph. The graph may also represent the completion grade for the corresponding completion rate. As depicted in block630, a plot of a completion rate that was a FAILURE may be shaded one color, e.g. red, while a plot of a complete rate that was PASSING may be shaded in another color, e.g. green. Further in block640, the plots of the completion rates on the graph may be linked to the corresponding database entry for that completion rate, so that a user may click on the plot on the graph for a completion rate and have the entry for that particular completion rate from the database be retrieved and displayed to the user, as depicted in block650. It is contemplated that a user of the newsgroup evaluation system110can configure outputs to conform to the user's needs and preferences.

For example, for a completion rate that receives a completion grade of FAILURE, a representative implementation of one preferred embodiment of the present invention sends a notification message to designated recipients, as shown by the flowchart ofFIG. 7. In block710, the evaluation parameters include a list of notification addresses that notification messages are sent to, whenever a FAILURE occurs. The notification list can include an address for one person, multiple addresses for one person, or addresses for more than one person. Typically, the notification address is an email address that can be used to send an email message over the Internet to a person's computer or through wireless communications to a person's wireless communication device, such as, among others, a cell phone or interactive pager. In alternative embodiments, however, the notification address could be an address for other messaging technologies such as instant messaging, for example. When a completion rate is lower than the minimum completion limit for that newsgroup, a notification message is sent to the notification addresses in the notification list, as shown in block720. This is known as a FAILURE result. The notification message informs the recipient that the newsgroup service is not performing at a desired standard. The content of the message contains relevant information about the failed evaluation task such as the name of the newsgroup, the completion rate, and the date and time that the evaluation task took place. In alternative implementations of the invention, different FAILURE count levels (e.g. 5 FAILURES out of 100 completion evaluation tasks, 10 FAILURES in a one month period, etc.) may be tracked to trigger the transmission of notification messages. Accordingly, an ISP can then gauge the quality of newsgroup service being provided by its newsgroup service provider and request compensation from the newsgroup service provider if the service is not satisfactory. Advantageously, the above-described embodiments of the present invention,

assess the completion performance of a newsgroup service. It should be emphasized that the above-described embodiments of the present invention are merely possible examples of implementations, merely set forth for a clear understanding of the principles of the invention. Many variations and modifications may be made to the above-described embodiment(s) of the invention without departing substantially from the principles of the invention. For example, the network evaluation system may randomly select a newsgroup to be the subject of an evaluation task. Also, FAILURE count levels could be compiled from completion rates calculated from more than one newsgroup.

If a newsgroup produces a FAILURE, then the network evaluation system could also send notification messages in the form of voice messages to listed telephone numbers in the evaluation parameters. All such modifications and variations are intended to be included herein within the scope of this disclosure and the present invention and protected by the following claims.