***Enhance NWSRFS Deterministic Verification Tools for AWIPS OB8.2***

***User Interface Change Document***

***OSIP 06-023***

***Hank Herr***

Table of Contents

[1.0 Overview 3](#__RefHeading___Toc161712294)

[2.0 Verification Group Manager 3](#__RefHeading___Toc161712295)

[3.0 Verification Location Manager 4](#__RefHeading___Toc161712296)

[4.0 IVP Data Display 6](#__RefHeading___Toc161712297)

[4.1 IVP Data Display: Scatter Plot View
6](#__RefHeading___Toc161712298)

[4.2 IVP Data Display: Time Series View 7](#__RefHeading___Toc161712299)

[5.0 Verification Plot Definition Manager
8](#__RefHeading___Toc161712300)

[6.0 IVP Statistic Chooser Manager 9](#__RefHeading___Toc161712301)

[7.0 IVP Statistic Display 10](#__RefHeading___Toc161712302)

[8.0 IVP Batch File Creation Wizard 12](#__RefHeading___Toc161712303)

[9.0 Vfyruninfo Editor 13](#__RefHeading___Toc161712304)

[10.0 IVP Batch Language 13](#__RefHeading___Toc161712305)

[11.0 IVP Batch Builder 16](#__RefHeading___Toc161712306)

1.  []{#__RefHeading___Toc161712294 .anchor}***Overview***

This document provides descriptions of how the user interface will
change in order to satisfy the requirements outlined for AWIPS OB8.2
delivery of the RFC verification software suite. For the OB7.2 software,
the user interface is described in the User's Manuals, found at

<http://www.nws.noaa.gov/oh/hrl/verification/verification_doc_ob7.php>

Each section that follows describes changes required to either a window
of the Interactive Verification Program or the batch language used in
the IVP Batch Program. Where possible, snapshots of a new prototype
display will be provided.

2.  []{#__RefHeading___Toc161712295 .anchor}***Verification Group
    Manager***

The Verification Group Manager must change to allow the user to input
the following information:

-   Issuance time-of-day interval and subinterval

-   Active/in-active (or both) flag

![](media/image1.png){width="2.9375in" height="3.4583333333333335in"}

![](media/image2.png){width="2.9479166666666665in"
height="3.6881944444444446in"}

Also, the persistence and physical element parts of the window will be
removed. The user will still be able to specify if persistence forecasts
are to be used by including the type source 'FR' in the Forecast Type
Sources text field, or setting it to 'ALL'. As for physical elements,
the user can specify the physical elements by choosing appropriate
locations via the Verification Location Manager.

Screenshots of the OB7.2 Verification Group Manager and a prototype
OB8.2 Verification Group Manager are provided in Figures 1a and 1b.

3.  []{#__RefHeading___Toc161712296 .anchor}***Verification Location
    Manager***

The Verification Location Manager will undergo significant changes in
order to allow for additional data types. The changes are as follows:

-   New columns will be created to display the duration, extremum,
    forecast type source, active state, and the observation type (raw or
    processed) for a location.

-   Existing columns displaying the critical stages will be renamed to
    reflect that those columns will display critical flow values for
    flow data.

-   The one table will be split into two tables: the upper table
    displays locations that can be chosen for display and the lower
    table will display locations currently chosen for display. The
    background colors for the table cells will remain the same:
    white/gray for unchosen locations, pink/red for chosen locations.

-   A location filter panel will be added to the top that allows for
    users to filter out rows from the upper table that do not satisfy
    specified constraints, including physical element, duration,
    extremum, forecast type source, and whether the location has missing
    or non-missing critical stage/flow values.

-   A **Reset Filter** button will be added that will reset the filter
    to include everything.

-   Buttons will be rearranged, so that each table has its own buttons
    to select or deselect all locations. Other buttons will be placed
    between the two tables, meaning that they affect both tables. A new
    button, called **Edit Obs Type** will be added between the two
    tables. It will spawn a small GUI that contains two radio buttons
    labeled "RAW" and "PROCESSED", as well as **Okay** and **Cancel**
    buttons. The **Show** button will be removed; its functionality will
    be added to the IVP Data Display.

Screenshots of the OB7.2 Verification Location Manager and a prototype
OB8.2 Verification Location Manager are provided in Figure 2.

![](media/image3.png){width="4.979166666666667in"
height="1.8020833333333333in"}

4.  []{#__RefHeading___Toc161712297 .anchor}***IVP Data Display***

The IVP Data Display will change partly due to the change in chart
rendering tool from JClass DesktopViews to ChartDirector. This will
result in changes to the fonts, label positions, plot area position, and
other aspects of the chart's appearance. Also the following general
changes will be made:

-   The NOAA logo in the upper left corner and the NWS logo in the upper
    right corner of the displayed chart will be removed. Instead, a NOAA
    water mark will be placed in the background of every chart.

-   ![](media/image5.png){width="4.708333333333333in"
    height="4.21875in"}

-   A new menu item called "View Batch Tokens" will be created allowing
    the user to view the tokens used in order to acquire the data
    displayed. As stated in the design document, the IVP GUI uses tokens
    in order to access the IVP Batch Program software components to
    acquire forecast-observed pairs and compute verification statistics.

    1.  []{#__RefHeading___Toc161712298 .anchor}***IVP Data Display:
        Scatter Plot View***

A Location List Panel will be added to the scatter plot view to allow
for a user to focus on data and categories for a specific location. When
a location is selected, it will be displayed exactly as if the **Show**
button of the Verification Location Manager was click in the AWIPS OB7.2
version of IVP. Locations with data to view will have a green background
within the list.

Screenshots of the OB7.2 IVP Data Display Scatter Plot View and a
prototype OB8.2 IVP Data Display Scatter Plot View are provided in
Figures 3a and 3b.

![](media/image6.png){width="5.584722222222222in"
height="4.532638888888889in"}

2.  []{#__RefHeading___Toc161712299 .anchor}***IVP Data Display: Time
    Series View***

A new time series view will be added to the IVP Data Display, displaying
forecast time series by location and forecast basis time. Also, users
will be able to add observation time series to the display based on the
observation type source. Finally, users will be able to emphasize any
forecast time series by clicking on the legend entry for that time
series. When emphasized, the forecast time series will be highlighted
and the observations paired with each forecast time series will be
shown.

A screenshot of the prototype OB8.2 IVP Data Display time series view is
provided in Figure 3c.

![](media/image6.png){width="5.584722222222222in"
height="4.532638888888889in"}

5.  []{#__RefHeading___Toc161712300 .anchor}***Verification Plot
    Definition Manager***

The Verification Plot Definition Manager will undergo changes to account
for the addition of a comparison variable and variables that can be used
to breakdown statistics. The changes are as follows:

-   A component to be used for specifying the comparison variable will
    be added. It will be similar to the component used to specify the
    x-axis variable.

-   ![](media/image7.png){width="5.592361111111111in"
    height="4.529861111111111in"}

Screenshots of the OB7.2 Verification Plot Definition Manager and a
prototype OB8.2 Verification Plot Definition Manager are provided in
Figure 4.

![](media/image8.png){width="3.285416666666667in" height="3.0in"}

6.  []{#__RefHeading___Toc161712301 .anchor}***IVP Statistic Chooser
    Manager***

The IVP Statistic Chooser Manager will undergo changes to include new
statistics to be produced for OB8.2. Special plots must also be
accounted for. The new statistics will be added to existing groups of
statistics, where reasonable. Otherwise, new statistic groups will be
created. Note that statistics are grouped together if they can be
displayed against the same y-axis. Screenshots of the OB7.2 IVP
Statistic Chooser Manager and a prototype OB8.2 IVP Statistic Chooser
Manager are provided in Figure 6.

7.  []{#__RefHeading___Toc161712302
    .anchor}![](media/image10.png){width="5.155555555555556in"
    height="3.8833333333333333in"}

The IVP Statistic Display will change appearance primarily because the
chart rendering engine will be changed from JClass DesktopViews to
ChartDirector. This will result in changes to the fonts, label
positions, plot area position, and other aspects of the chart's
appearance. Also the following changes will be made:

-   ![](media/image12.png){width="4.571527777777778in"
    height="3.16875in"}

-   A new menu item called View Batch Tokens will be created allowing
    the user to view the batch program tokens used to acquire the data
    displayed. As stated in the design document, the IVP GUI uses tokens
    in order to access the IVP Batch Program software components to
    acquire forecast-observed pairs and compute verification statistics.

Screenshots of the OB7.2 IVP Statistic Display and a prototype OB8.2 IVP
Statistic Display are provided in Figure 6.

8.  []{#__RefHeading___Toc161712303 .anchor}***IVP Batch File Creation
    Wizard***

The IVP Batch File Save Manager will be replaced by the IVP Batch File
Creation Wizard. It will be made possible for the user to create one
graphic displayed in the IVP Statistic Display, and create a batch file
capable of generating the same graphic for a different analysis period
or for many possible combinations of locations, saving each to a
different file.

The user interface will follow a generic wizard design. It will consist
of a sequence of steps, each specifying different aspects of the batch
file. The last step, when completed, will result in the creation of a
batch file.

![](media/image14.png){width="3.532638888888889in"
height="1.9868055555555555in"}

Screenshots of the OB7.2 IVP Batch File Save Manager and the prototype
OB8.2 IVP Batch File Creation Wizard are provided in Figure 7.

9.  []{#__RefHeading___Toc161712304 .anchor}***Vfyruninfo Editor***

The Vfyruninfo Editor main window will be significantly changed to allow
for greater usability and functionality. Specifically, the main window
will be changed to include two tables:

-   A bottom table displaying the user edited locations within the
    vfyruninfo table.

-   A top table displaying verification locations found in the
    ingestfilter table that are not in the top table, and entries that
    were in the bottom table at some time but have been removed.

In addition to the columns of the OB7.2 Vfyruninfo Editor table, the two
new tables will include new columns for the duration, extremum, active
state ('Y' or 'N'), and national flag ('Y' or 'N'), as well as critical
stages and flows as acquired from the rivercrit table, if appropriate.
Furthermore, a location filter panel will be included at the top of the
window, restricting the rows visible in the top table. Lastly, buttons
will be included to allow for selecting rows from the tables, adding
rows to or removing rows from the bottom table, and editing the sensor
preferences, response time, active state, and national flag values of
selected rows.

The Vfyruninfo Record Editor window will change to include text fields
for the duration and extremum.

Screen shots of the OB7.2 Vfyruninfo Editor main window and the OB8.2
prototype are provided in Figure 8, and screenshots of the OB7.2
Vfyruninfo Record Editor and the OB8.2 prototype are provided in Figure
9.

10. []{#__RefHeading___Toc161712305 .anchor}***IVP Batch Language***

The IVP Batch Program batch language shall include the following new
commands:

-   ACTIVE_STATUS: Restricts locations to only those that are active,
    inactive, or both (default). Used for pairing and statistics
    calculation.

-   BREAKDOWN_BY_FCSTTS: Breaks down statistic computation based on the
    forecast type source. Used for statistics calculation.

-   COMP_VARIABLE: Specifies the comparison variable used to further
    break down statistics computation and produce a graphic. The values
    of the comparison variable are shown in the graphic legend. Used for
    graphics.

-   DUR: Restricts locations to only those that have a specified
    duration code. Used for pairing and statistics calculation.

-   EXTREMUM: Restricts locations to only those that have a specified
    extremum code. Used for pairing and statistics calculation.

-   ISSUANCE_START: The start time-of-day (0 -- 24 hours) used to
    restrict the data used in computations based on the forecast
    basistime. Used for statistics calculation.

-   ISSUANCE_END: The end time-of-day (0 -- 24 hours) used to restrict
    the data used in computations based on the forecast basistime. Used
    for statistics calculation.

-   ISSUANCE_STEP: The time step used to break down the issuance
    time-of-day interval into evenly spaced subintervals. Used for
    statistics calculation.

-   OBS_TYPE: Specifies from where the observation is to be drawn for
    constructing and using a pair: "PROCESSED" or "RAW". Used for
    pairing and statistic computation.

> ![](media/image16.png){width="4.701388888888889in" height="3.0in"}

![](media/image18.png){width="2.9479166666666665in"
height="2.701388888888889in"}Possible values for some existing commands
will also be enhanced. For example, acceptable CALCSTATS values will
include new statistics (i.e. MOMENTS for all mean and standard deviation
statistics) and acceptable XAXIS_VARIABLE values will include new
variable values (for example, FCST_TS for forecast type source and
ISSTIME for issuance time).

The following commands are being removed from the batch language for
OB8.2:

-   OBSERVED_TABLE: Was used in OB7.2 to specify if the observations are
    to be drawn from the pehpsep table of the archive database, which is
    a processed table. By default, observations came from the pecrsep
    table, which is a raw table. This batch command is being replaced by
    OBS_TYPE. Whenever the OBSERVED_TABLE value was PEHPSEP, it is
    replaced by an OBS_TYPE value of PROCESSED.

11. []{#__RefHeading___Toc161712306 .anchor}***IVP Batch Builder***

Every new command given in the previous section will have an appropriate
editing tool provided in the IVP Batch Builder. Software for existing
tools will be reused wherever possible. No prototype is currently
available.