Just-in-Time Survey Results

Just-in-Time (JiT) questions appeared on three of the five stakeholder
Modular Grant web surveys. The web surveys designed for principal
investigators (PIs), institutional officials, and NIH program and grants
management staff each had a unique set of JiT questions in addition to a
common item that asked about overall satisfaction with JiT.

[Overall]{.underline}

-   PIs, institutional official and NIH program and grants management
    staff were asked to rate their overall satisfaction with JiT. Those
    outside of NIH rated JiT much more favorably than those inside NIH.
    Only 48.4% of NIH program and grants management staff reported being
    "very satisfied" or "satisfied" overall with JiT, compared to 72.4%
    of institutional officials and 75.6% of PIs. However, when the total
    PI group was broken out into modular grant award winners and modular
    grant award non-winners, the data show overall satisfaction between
    the PI groups varied greatly with only 61.4% of non-winners compared
    to 81.8% of winners reporting overall satisfaction with JiT.

[Principal Investigators]{.underline}

-   The survey results show 88.1% of PIs reported that not having to
    submit JiT materials at the same time the grant application is due
    saves them time when preparing their applications and 87.1% report
    that JiT makes the grant preparation process easier.

-   About half (49.5%) of the PIs indicated that they were able to
    postpone the preparation of JiT materials until pre-award
    notification. However, more than a quarter (27.7%) didn't seem to
    benefit from the JiT policy, reporting that they cannot postpone the
    preparation of JiT materials until pre-award notification because of
    the time it takes for these materials to be reviewed at their
    institution.

-   PIs were asked to rate their satisfaction with various aspects of
    the JiT policy. The data show 72.8% of PIs are satisfied with the
    time allowed to submit JiT materials once notified they may receive
    an award. However, when broken out by modular grant award winners
    and non-winners, 75.9% of winners compared to 61.5% of non-winners
    report being satisfied with the time allowed to submit JiT materials
    once notified they may receive an award.

-   Overall, 70.2% of PIs were satisfied with the coordination among NIH
    staff asking for JiT materials but further examination shows 73.6%
    of winners compared to only 57.0% of non-winners were satisfied with
    this aspect of JiT.

[Institutional Officials]{.underline}

-   Institutional officials were asked whether JiT increased, decreased,
    or had no effect on administrative burden and procedures.
    Approximately 80 percent (80.3%) thought JiT decreases
    administrative burden because investigators who are not likely to be
    funded do not have to provide these materials with the application.
    More institutional officials disagreed (40.6%) than agreed (32.2%)
    that JiT increases administrative burden because NIH staff
    repeatedly ask for the same materials during the review and award
    process. (The remaining 27.2% responded "neither agree nor
    disagree".) The majority of institutional officials (70.0%)
    disagreed with the statement, "Just-in-Time doesn't have much effect
    on our processes because our investigators prepare these materials
    ahead of time anyway."

[NIH Program and Grants Management Staff]{.underline}

-   Not quite half (45.5%) of NIH staff agreed that in general, the JiT
    procedures make the application process more efficient. The
    remaining respondents either disagreed (35.0%) or felt neutral
    (19.5% reported they neither agreed nor disagreed).

-   More than one third (40.5%) of NIH staff think the JiT procedures do
    not promote stewardship because they (NIH staff) have to rush and
    push the PIs and/or institutional officials to get the necessary
    information.

-   Over 70 percent (70.7%) agreed that one of the best things about the
    JiT procedures is that NIH staff get updated/current information
    from PIs and/or institutional officials.

-   NIH program and grants management staff were asked how much of a
    problem various aspects of JiT procedures are for them. The results
    from this part of the survey are presented in the table below:

+-----------------------------------------+-------+---------+---------+
| How much of a problem is\...            | A big | S       | Not a   |
|                                         | pr    | omewhat | problem |
|                                         | oblem | of a    |         |
|                                         |       | problem | (%)     |
|                                         | (%)   |         |         |
|                                         |       | (%)     |         |
+-----------------------------------------+-------+---------+---------+
|                                         |       |         |         |
+-----------------------------------------+-------+---------+---------+
| Explaining the difference to PIs        | 8.2   | 51.1    | 40.6    |
| between the information required in the |       |         |         |
| submitted biosketch and the information |       |         |         |
| previously needed as part of the Other  |       |         |         |
| Support pages                           |       |         |         |
+-----------------------------------------+-------+---------+---------+
|                                         |       |         |         |
+-----------------------------------------+-------+---------+---------+
| Following up with PIs by email, phone,  | 33.2  | 46.2    | 20.6    |
| or fax to obtain Just-in-Time materials |       |         |         |
| (e.g., IRB/IACUC approval, Other        |       |         |         |
| Support pages)                          |       |         |         |
+-----------------------------------------+-------+---------+---------+
|                                         |       |         |         |
+-----------------------------------------+-------+---------+---------+
| Receiving and managing Just-in-Time     | 16.7  | 43.0    | 40.3    |
| materials from more applicants than     |       |         |         |
| will ultimately be funded               |       |         |         |
+-----------------------------------------+-------+---------+---------+
|                                         |       |         |         |
+-----------------------------------------+-------+---------+---------+