<PAGE>   1
                       SECURITIES AND EXCHANGE COMMISSION
                             Washington, D.C. 20549


                                    FORM 10-K/A

(Mark one)
        [X]    ANNUAL REPORT PURSUANT TO SECTION 13 OR 15(d) OF THE SECURITIES
               EXCHANGE ACT OF 1934 [NO FEE REQUIRED]

                   For the fiscal year ended December 31, 1997

        [ ]    TRANSITION REPORT PURSUANT TO SECTION 13 OR 15(d) OF THE
               SECURITIES EXCHANGE ACT OF 1934 [NO FEE REQUIRED]


                     For the transition period from __ to__.

                           Commission File No. 0-20698

                           BROOKTROUT TECHNOLOGY, INC.
             (Exact name of registrant as specified in its charter)

              MASSACHUSETTS                                 04-2184792
         (State or other jurisdiction of                  (I.R.S.  Employer
         incorporation or organization)                   Identification No.)

                 410 FIRST AVENUE, NEEDHAM, MASSACHUSETTS 02194
               (Address of principal executive offices)(Zip Code)

       Registrant's telephone number, including area code: (781) 449-4100

        Securities registered pursuant to Section 12(b) of the Act: None

                                                 NAME OF EXCHANGE
                  TITLE OF EACH CLASS           ON WHICH REGISTERED
                       ---------                    ----------


    Securities registered pursuant to Section 12(g) of the Act: Common Stock
                                                             (Title of Class)

        Indicate by check mark whether the registrant (1) has filed all reports
required to be filed by Section 13 or 15(d) of the Securities Exchange Act of
1934 during the preceding 12 months (or for such shorter period that the
registrant was required to file such reports), and (2) has been subject to such
filing requirements for the past 90 days.   Yes X   No

        Indicate by check mark if disclosure of delinquent filers pursuant to
Item 405 of Regulation S-K is not contained herein, and will not be contained,
to the best of Registrant's knowledge, in definitive proxy or information
statements incorporated by reference in Part III of this Form 10-K or any
amendment to this Form 10-K. [X]

        As of March 20, 1998, the aggregate market value of the voting stock
held by non-affiliates of the registrant was approximately $164 million, based
on the closing price on such date of the Company's Common Stock on the Nasdaq
National Market ("Nasdaq").

        As of March 20, 1998, 10,753,834 shares of Common Stock, $.01 par value
per share, were outstanding.
<PAGE>   2
Item 14 of the Annual Report on Form 10-K for the year ended December 31, 1997,
filed by Brooktrout Technology, Inc. is hereby amended to include restated
financial data schedules as set forth below:

ITEM 14.       EXHIBITS, FINANCIAL STATEMENT SCHEDULES AND REPORTS ON FORM
               8-K

        (a)(3) Exhibits

        The following exhibits are filed as part of this report. 


 Exhibit
 No.                          Title
----------------------------------------------------------------------------

23.1         Independent Auditors' Consent

27.2         Restated Financial Data Schedules for Fiscal Year ended 1996 and 
             for Quarters 1, 2 and 3 of 1996

27.3         Restated Financial Data Schedules for Quarters 1, 2 and 3 of 1997



<PAGE>   3

    Pursuant to the requirements of Section 13 or 15(d) of the Securities
Exchange Act of 1934, as amended, the Registrant has duly caused this report to
be signed on its behalf by the undersigned, thereunto duly authorized.


                                BROOKTROUT TECHNOLOGY, INC.

                                By: /s/ Eric R. Giler
                                    ---------------------------
                                    Eric R. Giler
                                    President


Date: April 29, 1998


                                  SIGNATURE

    Pursuant to the requirements of the Securities Exchange Act of 1934, this
report has been signed below by the following persons on behalf of the
registrant in the capacities and on the dates indicated.


Signatures                      Title                              Date
----------                      -----                              ----

/s/ Eric R. Giler        President and Director (Principal     April 29, 1998
---------------------    Executive Officer)
Eric R. Giler

                                                               
/s/ Robert C. Leahy      Vice President of Finance and         April 29, 1998
----------------------   Operations and Treasurer 
Robert C. Leahy          (Principal Financial and
                         Accounting Officer)


/s/ David W. Duehren     Vice President and Director           April 29, 1998
----------------------
David W. Duehren

/s/ Patrick T. Hynes     Vice President and Director           April 29, 1998
----------------------
Patrick T. Hynes

/s/ Robert G. Barrett    Director                              April 29, 1998
----------------------
Robert G. Barrett

/s/ David L. Chapman     Director                              April 29, 1998
----------------------
David L. Chapman

/s/ W. Brooke Tunstall   Director                              April 29, 1998
----------------------
W. Brooke Tunstall