<PAGE>

                                                                    EXHIBIT 10.1

                                                                [EXECUTION COPY]

                      FIFTH AMENDMENT TO CREDIT AGREEMENT
                      -----------------------------------

     THIS FIFTH AMENDMENT TO CREDIT AGREEMENT ("this Amendment") dated as of May
31, 2001 but executed on June 13, 2001 is entered into by ALABAMA NATIONAL
BANCORPORATION, a Delaware corporation (the "Borrower") and AMSOUTH BANK, an
Alabama banking corporation and formerly known as AmSouth Bank of Alabama (the
"Lender").

                                    Recitals
                                    --------

     A.   The Borrower and the Lender have entered into a Credit Agreement dated
as of December 29, 1995 as amended by a First Amendment thereto dated as of
January 20, 1997, a Second Amendment thereto dated as of January 19, 1998, a
Third Amendment thereto dated as of May 31, 1999 and a Fourth Amendment thereto
dated as of May 31, 2000 (as so amended, the "Agreement").

     B.   The Borrower and the Lender now desire to further amend the
definitions of "Facility Termination Date" and "Maximum Credit Amount" and to
make the other changes set forth in this Amendment.

                                   Agreement
                                   ---------

     NOW, THEREFORE, in consideration of the recitals and the mutual obligations
and covenants contained herein, the Borrower and the Lender hereby agree as
follows:

     1.   Capitalized terms used in this Amendment and not otherwise defined
herein have the respective meanings attributed thereto in the Agreement.

     2.   The defined term "Facility Termination Date" set forth in Article I of
the Agreement is hereby further amended to read, in its entirety, as follows:

          "Facility Termination Date" means May 31, 2002, as such date may be
           -------------------------
     extended from time to time pursuant to Section 2.5 or accelerated pursuant
     to Section 7.2.

     3.   The defined term "Maximum Credit Amount" set forth in Article I of the
Agreement is hereby amended to read, in its entirety, as follows:

          "Maximum Credit Amount" means $35,000,000.
           ---------------------

     4.   The reference in Section 2.1 of the Agreement to the figure
"$32,000,000" is hereby amended to read "$35,000,000".
<PAGE>

     5.   Exhibit D to the Credit Agreement shall be amended in its entirety and
          ---------
replaced with Revised Exhibit D attached hereto and made a part hereof.
              -----------------

     6.   Notwithstanding the execution of this Amendment, all of the
indebtedness evidenced by the Note shall remain in full force and effect, as
modified hereby, and all of the collateral described in the Agreement and the
Credit Documents shall remain subject to the liens, security interests and
assignments of the Agreement and the Credit Documents as security for the
indebtedness evidenced by the Note and all other indebtedness described therein;
and nothing contained in this Amendment shall be construed to constitute a
novation of the indebtedness evidenced by the Note or to release, satisfy,
discharge, terminate or otherwise affect or impair in any manner whatsoever (a)
the validity or enforceability of the indebtedness evidenced by the Note; (b)
the liens, security interests, assignments and conveyances effected by the
Agreement or the Credit Documents, or the priority thereof; (c) the liability of
any maker, endorser, surety, guarantor or other person that may now or hereafter
be liable under or on account of the Note or the Agreement or the Credit
Documents; or (d) any other security or instrument now or hereafter held by the
Lender as security for or as evidence of any of the above-described
indebtedness.

     7.   All references in the Credit Documents to "Credit Agreement" shall
refer to the Agreement as amended by this Amendment, and as the Agreement may be
further amended from time to time.

     8.   The Borrower certifies that the organizational documents of the
Borrower have not been amended since May 31, 1999.

     9.   The Borrower hereby represents and warrants to the Lender that all
representations and warranties contained in the Agreement are true and correct
as of the date hereof (except representations and warranties that are expressly
limited to an earlier date); and the Borrower hereby certifies that no Event of
Default nor any event that, upon notice or lapse of time or both, would
constitute an Event of Default, has occurred and is continuing.

     10.  Except as hereby amended, the Agreement shall remain in full force and
effect as written.  This Amendment may be executed in one or more counterparts,
each of which shall be deemed an original, and all of which when taken together
shall constitute one and the same instrument.  The covenants and agreements
contained in this Amendment shall apply to and inure to the benefit of and be
binding upon the parties hereto and their respective successors and permitted
assigns.

     11.  Nothing contained herein shall be construed as a waiver,
acknowledgment or consent to any breach of or Event of Default under the
Agreement and the Credit Documents not specifically mentioned herein, and the
consents granted herein are effective only in the specific instance and for the
purposes for which given.

     12.  This Amendment shall be governed by the laws of the State of Alabama.

                                       2
<PAGE>

     IN WITNESS WHEREOF, the Borrower and the Lender have caused this Amendment
to be executed and delivered by their duly authorized corporate officers as of
the date set forth below their signature.

                              ALABAMA NATIONAL BANCORPORATION


                              By  /s/ William E. Matthews, V
                                 --------------------------------------
                                 Its Executive Vice President and Chief
                                  Financial Officer

                              Dated: June 13, 2001


                              AMSOUTH BANK


                              By  /s/ John M. Kettig
                                 --------------------------------------
                                 Its Senior Vice President

                              Dated: June 13, 2001

                                       3
<PAGE>

                                    REVISED
                                   EXHIBIT D
                                   ---------

                        Subsidiaries Stock Information
                        ------------------------------
<TABLE>
<CAPTION>


                                    Certificate   No. of
         Subsidiary                     No.       Shares
----------------------------        -----------  --------
<S>                                 <C>          <C>

1.  National Bank of                    204       659,251
    Commerce of
    Birmingham

2.  Alabama Exchange Bank              C285         3,134

                                       C284        16,006

                                       C283            21

                                       C281           102


3.  Bank of Dadeville                   445         4,000

4.  First Gulf Bank                       2         2,500

5.  Citizens and Peoples                  3        25,000
    Bank National
    Association

6.  First American Bank                 781        20,000

7.  Public Bank of St. Cloud            365       231,550

8.  First Citizens Bank,                553       986 2/3
    Talladega, Alabama

9.  Community Bank of                   001     1,000,000
    Naples, National
    Association

10. Georgia State Bank                    2       453,912

11. Peoples State Bank of                 1           100
    Groveland
</TABLE>

                                      D-1