<PAGE>   1
                                            United States
                                 Securities and Exchange Commission
                                       Washington, D.C.  20549

                                              FORM 10-Q/A

(Mark One)

[X]      QUARTERLY REPORT PURSUANT TO SECTION 13 OR 15(d) OF THE
         SECURITIES EXCHANGE ACT OF 1934

For the quarterly period ended:    May 2, 1998
                                       OR
[ ]      TRANSITION REPORT PURSUANT TO SECTION 13 OR 15(d) OF THE
         SECURITIES EXCHANGE ACT OF 1934

For the transition period from __________________ to ________________.

                           Commission File No. 0-21597

                               MAZEL STORES, INC.
                     ---------------------------------------
             (Exact name of Registrant as specified in its charter)

               Ohio                                             34-1830097
-------------------------------                             ------------------
(State or other jurisdiction of                               (I.R.S. Employer
incorporation or organization)                              Identification No.)

                                31000 Aurora Road
                                Solon, Ohio 44139
                   -------------------------------------------
                    (Address of principal executive offices)
                                   (Zip Code)

                                  440-248-5200
                              --------------------
              (Registrant's telephone number, including area code)

               ---------------------------------------------------
              (Former name, former address and former fiscal year,
                          if changed since last report)

         Indicate by check mark whether the registrant (1) has filed all reports
required to be filed by Section 13 or 15(d) of the Securities Exchange Act
during the preceding 12 months (or for such shorter period that the registrant
was required to file such reports), and (2) has been subject to such filing
requirements for the past 90 days. Yes  *    No
                                      ------   -------

         Indicate the number of shares outstanding of each of the issuer's
common stock, as of the latest practical date.

         Common Shares, no par value, outstanding as of May 29, 1998: 9,141,800.



                                     1 of 15

<PAGE>   2



                                   SIGNATURES

        Pursuant to the requirements of the Securities Exchange Act of 1934, the
registrant has duly caused this report to be signed on its behalf by the
undersigned, thereunto duly authorized.


                                        MAZEL STORES, INC.
                                        (Registrant)


6/15/98                                 /s/ Reuven Dessler
--------------------                    -------------------------------------
Date                                    Reuven Dessler
                                        Chairman and Chief Executive Officer



6/15/98                                 /s/ Sue Atkinson
--------------------                    -------------------------------------
Date                                    Sue Atkinson
                                        Senior Vice President -
                                        Chief Financial Officer and Treasurer