Does the word "church" have the same definition in the next two sentences?

There is a lovely little church in the valley.

The church was empty.
the same meaning