Repository: flutter
Issue: [google_maps_flutter] Scroll not smooth when GoogleMap inside widget tree
Labels: p: maps,package,team-ecosystem,has reproducible steps,P2,triaged-ecosystem,found in release: 3.13,found in release: 3.14

### Is there an existing issue for this?

- [x] I have searched the [existing issues](https://github.com/flutter/flutter/issues)
- [X] I have read the [guide to filing a bug](https://flutter.dev/docs/resources/bug-reports)

### Steps to reproduce

First Issue
- Notice not smooth scroll when have GoogleMap widget  inside widget tree. 

Second Issue
- Often BouncingScrollPhysics stops without inertia. It's looks like forse stop when finger up

### Expected results

Smooth scroll

### Actual results

Scroll not smooth and laggy

### Code sample

<details><summary>Simple code sample with GoogleMap</summary>

```dart
  @override
  Widget build(BuildContext context) {
    return Scaffold(
      body: SingleChildScrollView(
        physics: const BouncingScrollPhysics(),
        child: Column(
          children: [
            Container(
              height: 300,
              color: Colors.purple,
            ),
            const SizedBox(
              height: 300,
              width: 300,
              child: GoogleMap(
                initialCameraPosition: CameraPosition(
                  target: LatLng(37.42796133580664, -122.085749655962),
                  zoom: 14.4746,
                ),
              ),
            ),
            Container(
              height: 300,
              color: Colors.green,
            ),
            Container(
              height: 300,
              color: Colors.yellow,
            ),
          ],
        ),
      ),
    );
  }
```

</details>


### Screenshots or Video

<details>
<summary>Video with laggy scroll and video with normal scroll (without GoogleMap)</summary>

https://github.com/flutter/flutter/assets/2673538/5db199d5-4a27-417a-97a2-e7ef93d75615

https://github.com/flutter/flutter/assets/2673538/1ac34577-3431-4a42-ad63-a90613f4e59a
</details>


### Device
Huawei P10 lite . I know that this device is not so fast but the same thing coded with ReactNative with GoogleMap is working smooth and not laggy on this phone

### Plugin version
google_maps_flutter: ^2.5.0

### Flutter Doctor output

<details><summary>Doctor output</summary>

```console
[√] Flutter (Channel stable, 3.13.3, on Microsoft Windows [Version 10.0.19045.3448], locale ru-RU)
    • Flutter version 3.13.3 on channel stable at C:\Android\sdk\flutter_windows_1.20.2-stable\flutter
    • Upstream repository https://github.com/flutter/flutter.git
    • Framework revision 2524052335 (13 days ago), 2023-09-06 14:32:31 -0700
    • Engine revision b8d35810e9
    • Dart version 3.1.1
    • DevTools version 2.25.0

[√] Windows Version (Installed version of Windows is version 10 or higher)

[√] Android toolchain - develop for Android devices (Android SDK version 34.0.0)
    • Android SDK at C:\Users\kraa\AppData\Local\Android\Sdk
    • Platform android-33, build-tools 34.0.0
    • ANDROID_HOME = C:\Users\kraa\AppData\Local\Android\Sdk
    • Java binary at: C:\Program Files\Android\Android Studio2\jbr\bin\java
    • Java version OpenJDK Runtime Environment (build 17.0.6+0-b2043.56-9586694)
    • All Android licenses accepted.

[√] Chrome - develop for the web
    • Chrome at C:\Program Files\Google\Chrome\Application\chrome.exe

[X] Visual Studio - develop Windows apps
    X Visual Studio not installed; this is necessary to develop Windows apps.
      Download at https://visualstudio.microsoft.com/downloads/.
      Please install the "Desktop development with C++" workload, including all of its default components

[!] Android Studio (version 4.0)
    • Android Studio at C:\Program Files\Android\Android Studio
    • Flutter plugin version 48.1.2
    • Dart plugin version 193.7547
    X Unable to determine bundled Java version.
    • Try updating or re-installing Android Studio.

[!] Android Studio (version 2020.3)
    • Android Studio at C:\Program Files\Android\Android Studio1
    • Flutter plugin can be installed from:
       https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
       https://plugins.jetbrains.com/plugin/6351-dart
    X Unable to determine bundled Java version.
    • Try updating or re-installing Android Studio.

[√] Android Studio (version 2022.2)
    • Android Studio at C:\Program Files\Android\Android Studio2
    • Flutter plugin can be installed from:
       https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
       https://plugins.jetbrains.com/plugin/6351-dart
    • Java version OpenJDK Runtime Environment (build 17.0.6+0-b2043.56-9586694)

[√] Connected device (4 available)
    • ANE LX1 (mobile)  • 9WV7N18401005952 • android-arm64  • Android 9 (API 28)
    • Windows (desktop) • windows          • windows-x64    • Microsoft Windows [Version 10.0.19045.3448]
    • Chrome (web)      • chrome           • web-javascript • Google Chrome 116.0.5845.188
    • Edge (web)        • edge             • web-javascript • Microsoft Edge 116.0.1938.62

[√] Network resources
    • All expected network resources are available.

! Doctor found issues in 3 categories.
```

</details>