Repository: flutter
Issue: Scrollables inside InteractiveViewer could not scroll to end after scaling/zooming in.
Labels: framework,f: scrolling,has reproducible steps,P3,found in release: 2.2,found in release: 2.4,team-framework,triaged-framework

## Steps to Reproduce

1. Run `flutter create bug`.
2. Update the files as follows: 
**main.dart**
```dart
import 'package:flutter/material.dart';

void main() {
  runApp(MyApp());
}

class MyApp extends StatelessWidget {
  @override
  Widget build(BuildContext context) {
    return MaterialApp(
      title: 'Flutter Demo',
      theme: ThemeData(
        primarySwatch: Colors.blue,
      ),
      home: MyHomePage(title: 'Flutter Demo Home Page'),
    );
  }
}

class MyHomePage extends StatefulWidget {
  MyHomePage({Key? key, required this.title}) : super(key: key);
  final String title;

  @override
  _MyHomePageState createState() => _MyHomePageState();
}

class _MyHomePageState extends State<MyHomePage> {
  @override
  void initState() {
    super.initState();
  }

  @override
  Widget build(BuildContext context) {
    return Scaffold(
      appBar: AppBar(
        title: Text(widget.title),
      ),
      body: InteractiveViewer(
        child: ListView.builder(
          itemBuilder: (_, _index) {
            print(_index);
            return Container(
              color: Colors.grey,
              height: MediaQuery.of(context).size.width * 1.1,
              width: MediaQuery.of(context).size.width,
              padding: EdgeInsets.all(2),
              child: Container(
                padding: EdgeInsets.all(2),
                color: Colors.white,
                child: Column(
                  children: [
                    Text('Page start'),
                    Expanded(
                      child: Center(
                        child: Text('Page index: $_index'),
                      ),
                    ),
                    Text('Paage end'),
                  ],
                ),
              ),
            );
          },
        ),
      ),
    );
  }
}
```
3. Run the app. At initial scale user could scroll to page start label of page with index zero (first page) and page end label of page with index 9 (last page). But after zooming in scrolling to the topmost and bottom most part off the listview is not possible.

**Expected results:**

Must be able to scroll to the top or bottom end of the inner widget after scaling in.

**Actual results:** 
Could not scroll to the top or bottom end of the inner widget after scaling in.

![interactive_scroll_](https://user-images.githubusercontent.com/30487807/125909955-642682e6-26e4-4479-accd-c529178f453d.gif)

<details>
  <summary>Versions</summary>

flutter doctor

```
[✓] Flutter (Channel stable, 2.2.2, on macOS 11.4 20F71 darwin-x64, locale en-IN)
    • Flutter version 2.2.2 at /Users/syncfusion/Nikhil/flutter
    • Framework revision d79295af24 (5 weeks ago), 2021-06-11 08:56:01 -0700
    • Engine revision 91c9fc8fe0
    • Dart version 2.13.3

[✓] Android toolchain - develop for Android devices (Android SDK version 30.0.3)
    • Android SDK at /Users/syncfusion/Library/Android/sdk
    • Platform android-30, build-tools 30.0.3
    • Java binary at: /Applications/Android Studio.app/Contents/jre/jdk/Contents/Home/bin/java
    • Java version OpenJDK Runtime Environment (build 1.8.0_242-release-1644-b3-6915495)
    • All Android licenses accepted.

[✓] Xcode - develop for iOS and macOS
    • Xcode at /Applications/Xcode.app/Contents/Developer
    • Xcode 12.5.1, Build version 12E507
    • CocoaPods version 1.10.1

[✓] Chrome - develop for the web
    • Chrome at /Applications/Google Chrome.app/Contents/MacOS/Google Chrome

[✓] Android Studio
    • Android Studio at /Applications/Android Studio 4.2 Preview.app/Contents
    • Flutter plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/6351-dart
    • Java version OpenJDK Runtime Environment (build 11.0.8+10-b944.6916264)

[✓] Android Studio (version 4.1)
    • Android Studio at /Applications/Android Studio.app/Contents
    • Flutter plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/6351-dart
    • Java version OpenJDK Runtime Environment (build 1.8.0_242-release-1644-b3-6915495)

[✓] VS Code (version 1.58.0)
    • VS Code at /Applications/Visual Studio Code.app/Contents
    • Flutter extension version 3.24.0

[✓] Connected device (3 available)
    • Moto G Play (mobile)       • ZY223JQH6S                           • android-arm    • Android 6.0.1 (API 23)
    • iPhone 12 Pro Max (mobile) • 234B8964-686D-4253-AFB0-83A95023F9D9 • ios            • com.apple.CoreSimulator.SimRuntime.iOS-14-5
      (simulator)
    • Chrome (web)               • chrome                               • web-javascript • Google Chrome 91.0.4472.114

• No issues found!
```

```
Flutter 2.2.2 • channel stable • https://github.com/flutter/flutter.git

Dart SDK version: 2.13.3 (stable) (Wed Jun 9 12:44:44 2021 +0200) on "macos_x64"
```
</details>