Repository: flutter
Issue: RefreshIndicator moves down a bit fast when the viewport is small
Labels: framework,f: material design,f: scrolling,has reproducible steps,P2,found in release: 2.5,found in release: 2.6,team-design,triaged-design

<!-- Thank you for using Flutter!

     If you are looking for support, please check out our documentation
     or consider asking a question on Stack Overflow:
      * https://flutter.dev/
      * https://api.flutter.dev/
      * https://stackoverflow.com/questions/tagged/flutter?sort=frequent

     If you have found a bug or if our documentation doesn't have an answer
     to what you're looking for, then fill out the template below. Please read
     our guide to filing a bug first: https://flutter.dev/docs/resources/bug-reports
-->

## Steps to Reproduce

<!-- Please include full steps to reproduce so that we can reproduce the problem. -->

1. Execute `flutter run` on the code sample <!-- (see "Code sample" section below) -->
2. Pull to refresh
3. See that `RefreshIndicator` moves to bottom too fast 

**Expected results:** <!-- what did you want to see? -->

https://user-images.githubusercontent.com/52235899/144551526-6f36aba0-3b77-4f7c-b9e6-3b4d86a22998.mov


**Actual results:** <!-- what did you see? -->

https://user-images.githubusercontent.com/52235899/144551864-0bf33c71-7c2d-48cc-9be1-210ffa184bca.mov



<details>
<summary>Code sample</summary>

<!--
      Please create a minimal reproducible sample that shows the problem
      and attach it below between the lines with the backticks.

      To create it you can use `flutter create bug` command and update the `main.dart` file.

      Alternatively, you can use https://dartpad.dev/
      which is capable of creating and running small Flutter apps.

      Without this we will unlikely be able to progress on the issue, and because of that
      we regretfully will have to close it.
-->

```dart
import 'package:flutter/material.dart';
import 'package:flutter_pr/costom_nested_scroll%20copy.dart';
import 'package:flutter_pr/narrow_scroll.dart';
import 'package:flutter_pr/nested_scroll.dart';
import 'package:flutter_pr/scroll.dart';

void main() {
  runApp(const MyApp());
}

class MyApp extends StatelessWidget {
  const MyApp({Key? key}) : super(key: key);

  // This widget is the root of your application.
  @override
  Widget build(BuildContext context) {
    return MaterialApp(
      title: 'Flutter Demo',
      theme: ThemeData(
        // This is the theme of your application.
        //
        // Try running your application with "flutter run". You'll see the
        // application has a blue toolbar. Then, without quitting the app, try
        // changing the primarySwatch below to Colors.green and then invoke
        // "hot reload" (press "r" in the console where you ran "flutter run",
        // or simply save your changes to "hot reload" in a Flutter IDE).
        // Notice that the counter didn't reset back to zero; the application
        // is not restarted.
        primarySwatch: Colors.blue,
      ),
      home: const HomePage(),
    );
  }
}

class HomePage extends StatefulWidget {
  const HomePage({Key? key}) : super(key: key);
  @override
  State<HomePage> createState() => _HomePageState();
}

class _HomePageState extends State<HomePage> {
  @override
  Widget build(BuildContext context) {
    return Scaffold(
      appBar: AppBar(
        title: const Text('app bar'),
      ),
      body: RefreshIndicator(
        onRefresh: () {
          return Future.delayed(const Duration(seconds: 1));
        },
        child: Column(
          children: [
            Expanded(
              child: ListView.builder(
                padding: EdgeInsets.zero,
                itemCount: 30,
                itemBuilder: (context, index) {
                  return ListTile(
                    key: Key('$index'),
                    title: Center(
                      child: Text('ListTile ${index + 1}'),
                    ),
                  );
                },
              ),
            ),
            Container(color: Colors.grey, height: 600),
          ],
        ),
      ),
    );
  }
}

```

</details>

<!--
      Consider also attaching screenshots and/or videos to better
      illustrate the issue.

      You can upload them directly on GitHub.
      Beware that video file size is limited to 10MB.
-->

This bug also causes strange movement below

https://user-images.githubusercontent.com/52235899/144552950-6f158b8c-531f-4118-98fb-f99b7d98ab73.mov

I know this bug is caused by too small `ScrollMetrics.viewportDimension`