Repository: flutter
Issue: Wrong behavior of SingleChildScrollView 
Labels: framework,f: scrolling,a: layout,has reproducible steps,P2,found in release: 3.3,found in release: 3.6,team-framework,triaged-framework

Wrap a Column in the SingleChildScrollView, and create a TextField at the bottom of the Cloumn so that it can be coverd by the keyboard when focus on.Now the SingleChildScrollView can't be dragged, which is the right behavior.
But after you make the textfield focus on and release, the SingleChildScrollView can be dragged, which is a wrong behavior, It should not be able to be dragged.
 
![Simulator Screen Recording - iPhone 14 Pro Max - 2022-11-16 at 17 54 08](https://user-images.githubusercontent.com/11640176/202154211-b28836a0-a10c-4797-905a-f12da8c86d59.gif)


Sample code:
```Dart
import 'package:flutter/material.dart';

void main() {
  runApp(const MyApp());
}

class MyApp extends StatelessWidget {
  const MyApp({super.key});
  @override
  Widget build(BuildContext context) {
    return MaterialApp(
      title: 'Flutter Demo',
      theme: ThemeData(
        primarySwatch: Colors.blue,
      ),
      home: const MyHomePage(title: 'Flutter Demo Home Page'),
    );
  }
}

class MyHomePage extends StatefulWidget {
  const MyHomePage({super.key, required this.title});

  final String title;

  @override
  State<MyHomePage> createState() => _MyHomePageState();
}

class _MyHomePageState extends State<MyHomePage> {
  @override
  Widget build(BuildContext context) {
    return Scaffold(
      appBar: AppBar(
        title: Text(widget.title),
      ),
      body: SingleChildScrollView(
          child: Column(
        children: [
          Container(
              width: MediaQuery.of(context).size.width,
              height: 600,
              color: Colors.red),
          const TextField()
        ],
      )),
    );
  }
}

```
flutter doctor -v:
```


[!] Flutter (Channel master, 3.5.0-12.0.pre.168, on macOS 12.5 21G72 darwin-arm64, locale zh-Hans-CN)
    • Flutter version 3.5.0-12.0.pre.168 on channel master at /Users/hanshow/flutter_gitee/Flutter
    ! Upstream repository https://gitee.com/mirrors/Flutter.git is not a standard remote.
      Set environment variable "FLUTTER_GIT_URL" to https://gitee.com/mirrors/Flutter.git to dismiss this error.
    • Framework revision a1432a9c5d (8 days ago), 2022-11-07 19:17:03 -0600
    • Engine revision e7d7edab98
    • Dart version 2.19.0 (build 2.19.0-374.0.dev)
    • DevTools version 2.19.0
    • Pub download mirror https://pub.flutter-io.cn
    • Flutter download mirror https://storage.flutter-io.cn
    • If those were intentional, you can disregard the above warnings; however it is recommended to use "git" directly to
      perform update checks and upgrades.

[✓] Android toolchain - develop for Android devices (Android SDK version 30.0.3)
    • Android SDK at /Users/hanshow/Library/Android/sdk
    • Platform android-33, build-tools 30.0.3
    • Java binary at: /Users/hanshow/Documents/Android Studio.app/Contents/jre/Contents/Home/bin/java
    • Java version OpenJDK Runtime Environment (build 11.0.13+0-b1751.21-8125866)
    • All Android licenses accepted.

[✓] Xcode - develop for iOS and macOS (Xcode 14.0.1)
    • Xcode at /Applications/Xcode.app/Contents/Developer
    • Build 14A400
    • CocoaPods version 1.11.2

[✓] Android Studio (version 4.2)
    • Android Studio at /Applications/Android Studio.app/Contents
    • Flutter plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/6351-dart
    • Java version OpenJDK Runtime Environment (build 11.0.8+10-b944.6916264)

[✓] Android Studio (version 2021.3)
    • Android Studio at /Users/hanshow/Documents/Android Studio.app/Contents
    • Flutter plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/6351-dart
    • Java version OpenJDK Runtime Environment (build 11.0.13+0-b1751.21-8125866)

[✓] VS Code (version 1.72.2)
    • VS Code at /Applications/Visual Studio Code.app/Contents
    • Flutter extension version 3.52.0

[✓] Connected device (2 available)
    • iPhone 8 Plus (mobile)     • E24E9992-92FF-4F02-A7BD-09C59D229139 • ios • com.apple.CoreSimulator.SimRuntime.iOS-13-1
      (simulator)
    • iPhone 14 Pro Max (mobile) • 52A67EB4-2B9D-45DD-84F3-94D371E6B8D9 • ios • com.apple.CoreSimulator.SimRuntime.iOS-16-0
      (simulator)

[✓] HTTP Host Availability
    • All required HTTP hosts are available

! Doctor found issues in 1 category.
```