Repository: flutter
Issue: `NeverScrollableScrollPhysics` does not work as expected with `ScrollConfiguration`
Labels: framework,f: scrolling,has reproducible steps,P2,found in release: 3.3,found in release: 3.4,team-framework,triaged-framework

I want to **disable scroll functionality** for all of the widgets in a widget tree at a certain point in time. I figured best way to achieve this is to use `ScrollConfiguration` since the scroll physics defined in configuration applies to all scrollables in its child subtree. Other physics like `BouncingScrollPhysics` and `ClampingScrollPhysics` work just fine but using `NeverScrollableScrollPhysics` does not prevent scrolling in some scrollables and creates a drag and drop style physics.

## Steps to Reproduce

Paste the code below into your `main.dart`

<details>
<summary>main.dart</summary>

```dart
import 'package:flutter/material.dart';
import 'package:flutter/services.dart';

void main() {
  WidgetsFlutterBinding.ensureInitialized();
  SystemChrome.setEnabledSystemUIMode(SystemUiMode.edgeToEdge);
  SystemChrome.setSystemUIOverlayStyle(
    const SystemUiOverlayStyle(
      systemNavigationBarColor: Colors.transparent,
      statusBarColor: Colors.transparent,
      statusBarIconBrightness: Brightness.dark,
    ),
  );

  runApp(const MyApp());
}

class MyApp extends StatelessWidget {
  const MyApp({Key? key}) : super(key: key);

  @override
  Widget build(BuildContext context) {
    return MaterialApp(
      debugShowCheckedModeBanner: false,
      title: 'Flutter Playground',
      theme: ThemeData(
        primarySwatch: Colors.blue,
      ),
      home: const MyHomePage(),
    );
  }
}

class MyScrollBehavior extends ScrollBehavior {
  const MyScrollBehavior();

  @override
  ScrollPhysics getScrollPhysics(BuildContext context) {
    return const NeverScrollableScrollPhysics();
  }
}

class MyHomePage extends StatelessWidget {
  const MyHomePage({super.key});

  @override
  Widget build(BuildContext context) {
    final safeArea = MediaQuery.of(context).padding;

    return Scaffold(
      body: ScrollConfiguration(
        behavior: const MyScrollBehavior(),
        child: ListView.separated(
          padding: EdgeInsets.only(
            top: safeArea.top + 16,
            bottom: safeArea.bottom + 16,
          ),
          itemCount: 8,
          separatorBuilder: (context, index) => const SizedBox(height: 16),
          itemBuilder: (context, rowIndex) {
            return SizedBox(
              height: 132,
              child: ListView.separated(
                padding: EdgeInsets.only(
                  left: safeArea.left + 16,
                  right: safeArea.right + 16,
                ),
                scrollDirection: Axis.horizontal,
                itemCount: 4,
                separatorBuilder: (context, index) => const SizedBox(width: 16),
                itemBuilder: (context, columnIndex) {
                  return Container(
                    width: 132,
                    color: Colors.orangeAccent,
                    child: Center(
                      child: Text(
                        '$rowIndex.$columnIndex',
                        style: const TextStyle(fontSize: 24),
                      ),
                    ),
                  );
                },
              ),
            );
          },
        ),
      ),
    );
  }
}
```

</details>

**Expected results:**

I expected to see scrollable functionality disabled for the child subtree of `ScrollConfiguration` with `NeverScrollableScrollPhysics`.

**Actual results:**

An unexpected drag and drop effect on vertical `ListView`, horizontal `ListView`s work as expected.

https://user-images.githubusercontent.com/45076094/189066841-f203296e-a576-42aa-98bb-4cc7d5090baa.mp4

Below example shows how configuration works with `BouncingScrollPhysics`, which works as expected.

https://user-images.githubusercontent.com/45076094/189067030-c3300bf9-d443-4772-a0fc-6f0e4b38b55b.mp4

<details>
  <summary>Logs</summary>

<!--
     Run `flutter analyze` and attach any output of that command below.
     If there are any analysis errors, try resolving them before filing this issue.
-->

```
flutter analyze
Analyzing playground...                                                 
No issues found! (ran in 14.9s)
```

<!-- Finally, paste the output of running `flutter doctor -v` here. -->

```
flutter doctor -v
[√] Flutter (Channel stable, 3.3.0, on Microsoft Windows [Version 10.0.19044.1949], locale en-US)
    • Flutter version 3.3.0 on channel stable at D:\sdk\flutter
    • Upstream repository https://github.com/flutter/flutter.git
    • Framework revision ffccd96b62 (9 days ago), 2022-08-29 17:28:57 -0700
    • Engine revision 5e9e0e0aa8
    • Dart version 2.18.0
    • DevTools version 2.15.0

[√] Android toolchain - develop for Android devices (Android SDK version 33.0.0)
    • Android SDK at D:\sdk\android
    • Platform android-32, build-tools 33.0.0
    • Java binary at: C:\Program Files\Android\Android Studio\jre\bin\java
    • Java version OpenJDK Runtime Environment (build 11.0.12+7-b1504.28-7817840)
    • All Android licenses accepted.

[X] Chrome - develop for the web (Cannot find Chrome executable at .\Google\Chrome\Application\chrome.exe)
    ! Cannot find Chrome. Try setting CHROME_EXECUTABLE to a Chrome executable.

[√] Visual Studio - develop for Windows (Visual Studio Community 2022 17.2.5)
    • Visual Studio at C:\Program Files\Microsoft Visual Studio\2022\Community
    • Visual Studio Community 2022 version 17.2.32616.157
    • Windows 10 SDK version 10.0.19041.0

[√] Android Studio (version 2021.2)
    • Android Studio at C:\Program Files\Android\Android Studio
    • Flutter plugin can be installed from:
       https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
       https://plugins.jetbrains.com/plugin/6351-dart
    • Java version OpenJDK Runtime Environment (build 11.0.12+7-b1504.28-7817840)

[√] VS Code (version 1.71.0)
    • VS Code at C:\Users\Rasit Ayaz\AppData\Local\Programs\Microsoft VS Code
    • Flutter extension version 3.48.0

[√] Connected device (3 available)
    • sdk gphone64 x86 64 (mobile) • emulator-5554 • android-x64    • Android 12 (API 32) (emulator)
    • Windows (desktop)            • windows       • windows-x64    • Microsoft Windows [Version 10.0.19044.1949]
    • Edge (web)                   • edge          • web-javascript • Microsoft Edge 105.0.1343.27

[√] HTTP Host Availability
    • All required HTTP hosts are available

! Doctor found issues in 1 category.
```

</details>


<!--
      Consider also attaching screenshots and/or videos to better
      illustrate the issue.

      You can upload them directly on GitHub.
      Beware that video file size is limited to 10MB.
-->