Repository: flutter
Issue: InteractiveViewer 'scale != 0.0': is not true
Labels: framework,f: material design,f: gestures,has reproducible steps,P2,found in release: 2.0,found in release: 2.3,team-design,triaged-design

## Steps to Reproduce

1. Run InterctiveViewer sample on Android emulator
2. Press CTRL to make pan gesture circles appear
3. Start panning and collapse circles to the point, so they become the one
4. See the assertion failed in console

Code sample can be taken here https://api.flutter.dev/flutter/widgets/InteractiveViewer-class.html

**Expected results:** No error

**Actual results:** Error

<details>
  <summary>Logs</summary>

```
'package:flutter/src/widgets/interactive_viewer.dart': Failed assertion: line 948 pos 12: 'scale != 0.0': is not true.
```

```
Analyzing issues...                                                     

   info - Unused import: 'package:flutter_issue/main.dart' - test\widget_test.dart:2:8 - unused_import

1 issue found. (ran in 3.8s)
```

```
[√] Flutter (Channel master, 2.3.0-1.0.pre.264, on Microsoft Windows [Version 10.0.19041.928], locale ru-RU)
    • Flutter version 2.3.0-1.0.pre.264 at C:\dev\src\flutter
    • Upstream repository git@github.com:nt4f04und/flutter.git
    • Framework revision b3f7ebe069 (15 hours ago), 2021-05-08 08:54:02 +0800
    • Engine revision f57e986aa8
    • Dart version 2.14.0 (build 2.14.0-74.0.dev)

[√] Android toolchain - develop for Android devices (Android SDK version 30.0.2) 
    • Android SDK at C:\Users\danya\AppData\Local\Android\sdk
    • Platform android-30, build-tools 30.0.2
    • Java binary at: C:\Program Files\Android\Android Studio\jre\bin\java       
    • Java version OpenJDK Runtime Environment (build 1.8.0_242-release-1644-b01)
    • All Android licenses accepted.

[√] Chrome - develop for the web
    • Chrome at C:\Program Files\Google\Chrome\Application\chrome.exe

[√] Visual Studio - develop for Windows (Visual Studio Community 2019 16.7.7)
    • Visual Studio at C:\Program Files (x86)\Microsoft Visual Studio\2019\Community
    • Visual Studio Community 2019 version 16.7.30621.155
    • Windows 10 SDK version 10.0.19041.0

[√] Android Studio (version 4.1.0)
    • Android Studio at C:\Program Files\Android\Android Studio
    • Flutter plugin can be installed from:
       https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
       https://plugins.jetbrains.com/plugin/6351-dart
    • Java version OpenJDK Runtime Environment (build 1.8.0_242-release-1644-b01)

[√] IntelliJ IDEA Community Edition (version 2020.3)
    • IntelliJ at C:\Program Files\JetBrains\IntelliJ IDEA Community Edition 2020.3.3
    • Flutter plugin can be installed from:
       https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
       https://plugins.jetbrains.com/plugin/6351-dart

[√] VS Code (version 1.56.0)
    • VS Code at C:\Users\danya\AppData\Local\Programs\Microsoft VS Code
    • Flutter extension version 3.22.0

[√] Connected device (4 available)
    • sdk gphone x86 (mobile) • emulator-5554 • android-x86    • Android 11 (API 30) (emulator)
    • Windows (desktop)       • windows       • windows-x64    • Microsoft Windows [Version 10.0.19041.928]
    • Chrome (web)            • chrome        • web-javascript • Google Chrome 90.0.4430.93
    • Edge (web)              • edge          • web-javascript • Microsoft Edge 90.0.818.46

• No issues found!
```

</details>