Repository: flutter
Issue: Application running on Linux (Ubuntu) Desktop with fractional scaling has fonts scaled while everything else - not
Labels: framework,platform-linux,a: desktop,e: OS-version specific,P2,team-linux,triaged-linux

### Is there an existing issue for this?

- [X] I have searched the [existing issues](https://github.com/flutter/flutter/issues)
- [X] I have read the [guide to filing a bug](https://flutter.dev/docs/resources/bug-reports)

### Steps to reproduce

Linux desktop application has fonts scaled as per global system configuration, while everything else is unscaled.
Before Flutter 3.10 everything was unscaled (global system scaling was ignored) - this was not OK, but yet acceptable to my needs. Now it is broken and get worse: fonts are scaled, not matching all other application elements. 

### Expected results

1. Text size to match specified size: 48.
or
2. All application elements (including red square) to be scaled equally matching global system scale of 1.5

### Actual results

Text is scaled (most likely because of global system fractional scale of 1.5) and is around 1.5 times bigger than expected, while other elements are not scaled

### Code sample

<details><summary>Code sample</summary>

Build following application with Linux Desktop target:

```dart
import 'package:flutter/material.dart';
import 'package:google_fonts/google_fonts.dart';

const double size = 48;

void main() {
  runApp(const MyApp());
}

class MyApp extends StatelessWidget {
  const MyApp({super.key});

  @override
  Widget build(BuildContext context) {
    return MaterialApp(
      home: Material(
        child: DecoratedBox(
          decoration: const BoxDecoration(color: Colors.white),
          child: Center(
            child: DecoratedBox(
              decoration: BoxDecoration(
                border: Border.all(color: Colors.green),
              ),
              child: Row(
                mainAxisSize: MainAxisSize.min,
                crossAxisAlignment: CrossAxisAlignment.center,
                children: [
                  Container(
                    width: size,
                    height: size,
                    color: Colors.red,
                  ),
                  const SizedBox(width: 16),
                  Text(
                    '<- $size size square',
                    style: GoogleFonts.nunitoSans(fontSize: size),
                  )
                ],
              ),
            ),
          ),
        ),
      ),
    );
  }
}
```

</details>


### Screenshots or Video

<details>
<summary>Screenshots / Video demonstration</summary>

![image](https://github.com/flutter/flutter/assets/5489307/64f4c6d8-9815-407d-968d-bac620f51bbf)

</details>


### Logs

_No response_

### Flutter Doctor output

<details><summary>Doctor output</summary>

```console
[✓] Flutter (Channel stable, 3.10.2, on Ubuntu 23.04 6.2.0-20-generic, locale en_US.UTF-8)
    • Flutter version 3.10.2 on channel stable at /home/kernel/work/common/flutter
    • Upstream repository https://github.com/flutter/flutter.git
    • Framework revision 9cd3d0d9ff (4 days ago), 2023-05-23 20:57:28 -0700
    • Engine revision 90fa3ae28f
    • Dart version 3.0.2
    • DevTools version 2.23.1

[✗] Android toolchain - develop for Android devices
    ✗ Unable to locate Android SDK.
      Install Android Studio from: https://developer.android.com/studio/index.html
      On first launch it will assist you in installing the Android SDK components.
      (or visit https://flutter.dev/docs/get-started/install/linux#android-setup for detailed instructions).
      If the Android SDK has been installed to a custom location, please use
      `flutter config --android-sdk` to update to that location.


[✓] Chrome - develop for the web
    • Chrome at google-chrome

[✓] Linux toolchain - develop for Linux desktop
    • Ubuntu clang version 15.0.7
    • cmake version 3.25.1
    • ninja version 1.11.1
    • pkg-config version 1.8.1

[!] Android Studio (not installed)
    • Android Studio not found; download from https://developer.android.com/studio/index.html
      (or visit https://flutter.dev/docs/get-started/install/linux#android-setup for detailed instructions).

[✓] IntelliJ IDEA Ultimate Edition (version 2023.1)
    • IntelliJ at /home/kernel/work/common/idea
    • Flutter plugin version 73.1.1
    • Dart plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/6351-dart

[✓] Connected device (2 available)
    • Linux (desktop) • linux  • linux-x64      • Ubuntu 23.04 6.2.0-20-generic
    • Chrome (web)    • chrome • web-javascript • Google Chrome 113.0.5672.126

[✓] Network resources
    • All expected network resources are available.

! Doctor found issues in 2 categories.

```

</details>