[General Topics] tgall-foo:
This week the Linux based testing the uses Openembedded upgraded to a newer version of LTP. The Android based testing will make a similar upgrade in another week or two.*

Two sets of LTS releases were made during the course of the week this report covers. No regressions were observed on Linux nor with Android.

OpenEmbedded

LTP “mm” tests added to LKFT (75 tests/board)

Upgraded kselftest that is run against all stable kernels to 4.20.

Bug Status — 65 open bugs

New bugs due to new kselftest and ltp failures, caused by upgrades

2019–01–29: Rafael Tinoco sent an 8 patch series for new clock_settime tests to LTP — Merged today

2019–01–29: Anders Roxell sent build warning/error patches 1

2019–01–29: Naresh Kamboju sent a patch to fix kselftest config for netfilter

2019–01–28: Anders Roxell sent an initial kselftest result report on -next to kselftest list

2019–01–24: Rafael Tinoco reported ltp/vma05.sh test issue to LTP re: issue 477/bug 4256

2019–01–24: Rafael Tinoco reported ltp/clock_settime_8–1 hardly passes to LTP re: bug 3965

2019–01–24: Naresh Kamboju reported an arm32 build failure on -next

RC Log

2019–01–30

4.9.154, 4.14.97, 4.19.19, 4.20.6

LTP upgraded to 20190115 for all branches

Reported no regressions in <48h

2019–01–24

4.4.172, 4.9.153, 4.14.96, 4.19.18, 4.20.5

kselftest upgraded to 4.20 for all LTS branches

Reported no regressions in <24h

Android

Discussion

4.19 has a fairly high number of failures as part of it’s baseline. Started to look into improving baseline

40 VTS failures due to QTAGUID on 4.19, moving to known failures.*

New LTP testcases, consistent failures

vts-test/arm64-v8a.VtsKernelLtp/VtsKernelLtp.io.aio01_64bit

vts-test/arm64-v8a.VtsKernelLtp/VtsKernelLtp.io.aio02_64bit

vts-test/arm64-v8a.VtsKernelLtp/VtsKernelLtp.syscalls.io_setup01_64bit

vts-test/arm64-v8a.VtsKernelLtp/VtsKernelLtp.syscalls.io_submit01_64bit

vts-test/arm64-v8a.VtsKernelLtp/VtsKernelLtp.syscalls.select04_64bit

vts-test/armeabi-v7a.VtsKernelLtp/VtsKernelLtp.io.aio01_32bit

vts-test/armeabi-v7a.VtsKernelLtp/VtsKernelLtp.io.aio02_32bit

vts-test/armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.io_setup01_32bit

vts-test/armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.io_submit01_32bit

Android 9 / P LTS-premerge — 4.4, 4.9, 4.14, 4.19

4.19.18 — no regressions

4.19.17 — no regressions

4.14.96 — no regressions

4.14.95 — no regressions

4.9.153 — no regressions

4.9.152 — no regressions

4.4.172 — no regressions

4.4.171 — no regressions

Android 9 / P — 4.4, 4.9, 4.14, 4.19 + HiKey

4.19.16 — current, rerun completed for missing CTS from last week otherwise no new data

4.14.94 — current, no new data

4.9.150 — current, no new data

4.4.170 — current, no new data

AOSP-master-tracking — 4.9, 4.14 4.19 / HiKey & 4.14 / X15

Regression reporting for this combination is very difficult until LSS-451 is addressed

4.14.91 / X15

4.9.150 / HiKey

4.14.94 / HiKey

4.19.16 / HiKey

Android 8.1–4.4 + HiKey, 4.14 and X15

4.14.94 / X15 — seems PVR driver is not loading (outdated). Need to test locally, build and upload the driver.

4.4.170 / HiKey — current, no new data

Bugs

22 WtW + 4

New*: 4267, 4268, 4269, 4270