KonstantinSeurer
/
mesa
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
mesa/ci-expects/freedreno/deqp-freedreno-a530-fails.txt

67 lines
5.5 KiB
Plaintext
Raw Normal View History

ci/deqp: Switch to a new dEQP runner written in Rust. I found the C++ runner hard to develop on, and we had stability issues and outstanding feature needs that made me want something I felt good about hacking on. Thus, Rewrite It In Rust of the deqp runner. The new runner includes: - Skip lists don't reshuffle the test list. - Known-flake handling without resorting to skip lists (fixing our main CI reliability issue on a3xx right now). - Per-thread Vulkan shader caches should speed up VK CI runtime. - Tracking of crashes separate from fails (so we can see progress on that front). - Logging of deqp stderr spam (particularly assertion failures!) in the CI log. - Integrated QPA filtering so we don't have bash perf issues for it. - Logging of what caselist to go look at for a given error report (in red, so it's easier to find in your CI log). - The code is 1/3 unit tests, and easy to extend for more coverage. - Non-LAVA CI runs create a failures.csv in artifacts that you can check in as your deqp-*-fails.txt file. - Test runtime is included in results.csv so you can debug how to speed up your CI job. - Pretty summary at the end of the run of slow/flaky/failed tests. Since this is a new runner with a different RNG, the test groups are shuffled one more time. This seems to result in some panfrost T720 stability issues (See its new deqp-panfrost-t720-flakes.txt), and one new flake in freedreno a630. Reviewed-by: Tomeu Vizoso <tomeu.vizoso@collabora.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/7434>
2020-10-29 17:29:28 +00:00
dEQP-GLES2.functional.clipping.line.wide_line_clip_viewport_center,Fail
dEQP-GLES2.functional.clipping.line.wide_line_clip_viewport_corner,Fail
dEQP-GLES2.functional.clipping.point.wide_point_clip,Fail
dEQP-GLES2.functional.clipping.point.wide_point_clip_viewport_center,Fail
dEQP-GLES2.functional.clipping.point.wide_point_clip_viewport_corner,Fail
dEQP-GLES2.functional.texture.specification.basic_copytexsubimage2d.2d_alpha,Fail
dEQP-GLES2.functional.texture.specification.basic_copytexsubimage2d.2d_luminance,Fail
ci: Bump deqp to current vulkan-cts-1.2.4 I want the new version to show the fix in the fd-largeconsts branch (and make sure the pass keeps working, and make sure other drivers get around to fixing the issue). While I'm here, cherry-pick in the VK test along with the GLES one, and also the fix for clip_three on ARMs. Since the VK and GL test lists were changing, I took the opportunity to reset freedreno xfails lists to just the tests that are being run with the CTS uprev, and increase its coverage to 1/10th of the CTS across two boards (since we just freed up a bunch of runtime with the grouped gles "other" job). For panfrost, I didn't spend the time characterizing the t720 fragment_ops flakes like I did for the deqp-runner change. Given that the random behavior changes between CTS versions, it doesn't seem to be worth the time to do so. Reviewed-by: Tomeu Vizoso <tomeu.vizoso@collabora.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/6971>
2020-09-30 18:20:22 +01:00
dEQP-GLES2.functional.texture.specification.basic_copytexsubimage2d.2d_rgb,Fail
ci: Bump deqp to current vulkan-cts-1.2.5.0 This new version contains several fixes. v1 (Eric): - Rebuild fail list for freedreno and lavapipe - Move freedreno crashes to skip list Closes: https://gitlab.freedesktop.org/mesa/mesa/-/issues/3902 Reviewed-by: Eric Anholt <eric@anholt.net> Reviewed-by: Dave Airlie <airlied@redhat.com> Signed-off-by: Juan A. Suarez Romero <jasuarez@igalia.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/8088>
2020-12-14 12:57:59 +00:00
dEQP-GLES2.functional.texture.specification.basic_copytexsubimage2d.2d_rgba,Fail
ci/deqp: Switch to a new dEQP runner written in Rust. I found the C++ runner hard to develop on, and we had stability issues and outstanding feature needs that made me want something I felt good about hacking on. Thus, Rewrite It In Rust of the deqp runner. The new runner includes: - Skip lists don't reshuffle the test list. - Known-flake handling without resorting to skip lists (fixing our main CI reliability issue on a3xx right now). - Per-thread Vulkan shader caches should speed up VK CI runtime. - Tracking of crashes separate from fails (so we can see progress on that front). - Logging of deqp stderr spam (particularly assertion failures!) in the CI log. - Integrated QPA filtering so we don't have bash perf issues for it. - Logging of what caselist to go look at for a given error report (in red, so it's easier to find in your CI log). - The code is 1/3 unit tests, and easy to extend for more coverage. - Non-LAVA CI runs create a failures.csv in artifacts that you can check in as your deqp-*-fails.txt file. - Test runtime is included in results.csv so you can debug how to speed up your CI job. - Pretty summary at the end of the run of slow/flaky/failed tests. Since this is a new runner with a different RNG, the test groups are shuffled one more time. This seems to result in some panfrost T720 stability issues (See its new deqp-panfrost-t720-flakes.txt), and one new flake in freedreno a630. Reviewed-by: Tomeu Vizoso <tomeu.vizoso@collabora.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/7434>
2020-10-29 17:29:28 +00:00
dEQP-GLES3.functional.fbo.blit.rect.nearest_consistency_mag_reverse_dst_y,Fail
dEQP-GLES3.functional.transform_feedback.array.interleaved.lines.lowp_float,Fail
dEQP-GLES3.functional.transform_feedback.array.interleaved.lines.mediump_int,Fail
dEQP-GLES3.functional.transform_feedback.array.interleaved.points.highp_mat3x2,Fail
dEQP-GLES3.functional.transform_feedback.array.separate.lines.highp_mat3x4,Fail
dEQP-GLES3.functional.transform_feedback.array.separate.points.lowp_mat2,Fail
dEQP-GLES3.functional.transform_feedback.array.separate.points.mediump_uint,Fail
ci: Bump deqp to current vulkan-cts-1.2.5.0 This new version contains several fixes. v1 (Eric): - Rebuild fail list for freedreno and lavapipe - Move freedreno crashes to skip list Closes: https://gitlab.freedesktop.org/mesa/mesa/-/issues/3902 Reviewed-by: Eric Anholt <eric@anholt.net> Reviewed-by: Dave Airlie <airlied@redhat.com> Signed-off-by: Juan A. Suarez Romero <jasuarez@igalia.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/8088>
2020-12-14 12:57:59 +00:00
dEQP-GLES3.functional.transform_feedback.array_element.interleaved.lines.highp_uvec4,Fail
dEQP-GLES3.functional.transform_feedback.array_element.interleaved.points.highp_vec2,Fail
dEQP-GLES3.functional.transform_feedback.array_element.interleaved.points.lowp_ivec3,Fail
dEQP-GLES3.functional.transform_feedback.array_element.separate.lines.highp_vec4,Fail
dEQP-GLES3.functional.transform_feedback.array_element.separate.lines.lowp_uint,Fail
ci/deqp: Switch to a new dEQP runner written in Rust. I found the C++ runner hard to develop on, and we had stability issues and outstanding feature needs that made me want something I felt good about hacking on. Thus, Rewrite It In Rust of the deqp runner. The new runner includes: - Skip lists don't reshuffle the test list. - Known-flake handling without resorting to skip lists (fixing our main CI reliability issue on a3xx right now). - Per-thread Vulkan shader caches should speed up VK CI runtime. - Tracking of crashes separate from fails (so we can see progress on that front). - Logging of deqp stderr spam (particularly assertion failures!) in the CI log. - Integrated QPA filtering so we don't have bash perf issues for it. - Logging of what caselist to go look at for a given error report (in red, so it's easier to find in your CI log). - The code is 1/3 unit tests, and easy to extend for more coverage. - Non-LAVA CI runs create a failures.csv in artifacts that you can check in as your deqp-*-fails.txt file. - Test runtime is included in results.csv so you can debug how to speed up your CI job. - Pretty summary at the end of the run of slow/flaky/failed tests. Since this is a new runner with a different RNG, the test groups are shuffled one more time. This seems to result in some panfrost T720 stability issues (See its new deqp-panfrost-t720-flakes.txt), and one new flake in freedreno a630. Reviewed-by: Tomeu Vizoso <tomeu.vizoso@collabora.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/7434>
2020-10-29 17:29:28 +00:00
dEQP-GLES3.functional.transform_feedback.basic_types.interleaved.lines.lowp_mat2x4,Fail
dEQP-GLES3.functional.transform_feedback.basic_types.interleaved.lines.mediump_uvec3,Fail
dEQP-GLES3.functional.transform_feedback.basic_types.interleaved.points.highp_int,Fail
dEQP-GLES3.functional.transform_feedback.basic_types.interleaved.points.mediump_float,Fail
dEQP-GLES3.functional.transform_feedback.basic_types.separate.lines.highp_ivec3,Fail
dEQP-GLES3.functional.transform_feedback.basic_types.separate.lines.mediump_vec3,Fail
dEQP-GLES3.functional.transform_feedback.basic_types.separate.points.lowp_mat4x2,Fail
dEQP-GLES3.functional.transform_feedback.position.lines_separate,Fail
dEQP-GLES3.functional.transform_feedback.random.interleaved.lines.3,Fail
dEQP-GLES3.functional.transform_feedback.random.separate.points.3,Fail
ci: Bump deqp to current vulkan-cts-1.2.5.0 This new version contains several fixes. v1 (Eric): - Rebuild fail list for freedreno and lavapipe - Move freedreno crashes to skip list Closes: https://gitlab.freedesktop.org/mesa/mesa/-/issues/3902 Reviewed-by: Eric Anholt <eric@anholt.net> Reviewed-by: Dave Airlie <airlied@redhat.com> Signed-off-by: Juan A. Suarez Romero <jasuarez@igalia.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/8088>
2020-12-14 12:57:59 +00:00
dEQP-GLES3.functional.transform_feedback.random_full_array_capture.separate.triangles.3,Fail
dEQP-GLES31.functional.image_load_store.cube.format_reinterpret.r32i_rgba8,Fail
ci/deqp: Upgrade the runner, enable junit output. I moved QPA-to-XML conversion to the runner, so Mesa CI (and developers!) don't need to do quite so much in bash. I also made it clean up caselist .qpa files since nobody ever wants them and we deleted them anyway. This cleans up a ton of the job log output. Additionally, I added a subcommend to turn the .csv into a junit output that we can expose to gitlab. Now, the pipeline's status page will report the failed testcases, and the "detail" button will give you a link to the .XML to view for the failure. (We don't report all testcases because it's too much load for the gitlab server). Note that this will 404 for the LAVA runners for now, as they don't retain artifacts in gitlab (the plan is to eventually have them minio upload the artifacts). This uprev also includes a deqp output parsing fix, resulting in us catching a couple more failures in some drivers. Reviewed-by: Christian Gmeiner <christian.gmeiner@gmail.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/8206>
2020-12-19 00:47:51 +00:00
dEQP-GLES31.functional.image_load_store.cube.format_reinterpret.rgba32f_rgba32ui,Fail
ci: Bump deqp to current vulkan-cts-1.2.5.0 This new version contains several fixes. v1 (Eric): - Rebuild fail list for freedreno and lavapipe - Move freedreno crashes to skip list Closes: https://gitlab.freedesktop.org/mesa/mesa/-/issues/3902 Reviewed-by: Eric Anholt <eric@anholt.net> Reviewed-by: Dave Airlie <airlied@redhat.com> Signed-off-by: Juan A. Suarez Romero <jasuarez@igalia.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/8088>
2020-12-14 12:57:59 +00:00
dEQP-GLES31.functional.image_load_store.cube.format_reinterpret.rgba8_snorm_r32ui,Fail
dEQP-GLES31.functional.image_load_store.cube.format_reinterpret.rgba8i_r32f,Fail
dEQP-GLES31.functional.image_load_store.cube.load_store.r32f_single_layer,Fail
dEQP-GLES31.functional.image_load_store.cube.load_store.rgba32i_single_layer,Fail
dEQP-GLES31.functional.image_load_store.cube.load_store.rgba8_snorm_single_layer,Fail
dEQP-GLES31.functional.image_load_store.early_fragment_tests.early_fragment_tests_stencil_fbo,Crash
dEQP-GLES31.functional.separate_shader.random.59,Fail
ci/freedreno: Mark some a5xx separate_shader tests as xfails. These almost always fail for us, so we get flake complaints on basically every job. Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/8510>
2021-01-14 23:34:04 +00:00
dEQP-GLES31.functional.separate_shader.random.69,Fail
ci: Bump deqp to current vulkan-cts-1.2.5.0 This new version contains several fixes. v1 (Eric): - Rebuild fail list for freedreno and lavapipe - Move freedreno crashes to skip list Closes: https://gitlab.freedesktop.org/mesa/mesa/-/issues/3902 Reviewed-by: Eric Anholt <eric@anholt.net> Reviewed-by: Dave Airlie <airlied@redhat.com> Signed-off-by: Juan A. Suarez Romero <jasuarez@igalia.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/8088>
2020-12-14 12:57:59 +00:00
dEQP-GLES31.functional.separate_shader.random.79,Fail
ci/freedreno: Mark some a5xx separate_shader tests as xfails. These almost always fail for us, so we get flake complaints on basically every job. Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/8510>
2021-01-14 23:34:04 +00:00
dEQP-GLES31.functional.separate_shader.random.99,Fail
dEQP-GLES31.functional.separate_shader.random.119,Fail
ci/deqp: Bump runner to 0.5.1 for recent runtime perf improvements. 3 commits in 0.5.0: - 20-40s savings on many of our CI runs by dropping the clever test size scaling code. - Even bigger savings (especially on deqp-vk runs) by increasing maximuim test group size (~1/4 of runtime was spawning deqp on cheza, that cost is cut by ~75%) - No more needing to manually set MESA_DEBUG=silent 2 commits in 0.5.1: - Fixed automatic thread pool sizing to keep all CPUs busy (thanks for catching that Bas!). - Automatically size down test groups on short test lists and many CPUs, so split the list evenly between CPUs (such as on freedreno -options jobs). Acked-by: Daniel Stone <daniel@fooishbar.org> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/8787>
2021-01-29 20:58:38 +00:00
dEQP-GLES31.functional.texture.border_clamp.depth_compare_mode.depth24_stencil8.linear_size_pot,Fail
dEQP-GLES31.functional.texture.border_clamp.formats.compressed_rgb8_etc2.gather_size_tile_multiple,Fail
ci: Bump deqp to current vulkan-cts-1.2.5.0 This new version contains several fixes. v1 (Eric): - Rebuild fail list for freedreno and lavapipe - Move freedreno crashes to skip list Closes: https://gitlab.freedesktop.org/mesa/mesa/-/issues/3902 Reviewed-by: Eric Anholt <eric@anholt.net> Reviewed-by: Dave Airlie <airlied@redhat.com> Signed-off-by: Juan A. Suarez Romero <jasuarez@igalia.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/8088>
2020-12-14 12:57:59 +00:00
dEQP-GLES31.functional.texture.border_clamp.formats.compressed_rgba8_etc2_eac.nearest_size_tile_multiple,Fail
ci/deqp: Bump runner to 0.5.1 for recent runtime perf improvements. 3 commits in 0.5.0: - 20-40s savings on many of our CI runs by dropping the clever test size scaling code. - Even bigger savings (especially on deqp-vk runs) by increasing maximuim test group size (~1/4 of runtime was spawning deqp on cheza, that cost is cut by ~75%) - No more needing to manually set MESA_DEBUG=silent 2 commits in 0.5.1: - Fixed automatic thread pool sizing to keep all CPUs busy (thanks for catching that Bas!). - Automatically size down test groups on short test lists and many CPUs, so split the list evenly between CPUs (such as on freedreno -options jobs). Acked-by: Daniel Stone <daniel@fooishbar.org> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/8787>
2021-01-29 20:58:38 +00:00
dEQP-GLES31.functional.texture.border_clamp.formats.depth_component16.nearest_size_pot,Fail
dEQP-GLES31.functional.texture.border_clamp.formats.luminance.nearest_size_pot,Fail
dEQP-GLES31.functional.texture.border_clamp.formats.rg16ui.nearest_size_pot,Fail
dEQP-GLES31.functional.texture.border_clamp.formats.rg32f.nearest_size_pot,Fail
dEQP-GLES31.functional.texture.border_clamp.formats.rg8.gather_size_pot,Fail
dEQP-GLES31.functional.texture.border_clamp.formats.rgb16i.nearest_size_pot,Fail
dEQP-GLES31.functional.texture.border_clamp.formats.rgb565.nearest_size_pot,Fail
dEQP-GLES31.functional.texture.border_clamp.formats.srgb8_alpha8.gather_size_pot,Fail
dEQP-GLES31.functional.texture.border_clamp.per_axis_wrap_mode.texture_3d.int_color.nearest.s_clamp_to_border_t_clamp_to_border_r_clamp_to_border_pot,Fail
dEQP-GLES31.functional.texture.border_clamp.per_axis_wrap_mode.texture_3d.snorm_color.nearest.s_mirrored_repeat_t_clamp_to_border_r_repeat_pot,Fail
dEQP-GLES31.functional.texture.border_clamp.per_axis_wrap_mode.texture_3d.unorm_color.nearest.s_clamp_to_border_t_clamp_to_border_r_clamp_to_border_pot,Fail
dEQP-GLES31.functional.texture.border_clamp.sampler.unorm_depth,Fail
dEQP-GLES31.functional.texture.border_clamp.unused_channels.r8,Fail
ci: Bump deqp to current vulkan-cts-1.2.5.0 This new version contains several fixes. v1 (Eric): - Rebuild fail list for freedreno and lavapipe - Move freedreno crashes to skip list Closes: https://gitlab.freedesktop.org/mesa/mesa/-/issues/3902 Reviewed-by: Eric Anholt <eric@anholt.net> Reviewed-by: Dave Airlie <airlied@redhat.com> Signed-off-by: Juan A. Suarez Romero <jasuarez@igalia.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/8088>
2020-12-14 12:57:59 +00:00
dEQP-GLES31.functional.texture.texture_buffer.modify.bufferdata.buffer_size_131071,Fail
dEQP-GLES31.functional.texture.texture_buffer.render.as_index_array_as_fragment_texture.offset_7_alignments,Fail
dEQP-GLES31.functional.texture.texture_buffer.render.as_vertex_array_as_index_array_as_fragment_texture.offset_1_alignments,Fail
dEQP-GLES31.functional.texture.texture_buffer.render.as_vertex_texture_as_fragment_texture.range_size_98304,Fail
dEQP-GLES31.functional.texture.texture_buffer.state_query.max_texture_buffer_size_getinteger,Fail