testing tab is not showing all tests collected

[henrycomm100]

Type: Bug

1. Go to Testing Tab, click Refresh Tests,
2. It started collecting tests. I can see the tests are being collected in the Output tab
3. The collecting is completed with ======================= 1731 tests collected in 32.27s ========================

Expected Results:
I should see all 1731 tests in the Testing Tab.

Actual Results:

1. But in the Testing Tab, it's only showing 5 cases. All these 5 cases are diretcly writing code in the test methods.
   

2. All other cases will read data from a corresponding .yml file into the test code. And they are not showing in the Testing Tab.
   

It was working fine with previous version of VS Code.

VS Code version: Code 1.89.1 (dc96b837cf6bb4af9cd736aa3af08cf8279f7685, 2024-05-07T05:13:33.891Z)
OS version: Windows_NT x64 10.0.22631
Modes:

System Info

Item	Value
CPUs	Intel(R) Core(TM) i7-10700 CPU @ 2.90GHz (16 x 2904)
GPU Status	2d_canvas: enabled canvas_oop_rasterization: enabled_on direct_rendering_display_compositor: disabled_off_ok gpu_compositing: enabled multiple_raster_threads: enabled_on opengl: enabled_on rasterization: enabled raw_draw: disabled_off_ok skia_graphite: disabled_off video_decode: enabled video_encode: enabled vulkan: disabled_off webgl: enabled webgl2: enabled webgpu: enabled
Load (avg)	undefined
Memory (System)	31.72GB (13.72GB free)
Process Argv	--crash-reporter-id c5f354a2-8dfa-43ed-a15b-1defc4a21b56
Screen Reader	no
VM	0%

Extensions (44)

Extension	Author (truncated)	Version
cucumberautocomplete	ale	2.15.2
featurehighlight	Blo	1.8.0
statistic	cai	0.6.3
path-intellisense	chr	2.8.5
dbclient-jdbc	cwe	1.3.5
vscode-database-client2	cwe	7.3.8
quick-go-to-selected-file-path	duX	0.0.10
gitlens	eam	15.0.4
prettier-vscode	esb	10.4.0
auto-close-tag	for	0.5.15
auto-complete-tag	for	0.1.0
auto-rename-tag	for	0.1.10
code-runner	for	0.12.2
copilot	Git	1.194.0
copilot-chat	Git	0.15.2
remotehub	Git	0.62.0
batch-rename-extension	Jan	0.0.6
linecounter	lyz	0.2.7
theme-monokai-pro-vscode	mon	1.3.2
csdevkit	ms-	1.5.20
csharp	ms-	2.28.11
vscode-dotnet-runtime	ms-	2.0.5
vscodeintellicode-csharp	ms-	2.1.11
autopep8	ms-	2024.0.0
black-formatter	ms-	2024.2.0
debugpy	ms-	2024.6.0
isort	ms-	2023.10.1
python	ms-	2024.6.0
vscode-pylance	ms-	2024.5.1
jupyter	ms-	2024.4.0
jupyter-keymap	ms-	1.1.2
jupyter-renderers	ms-	1.0.17
vscode-jupyter-cell-tags	ms-	0.1.9
vscode-jupyter-slideshow	ms-	0.1.6
remote-containers	ms-	0.362.0
remote-wsl	ms-	0.88.2
azure-repos	ms-	0.38.0
remote-repositories	ms-	0.40.0
material-icon-theme	PKi	5.3.0
vscode-yaml	red	1.14.0
vscode-icons	vsc	12.7.0
JavaScriptSnippets	xab	1.8.0
markdown-all-in-one	yzh	3.6.2
material-theme	zhu	3.17.2

(1 theme extensions excluded)

A/B Experiments

vsliv368:30146709
vspor879:30202332
vspor708:30202333
vspor363:30204092
tftest:31042121
vswsl492cf:30256860
vstes516:30244333
vscod805:30301674
binariesv615:30325510
vsaa593cf:30376535
py29gd2263:31024239
c4g48928:30535728
azure-dev_surveyone:30548225
vscrp:30673768
962ge761:30959799
pythongtdpath:30769146
welcomedialog:30910333
pythonidxpt:30866567
pythonnoceb:30805159
asynctok:30898717
pythontestfixt:30902429
pythonregdiag2:30936856
pyreplss1:30897532
pythonmypyd1:30879173
pythoncet0:30885854
h48ei257:31000450
pythontbext0:30879054
accentitlementst:30995554
dsvsc016:30899300
dsvsc017:30899301
dsvsc018:30899302
cppperfnew:31000557
dsvsc020:30976470
pythonait:31006305
dsvsc021:30996838
01bff139:31013167
fchga941:31038042
dwnewjupytercf:31039676

[eleanorjboyd]

Hi! Thanks so much for the report! What plugins are you using for pytest? Sometimes these are not compatible with our plugin which handles building the test tree for the test explorer view. If you send over the plugins you use and a test which isn't appearing in the sidebar I can give it a try on my machine and see where it is not being interpreted correctly. Thanks!

[henrycomm100]

Hi! Thanks so much for the report! What plugins are you using for pytest? Sometimes these are not compatible with our plugin which handles building the test tree for the test explorer view. If you send over the plugins you use and a test which isn't appearing in the sidebar I can give it a try on my machine and see where it is not being interpreted correctly. Thanks!

@eleanorjboyd Thanks for your reply. This is the list of pytest plugins specified in my requirements.txt file:

pytest==6.2.5
pytest-assume==2.4.3
pytest-azurepipelines==1.0.4
pytest-forked==1.4.0
pytest-xdist==2.5.0
PyYAML==6.0
requests==2.27.1

If you need the complete requirements.txt, let me know. Thanks in advance.

[henrycomm100]

With suggestions by @eleanorjboyd, I updated my pytest plugin to latest version and now the test tree is displaying all tests. Thanks a bunch for all your help.

[eleanorjboyd]

Great stuff! Thanks for the follow up. Happy coding 🥳