How to debug tests?

[pogopaule]

I struggle to understand what tests in the suite are failing.

If I run make test I get the following output.

❯ make test
make test-langs && make test-langs-tab && make test-chold
make[1]: Verzeichnis „/home/pogopaule/dev/treesj“ wird betreten
nvim --headless -u tests/minimal.lua -c "PlenaryBustedDirectory tests/langs {minimal_init = 'tests/minimal.lua'}"
Starting...
Scheduling: tests/langs/rust/rust_split_spec.lua
Scheduling: tests/langs/rust/rust_join_spec.lua
Scheduling: tests/langs/go_spec.lua
Scheduling: tests/langs/svelte_spec.lua
Scheduling: tests/langs/css_spec.lua
Scheduling: tests/langs/ruby_spec.lua
Scheduling: tests/langs/typescript/typescript_spec.lua
Scheduling: tests/langs/typescript/tsx_spec.lua
Scheduling: tests/langs/javascript/javascript_split_spec.lua
Scheduling: tests/langs/javascript/javascript_join_spec.lua
Scheduling: tests/langs/javascript/jsx_last_indent_spec.lua
Scheduling: tests/langs/javascript/javascript_rec_spec.lua
Scheduling: tests/langs/javascript/jsx_spec.lua
Scheduling: tests/langs/php_spec.lua
Scheduling: tests/langs/scss_spec.lua
Scheduling: tests/langs/python/python_join_spec.lua
Scheduling: tests/langs/python/python_split_spec.lua
Scheduling: tests/langs/lua_spec.lua
Scheduling: tests/langs/pug_spec.lua
Scheduling: tests/langs/lua_rec_spec.lua
Scheduling: tests/langs/r/r_join_spec.lua
Scheduling: tests/langs/r/r_split_spec.lua
Scheduling: tests/langs/vue_spec.lua
Scheduling: tests/langs/java_spec.lua
Scheduling: tests/langs/c_spec.lua
Scheduling: tests/langs/json_spec.lua
Scheduling: tests/langs/cpp_spec.lua
Scheduling: tests/langs/html/html_last_indent_spec.lua
Scheduling: tests/langs/html/html_spec.lua
Scheduling: tests/langs/html/html_no_empty_spec.lua
Scheduling: tests/langs/lua_no_empty_spec.lua
make[1]: *** [Makefile:5: test-langs] Fehler 1
make[1]: Verzeichnis „/home/pogopaule/dev/treesj“ wird verlassen
make: *** [Makefile:14: test] Fehler 2

If I understand plenary busted correctly it is the correct behaviour to just show exit codes. But how do I run e.g. just one test file and see the output of failing tests?

[Wansmer]

Sorry for the long wait. Are you an make preinstall-js-parsers before running make test?
It's no look like any test not passed. It is look, like something went wrong when test vim starting.

[pogopaule]

No worries! Thank you for answering.
I figured out the problem by digging a bit into plenary.nvim.

If I just run a single test, or run the tests sequentially I get this error message which helped me to figure out the problem:

E5108: Error executing lua ...site/pack/deps/start/plenary.nvim/lua/plenary/busted.lua:265: tests/langs/nix_spec.lua:1: module 'tests.utils' not found:
        no field package.preload['tests.utils']
        no file '/nix/store/p9jha0b6hkfl09y6hs39j56bkxzrsbn8-luajit-2.1.0-2022-10-04-env/share/lua/5.1/tests/utils.lua'
        no file '/nix/store/p9jha0b6hkfl09y6hs39j56bkxzrsbn8-luajit-2.1.0-2022-10-04-env/share/lua/5.1/tests/utils/init.lua'
        no file '/home/pogopaule/dev/treesj/tests/tests/utils.lua'
        no file '/nix/store/p9jha0b6hkfl09y6hs39j56bkxzrsbn8-luajit-2.1.0-2022-10-04-env/lib/lua/5.1/tests/utils.so'
        no file '/nix/store/p9jha0b6hkfl09y6hs39j56bkxzrsbn8-luajit-2.1.0-2022-10-04-env/lib/lua/5.1/tests.so'
stack traceback:
        [builtin#36]: at 0x7f1b164fa510
        ...site/pack/deps/start/plenary.nvim/lua/plenary/busted.lua:265: in function 'run'
        [string ":lua"]:1: in main chunk

Lua does not find files that are not inside the lua folder. So my quick fix for the moment is to copy utils.lua into lua/tests/. Not sure how or where to set paths or variables correctly so that my lua finds stuff outside lua folders...

[Wansmer]

For the specific test to run, you can create your own make-command in Makefile, e.g.:

test-specific-test:
	nvim --headless -u tests/minimal.lua -c "PlenaryBustedDirectory tests/langs/javascript_spec.lua {minimal_init = 'tests/minimal.lua'}"

[pogopaule]

What I did was to use:

nvim --headless -u tests/minimal.lua -c "PlenaryBustedFile tests/langs/nix_spec.lua"

It also works to run a single test.