summaryrefslogtreecommitdiff
path: root/tool/lib/test
AgeCommit message (Collapse)Author
2 daysAdd `--keep-repeating` optionNobuyoshi Nakada
It directs the program to continue repeating the tests the specified number of times, even if any tests fail along the way.
2 daysDump with debugger before killing stuck workerNobuyoshi Nakada
Notes: Merged: https://github.com/ruby/ruby/pull/13618
2025-03-06Show test task names longerNobuyoshi Nakada
Notes: Merged: https://github.com/ruby/ruby/pull/12871
2025-02-27[Misc #20661] Stop retrying tests in `make test-all` command by default (#11271)Naoto Ono
[Misc #20661] Stop retrying tests in make test-all command by default Notes: Merged-By: ono-max <[email protected]>
2025-01-10Extract Benchmark.measure on assert_cpu_usage_lowHiroshi SHIBATA
Notes: Merged: https://github.com/ruby/ruby/pull/12544
2024-09-10Remove an unnecessary blank line added by mistake [ci skip]Nobuyoshi Nakada
2024-09-10Add predicates for platformsNobuyoshi Nakada
Notes: Merged: https://github.com/ruby/ruby/pull/11583
2024-09-04Ignore blocks to `Test::Unit::Assertions#pend` silentlyNobuyoshi Nakada
Although `pend` in test-unit gem expects the block does not pass if it is given, our `pend` should ignore the block silently as same as it just skips the test with no message by default. Add an unused parameter, to suppress the warning for the block to be ignored. Notes: Merged: https://github.com/ruby/ruby/pull/11538
2024-08-22`make test-tool` with Windows is broken. We should use :KILL with that platform.Hiroshi SHIBATA
``` [ 14/191] TestParallel::TestParallel#test_hungup = 11.02 s 1) Failure: TestParallel::TestParallel#test_hungup [C:/Users/hsbt/DevDrive/github.com/ruby/ruby/tool/test/testunit/test_parallel.rb:211]: Expected /^Retrying hung up testcases\.+$/ to match "Run options: \n" + " --seed=35582\n" + " --ruby\n" + " \".\\\\ruby.exe -I../../ruby/lib -I.ext/x64-mswin64_140 -I. ../../ruby/tool/runruby.rb --extout=.ext -- --disable-gems\"\n" + " -j\n" + " t1\n" + " --worker-timeout=1\n" + "\n" + "# Running tests:\n" + "\n" + "[1/1] 50340=test4test_hungup.\n" + "C:/Users/hsbt/DevDrive/github.com/ruby/ruby/tool/lib/test/unit.rb:418:in 'Process.kill': Invalid argument (Errno::EINVAL)\n" + ``` Notes: Merged: https://github.com/ruby/ruby/pull/11430
2024-08-07Use 20min for parallel test worker timeoutYusuke Endoh
2024-08-07Use SIGSEGV to kill a parallel test worker (to dump backtrace)Yusuke Endoh
2024-08-07Wait a bit longer for worker quitYusuke Endoh
2024-08-07Add a log when SIGKILL is sent to a test parallel workerYusuke Endoh
2024-08-07Fix a typoYusuke Endoh
2024-08-06Use 3min for test parallel worker timeout againYusuke Endoh
Notes: Merged: https://github.com/ruby/ruby/pull/11315
2024-08-06Dump all-thread backtraces when test parallel worker exceeds time limitYusuke Endoh
Notes: Merged: https://github.com/ruby/ruby/pull/11315
2024-08-06Extend the default timeout of parallel testing to one hourYusuke Endoh
2024-08-06Extend the default timeout of parallel testingYusuke Endoh
Notes: Merged: https://github.com/ruby/ruby/pull/11311
2024-07-08Move the file location of launchable.rbNaoto Ono
2024-07-08Integrate Launchable into make btestNaoto Ono
2024-06-14Enable LeakChecker for RJIT previously disabled for MJIT (#10998)Alan Wu
RJIT doesn't spawn subprocesses so there should now be no need to special case it.
2024-05-08Show the caller location of assertion methodsNobuyoshi Nakada
Not only defined in `Test::Unit` or `CoreAssertions`, also show the caller location of assertion methods defined in the current class or ancestors.
2024-05-07[PRISM] Enable test_methoddef_endless_commandKevin Newton
2024-04-03Launchable: Add lineNumber fieldNaoto Ono
2024-04-02Launchable: Refactor the logic of JsonStreamWriterNaoto Ono
2024-02-29Inform failures in parallel tests before retryingNobuyoshi Nakada
Displays for each failure which test it actually occurred in. The output destination follows the --{stdout,stderr}-on-failure option.
2024-02-23Add Launchable into CINaoto Ono
2024-02-21Add `Test::Unit::TestCase#method_name`Nobuyoshi Nakada
For the compatibility with test-unit gem.
2024-02-15Show the method owner in backtracesYusuke Endoh
``` test.rb:1:in 'Object#toplevel_meth': unhandled exception from test.rb:4:in 'Foo.class_meth' from test.rb:6:in 'Foo#instance_meth' from test.rb:11:in 'singleton_meth' from test.rb:13:in '<main>' ``` [Feature #19117]
2024-01-31Add newline between end and defNaoto Ono
2024-01-31Add the ability to generate Launchable test reportsNaoto Ono
2023-12-22Get rid of obsoleted RJITFirstTakashi Kokubun
It was renamed from test_mjit, but we did not maintain it as test_rjit. We test RJIT very differently.
2023-11-15Refactor the settings of test-all outYusuke Endoh
test/runner.rb and tool/lib/test/unit/parallel.rb must use the same settings. However, some settings were copied and pasted, while some were added only to test/runner.rb. This changeset creates tool/test/init.rb for all settings of test-unit, which is loaded not only by test/runner.rb but also tool/lib/test/unit/parallel.rb. Background: the GEM_HOME environment variable was removed in test/runner.rb, which prohibit `require "rake"` (note that rake is a bundled gem). However the parallel mode didn't refrect this setting, i.e., `require "rake"` was allowed. This leads to an inconsistency, which actually affected a test test defines s test class *only when* `require "rake"` is successful. (test/rubygems/test_gem_package_task.rb) https://github.com/ruby/ruby/actions/runs/6807729617/job/18511055636#step:8:1714 ``` /home/runner/work/ruby/ruby/src/tool/lib/test/unit.rb:729:in `const_get': uninitialized constant TestGemPackageTask (NameError) suites.map! {|r| ::Object.const_get(r[:testcase])} ^^^^^^^^^^ ```
2023-10-26tool test/unit/testcase: rename vars @passed, @@currentlukeg
to @__passed__, @@__current__. @passed is redefined in a few test suites, and this could lead to bugs. Also rename @options (Runner#options) to @__runner_options__, which is only used in make test-tool anyway.
2023-10-21Fallback job status to normal if no ttyNobuyoshi Nakada
2023-10-18Handle `Timeout::Error` reported from workersNobuyoshi Nakada
2023-10-18Fix total count when filters givenNobuyoshi Nakada
2023-10-18Escape method names containing control charactersNobuyoshi Nakada
2023-10-18Manage parallel test workers after timeoutNobuyoshi Nakada
2023-08-29Expose Test.filter_backtrace for the default gems.Hiroshi SHIBATA
Notes: Merged: https://github.com/ruby/ruby/pull/8313
2023-08-08Add message for `--ruby` option [ci skip]Nobuyoshi Nakada
2023-06-03Exit with a failure if any test files failed to loadNobuyoshi Nakada
Notes: Merged: https://github.com/ruby/ruby/pull/7897
2023-03-06s/mjit/rjit/Takashi Kokubun
Notes: Merged: https://github.com/ruby/ruby/pull/7462
2023-03-06s/MJIT/RJIT/Takashi Kokubun
Notes: Merged: https://github.com/ruby/ruby/pull/7462
2023-02-28fix test/rubygems/test_gem_package_task.rb when in -j modelukeg
This test skipped sometimes due to failure to load 'rake/packagetask'. This is due to manipulation of $LOAD_PATH by other rubygems tests. If rake is loaded before any rubygems tests run, then it works fine. To reproduce the skipping behavior: $ make test-all TESTOPTS="-j6 --test-order=sorted test/rubygems/test_*.rb" Notes: Merged: https://github.com/ruby/ruby/pull/7394
2023-01-18Supressing warnings messages like:Hiroshi SHIBATA
Ignoring debug-1.7.1 because its extensions are not built. Try: gem pristine debug --version 1.7. Revert "Clear gem paths for each test" This reverts commit 6698b580ddad8cfa8c5c86df9328472820d3ee6a.
2023-01-15Clear gem paths for each testNobuyoshi Nakada
So that rubygems can find the bundled rake. Notes: Merged: https://github.com/ruby/ruby/pull/7122
2022-12-01Use class methods of `File` over `Kernel.open` and `IO.read`Nobuyoshi Nakada
Notes: Merged: https://github.com/ruby/ruby/pull/6834
2022-11-07jobserver option may not be at the lastNobuyoshi Nakada
2022-11-07Set `autoclose:` for inherited FDs only [ci skip]Nobuyoshi Nakada