This document contains the change log for all JUnit 5 releases since 5.6 GA.
Please refer to the User Guide for comprehensive reference documentation for programmers writing tests, extension authors, and engine authors as well as build tool and IDE vendors.
5.7.0
Date of Release: September 13, 2020
Scope:
-
Promotion of experimental features in JUnit Platform and Jupiter
-
Java Flight Recorder support
-
TestKit improvements
-
@Isolated
tests -
Configurable default method orderer
-
Custom disabled reasons for all
@Enabled*
/@Disabled*
annotations -
Improvements to
assertTimeoutPreemptively()
-
Improvements to
@CsvFileSource
and@CsvSource
For a complete list of all closed issues and pull requests for this release, consult the 5.7 M1, 5.7 RC1, and 5.7 GA milestone pages in the JUnit repository on GitHub.
Overall Improvements
-
Javadoc JARs now contain
package-list
in addition toelement-list
for compatibility with tools like NetBeans 11.
JUnit Platform
Promoted Features
The following APIs have been promoted from "experimental" status:
-
LauncherConstants
is now stable -
LauncherConfig
(except for methods introduced in 5.7) is now stable -
LegacyXmlReportGeneratingListener
is now stable -
org.junit.platform.testkit.engine
is now maintained
Bug Fixes
-
In XML reports generated by the
ConsoleLauncher
orLegacyXmlReportGeneratingListener
, characters in exception messages and other user-supplied values that are not allowed in XML are now replaced with their character reference – for example,\0
becomes�
. -
The
Launcher
now throws an exception when a previously executedTestPlan
is attempted to be executed again.
Deprecations and Breaking Changes
-
In the
EngineTestKit
API, theall()
,containers()
, andtests()
methods inEngineExecutionResults
that were deprecated in JUnit Platform 1.6.0 have been removed in favor ofallEvents()
,containerEvents()
, andtestEvents()
, respectively. -
The following methods in
EngineTestKit
are now deprecated with replacements:-
execute(String, EngineDiscoveryRequest)
→execute(String, LauncherDiscoveryRequest)
-
execute(TestEngine, EngineDiscoveryRequest)
→execute(TestEngine, LauncherDiscoveryRequest)
-
Builder.filters(DiscoveryFilter…)
→Builder.filters(Filter…)
-
-
EngineTestKit
no longer takes into account implicit configuration parameters (i.e. system properties and thejunit-platform.properties
classpath resource) by default. This change makes tests executed viaEngineTestKit
independent of the environment they are executed in.
New Features and Improvements
-
The number of containers and tests excluded by post discovery filters based on their tags is now logged, along with the exclusion reasons.
-
New
junit.platform.execution.listeners.deactivate
configuration parameter that allows one to specify a comma-separated list of patterns for deactivatingTestExecutionListener
implementations registered via theServiceLoader
mechanism. -
The
@Testable
annotation may now be applied directly to fields. -
New
Node.DynamicTestExecutor#execute(TestDescriptor, EngineExecutionListener)
method for engines that wish to provide a customEngineExecutionListener
and cancel or wait for the execution of a submitted test via the returnedFuture
. -
New
EngineExecutionListener.NOOP
EngineExecutionListener
implementation. -
All declared methods in the
EngineExecutionListener
API now have emptydefault
implementations. -
The
EngineTestKit
now reuses the same test discovery and execution logic as theLauncher
. Thus, it’s now possible to test an engine’s behavior in the presence of post-discovery filters (e.g. tag filters) and with regard to pruning. -
The
EngineTestKit
now supports matching conditions with events loosely, i.e. an incomplete match with or without a fixed order. -
The
@Testable
annotation may now target any element type, including fields, methods, classes, packages, and modules. -
When using the
ConsoleLauncher
, classes selected explicitly via--select-class
and--select-method
are now always executed regardless of class name patterns provided via--include-classname
or the default class name pattern. -
The
ConsoleLauncher
now honors the--disable-ansi-colors
option when printing usage help. -
New
FilePosition
support inFileSelector
andClasspathResourceSelector
. -
New
getJavaClass()
andgetJavaMethod()
methods inorg.junit.platform.engine.support.descriptor.MethodSource
. -
Custom
PostDiscoveryFilter
implementations can now be registered via Java’sServiceLoader
mechanism. -
New
org.junit.platform.jfr
module. When running on Java 11 or later, it provides and registers aTestExecutionListener
that generates Java Flight Recorder events. -
The
ExecutionRecorder
injunit-platform-testkit
is now public for fine-grained testing of classes that useEngineExecutionListener
. -
ForkJoinPoolHierarchicalTestExecutorService
can now be constructed by supplying aParallelExecutionConfiguration
. -
HierarchicalTestEngine
now supports a global resource lock.
JUnit Jupiter
Promoted Features
The following APIs have been promoted from experimental to stable:
-
junit-jupiter-migrationsupport
-
junit-jupiter-params
(i.e.@ParameterizedTest
etc.) -
@TestMethodOrder
,MethodOrderer
, and its pre-5.7 implementations -
@DisplayNameGeneration
,DisplayNameGenerator
, and its pre-5.7 implementations -
@Timeout
-
TestInstanceFactory
-
TestInstancePreDestroyCallback
-
TestInstances
and correspondingExtensionContext
methods -
TestWatcher
-
Kotlin-specific assertions that were introduced in 5.1
Bug Fixes
-
@TempDir
is now able to clean up files in read-only directories. -
The Jupiter engine now ignores
MethodSelectors
for methods in non-Jupiter test classes instead of failing for missing methods in such cases. -
CloseableResource
instances stored inExtensionContext.Store
are now closed in the reverse order they were added in. Previously, the order was undefined and unstable. -
Inherited
@BeforeEach
methods are now executed on correct instances for@Nested
classes. -
Registered
TestInstancePreDestroyCallback
extensions are now always called if an instance of a test class was created, regardless whether any registeredTestInstancePostProcessor
extension threw an exception. -
Disabled
@TestTemplate
methods (e.g.@ParameterizedTest
and@RepeatedTest
methods) are now reported to registeredTestWatcher
extensions.
Deprecations and Breaking Changes
-
MethodOrderer.Alphanumeric
has been deprecated in favor ofMethodOrderer.MethodName
which provides the exact same functionality but has a more descriptive name.
New Features and Improvements
-
New
@EnabledIf
and@DisabledIf
annotations can be used to enable or disable a test or container based on condition methods. -
New
MethodOrderer
namedDisplayName
that sorts test methods alphanumerically based on their display names. -
New
DisplayNameGenerator
namedSimple
(based onStandard
) that removes trailing parentheses for methods with no parameters. -
assertThrows()
for Kotlin can now be used with suspending functions and other lambda contexts that require inlining. -
The
JRE
enum now provides a staticcurrentVersion()
method that returns the enum constant for the currently executing JRE, e.g. for use in custom execution conditions and other extensions. -
The
name
attribute of@ParameterizedTest
is now clearly documented to be aMessageFormat
pattern. -
Synthetic constructors are now ignored when instantiating a test class.
-
The Javadoc for the
provideTestTemplateInvocationContexts()
method inTestTemplateInvocationContextProvider
has been aligned with the actual implementation. Providers are now officially allowed to return an empty stream, and the error message when all provided streams are empty is now more helpful. -
New
getDisplayName()
method inMethodDescriptor
for use inMethodOrderer
implementations. -
New
assertLinesMatch()
method overloads inAssertions
that accept twoStream<String>
instances for comparison. -
assertTimeoutPreemptively()
inAssertions
now reports the stack trace of the timed out thread in the cause of theAssertionFailedError
. -
assertTimeoutPreemptively()
now uses threads with a specific name, conveying their use by the framework, to facilitate debugging and stack trace analysis. -
All
@Enabled*
/@Disabled*
annotations now have an optionaldisabledReason
attribute that can be used to provide an additional explanation as to why a test or container might be disabled. -
JAVA_16
has been added to theJRE
enum for use with JRE-based execution conditions. -
New
MethodOrderer.MethodName
to replaceMethodOrderer.Alphanumeric
with the exact same functionality but a more descriptive name. -
New
junit.jupiter.testmethod.order.default
configuration parameter to set the defaultMethodOrderer
that will be used unless@TestMethodOrder
is present. -
New
DynamicTest.stream()
factory method that accepts aStream
instead of anIterator
for the input source. -
@CsvFileSource
now allows one to specify file paths as an alternative to classpath resources. -
@CsvFileSource
and@CsvSource
now provide amaxCharsPerColumn
attribute for configuring the maximum number of characters per column. -
Arguments in display names of parameterized test invocations are now truncated if they exceed a configurable maximum length (defaults to 512 characters).
-
New
@Isolated
annotation allows to run test classes in isolation of other test classes when using parallel test execution. -
New
TypedArgumentConverter
for converting one specific type to another, therefore reducing boilerplate type checks compared to implementingArgumentConverter
directly. -
New
ExtensionContext.getConfigurationParameter(String, Function<String, T>)
convenience method for reading transformed configuration parameters from extensions.
5.6.2
Date of Release: April 10, 2020
Scope: Bug fixes since 5.6.1
For a complete list of all closed issues and pull requests for this release, consult the 5.6.2 milestone page in the JUnit repository on GitHub.
JUnit Platform
Bug Fixes
-
ReflectionSupport.findNestedClasses()
no longer detects inner class cycles for classes that do not match the suppliedPredicate
. For example, JUnit Jupiter no longer throws an exception if an inner class cycle is detected in a nested class hierarchy whose inner classes are not annotated with@Nested
.
5.6.1
Date of Release: March 22, 2020
Scope: Bug fixes since 5.6.0
For a complete list of all closed issues and pull requests for this release, consult the 5.6.1 milestone page in the JUnit repository on GitHub.
5.6.0
Date of Release: January 20, 2020
Scope:
-
New
@EnabledForJreRange
and@DisabledForJreRange
execution conditions -
@Order
allows to specify relative order -
Parameter names are included in default display names of parameterized test invocations
-
Improvements to
@CsvSource
and@CsvFileSource
-
New
TestInstancePreDestroyCallback
extension API -
Performance improvements and bug fixes for the Vintage engine
-
Improved error reporting for failures during test discovery and execution
-
Support for using
any()
andnone()
in tag expressions -
org.junit.platform.console
now provides ajava.util.spi.ToolProvider
-
DiscoverySelectors
for tests in inherited nested classes -
OSGi metadata
-
Minor bug fixes and improvements
For complete details consult the 5.6.0 Release Notes online.