org.scalatest.WordSpec.scala Maven / Gradle / Ivy
Show all versions of scalatest_2.8.0 Show documentation
/* * Copyright 2001-2008 Artima, Inc. * * Licensed under the Apache License, Version 2.0 (the "License"); * you may not use this file except in compliance with the License. * You may obtain a copy of the License at * * http://www.apache.org/licenses/LICENSE-2.0 * * Unless required by applicable law or agreed to in writing, software * distributed under the License is distributed on an "AS IS" BASIS, * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. * See the License for the specific language governing permissions and * limitations under the License. */ package org.scalatest import verb.{CanVerb, ResultOfAfterWordApplication, ShouldVerb, BehaveWord, MustVerb, StringVerbBlockRegistration} import NodeFamily._ import scala.collection.immutable.ListSet import org.scalatest.StackDepthExceptionHelper.getStackDepth import java.util.concurrent.atomic.AtomicReference import java.util.ConcurrentModificationException import org.scalatest.events._ import Suite.anErrorThatShouldCauseAnAbort /** * Trait that facilitates a “behavior-driven” style of development (BDD), in which tests * are combined with text that specifies the behavior the tests verify. * (In BDD, the word example is usually used instead of test. The word test will not appear * in your code if you usefor traitWordSpec, so if you prefer the word example you can use it. However, in this documentation * the word test will be used, for clarity and to be consistent with the rest of ScalaTest.) * TraitWordSpecis so named because * you specification text is structured by placing words after strings. * Here's an exampleWordSpec: * ** import org.scalatest.WordSpec * import scala.collection.mutable.Stack * * class StackSpec extends WordSpec { * * "A Stack" should { * * "pop values in last-in-first-out order" in { * val stack = new Stack[Int] * stack.push(1) * stack.push(2) * assert(stack.pop() === 2) * assert(stack.pop() === 1) * } * * "throw NoSuchElementException if an empty stack is popped" in { * val emptyStack = new Stack[String] * intercept[NoSuchElementException] { * emptyStack.pop() * } * } * } * } ** ** Note: Trait
* *WordSpecis in part inspired by classorg.specs.Specification, designed by * Eric Torreborre for the Specs framework. ** In a
* *WordSpecyou write a one (or more) sentence specification for each bit of behavior you wish to * specify and test. Each specification sentence has a * "subject," which is sometimes called the system under test (or SUT). The * subject is entity being specified and tested and also serves as the subject of the sentences you write for each test. A subject * can be followed by one of three verbs,should,must, orcan, and a block. Here are some * examples: ** "A Stack" should { * // ... * } * "An Account" must { * // ... * } * "A ShippingManifest" can { * // ... * } ** ** You can describe a subject in varying situations by using a
* *whenclause. Awhenclause * follows the subject and precedes a block. In the block after thewhen, you place strings that describe a situation or a state * the subject may be in using a string, each followed by a verb. Here's an example: ** "A Stack" when { * "empty" should { * // ... * } * "non-empty" should { * // ... * } * "full" should { * // ... * } * } ** ** When you are ready to finish a sentence, you write a string followed by
* *inand a block that * contains the code of the test. Here's an example: ** import org.scalatest.WordSpec * * class StackSpec extends WordSpec { * "A Stack" when { * "empty" should { * "be empty" in { * // ... * } * "complain on peek" in { * // ... * } * "complain on pop" in { * // ... * } * } * "full" should { * "be full" in { * // ... * } * "complain on push" in { * // ... * } * } * } * } ** ** Running the above
* *StackSpecin the interpreter would yield: ** scala> (new StackSpec).execute() * A Stack (when empty) * - should be empty * - should complain on peek * - should complain on pop * A Stack (when full) * - should be full * - should complain on push ** ** Note that the output does not exactly match the input in an effort to maximize readability. * Although the
* *WordSpeccode is nested, which can help you eliminate any repeated phrases * in the specification portion of your code, the output printed will have one line per subject per situation, and * one line per test. ** Sometimes you may wish to eliminate repeated phrases inside the block following a
* *verb. Here's an example * in which the phrase "provide an and/or operator that" is repeated: ** import org.scalatest.WordSpec * * class AndOrSpec extends WordSpec { * * "The ScalaTest Matchers DSL" should { * "provide an and operator that returns silently when evaluating true and true" in {} * "provide an and operator that throws a TestFailedException when evaluating true and false" in {} * "provide an and operator that throws a TestFailedException when evaluating false and true" in {} * "provide an and operator that throws a TestFailedException when evaluating false and false" in {} * "provide an or operator that returns silently when evaluating true or true" in {} * "provide an or operator that returns silently when evaluating true or false" in {} * "provide an or operator that returns silently when evaluating false or true" in {} * "provide an or operator that throws a TestFailedException when evaluating false or false" in {} * } * } ** ** In such situations you can place
* *thatclauses inside the verb clause, like this: ** import org.scalatest.WordSpec * * class AndOrSpec extends WordSpec { * * "The ScalaTest Matchers DSL" should { * "provide an and operator" that { * "returns silently when evaluating true and true" in {} * "throws a TestFailedException when evaluating true and false" in {} * "that throws a TestFailedException when evaluating false and true" in {} * "throws a TestFailedException when evaluating false and false" in {} * } * "provide an or operator" that { * "returns silently when evaluating true or true" in {} * "returns silently when evaluating true or false" in {} * "returns silently when evaluating false or true" in {} * "throws a TestFailedException when evaluating false or false" in {} * } * } * } ** ** If a word or phrase is repeated at the beginning of each string contained in a block, you can eliminate * that repetition by using an after word. An after word is a word or phrase that you can place * after
* *when, a verb, or *that. For example, in the previousWordSpec, the word "provide" is repeated * at the beginning of each string inside theshouldblock. You can factor out this duplication * like this: ** import org.scalatest.WordSpec * * class AndOrSpec extends WordSpec { * * def provide = afterWord("provide") * * "The ScalaTest Matchers DSL" should provide { * "an and operator" that { * "returns silently when evaluating true and true" in {} * "throws a TestFailedException when evaluating true and false" in {} * "that throws a TestFailedException when evaluating false and true" in {} * "throws a TestFailedException when evaluating false and false" in {} * } * "an or operator" that { * "returns silently when evaluating true or true" in {} * "returns silently when evaluating true or false" in {} * "returns silently when evaluating false or true" in {} * "throws a TestFailedException when evaluating false or false" in {} * } * } * } ** ** Once you've defined an after word, you can place it after
* *when, a verb * (should,must, orcan), or *that. (You can't place one afterinoris, the * words that introduce a test.) Here's an example that has after words used in all three * places: ** import org.scalatest.WordSpec * * class ScalaTestGUISpec extends WordSpec { * * def theUser = afterWord("the user") * def display = afterWord("display") * def is = afterWord("is") * * "The ScalaTest GUI" when theUser { * "clicks on an event report in the list box" should display { * "a blue background in the clicked-on row in the list box" in {} * "the details for the event in the details area" in {} * "a rerun button" that is { * "enabled if the clicked-on event is rerunnable" in {} * "disabled if the clicked-on event is not rerunnable" in {} * } * } * } * } ** ** Running the previous
* *WordSpecin the Scala interpreter would yield: ** scala> (new ScalaTestGUISpec).execute() * The ScalaTest GUI (when the user clicks on an event report in the list box) * - should display a blue background in the clicked-on row in the list box * - should display the details for the event in the details area * - should display a rerun button that is enabled if the clicked-on event is rerunnable * - should display a rerun button that is disabled if the clicked-on event is not rerunnable ** ** A
* *WordSpec's lifecycle has two phases: the registration phase and the * ready phase. It starts in registration phase and enters ready phase the first time *runis called on it. It then remains in ready phase for the remainder of its lifetime. ** Tests can only be registered while the
* *WordSpecis * in its registration phase. Any attempt to register a test after theWordSpechas * entered its ready phase, i.e., afterrunhas been invoked on theWordSpec, * will be met with a thrownTestRegistrationClosedException. The recommended style * of usingWordSpecis to register tests during object construction as is done in all * the examples shown here. If you keep to the recommended style, you should never see a *TestRegistrationClosedException. *Shared fixtures
* ** A test fixture is objects or other artifacts (such as files, sockets, database * connections, etc.) used by tests to do their work. You can use fixtures in *
* *WordSpecs with the same approaches suggested forSuitein * its documentation. The same text that appears in the test fixture * section ofSuite's documentation is repeated here, with examples changed from *SuitetoWordSpec. ** If a fixture is used by only one test, then the definitions of the fixture objects can * be local to the test function, such as the objects assigned to
* *stackandemptyStackin the * previousStackSpecexamples. If multiple tests need to share an immutable fixture, one approach * is to assign them to instance variables. Here's a (very contrived) example, in which the object assigned * tosharedis used by multiple test functions: ** import org.scalatest.WordSpec * * class ArithmeticSpec extends WordSpec { * * // Sharing immutable fixture objects via instance variables * val shared = 5 * * "The Scala language" should { * "add correctly" in { * val sum = 2 + 3 * assert(sum === shared) * } * * "subtract correctly" in { * val diff = 7 - 2 * assert(diff === shared) * } * } * } ** ** In some cases, however, shared mutable fixture objects may be changed by tests such that * they need to be recreated or reinitialized before each test. Shared resources such * as files or database connections may also need to be created and initialized before, and * cleaned up after, each test. JUnit offers methods
* *setUpand *tearDownfor this purpose. In ScalaTest, you can use theBeforeAndAfterEachtrait, * which will be described later, to implement an approach similar to JUnit'ssetUp* andtearDown, however, this approach often involves reassigningvars * between tests. Before going that route, you should consider some approaches that * avoidvars. One approach is to write one or more create-fixture methods * that return a new instance of a needed object (or a tuple or case class holding new instances of * multiple objects) each time it is called. You can then call a create-fixture method at the beginning of each * test that needs the fixture, storing the fixture object or objects in local variables. Here's an example: ** import org.scalatest.WordSpec * import scala.collection.mutable.ListBuffer * * class MySuite extends WordSpec { * * // create objects needed by tests and return as a tuple * def createFixture = ( * new StringBuilder("ScalaTest is "), * new ListBuffer[String] * ) * * "ScalaTest" should { * * "be easy " in { * val (builder, lbuf) = createFixture * builder.append("easy!") * assert(builder.toString === "ScalaTest is easy!") * assert(lbuf.isEmpty) * lbuf += "sweet" * } * * "be fun" in { * val (builder, lbuf) = createFixture * builder.append("fun!") * assert(builder.toString === "ScalaTest is fun!") * assert(lbuf.isEmpty) * } * } * } ** ** If different tests in the same
* *WordSpecrequire different fixtures, you can create multiple create-fixture methods and * call the method (or methods) needed by each test at the begining of the test. If every test requires the same set of * mutable fixture objects, one other approach you can take is make them simplyvals and mix in trait *OneInstancePerTest. If you mix inOneInstancePerTest, each test * will be run in its own instance of theWordSpec, similar to the way JUnit tests are executed. ** Although the create-fixture and
* *OneInstancePerTestapproaches take care of setting up a fixture before each * test, they don't address the problem of cleaning up a fixture after the test completes. In this situation, * one option is to mix in theBeforeAndAfterEachtrait. *BeforeAndAfterEach'sbeforeEachmethod will be run before, and itsafterEach* method after, each test (like JUnit'ssetUpandtearDown* methods, respectively). * For example, you could create a temporary file before each test, and delete it afterwords, like this: ** import org.scalatest.WordSpec * import org.scalatest.BeforeAndAfterEach * import java.io.FileReader * import java.io.FileWriter * import java.io.File * * class MySuite extends WordSpec with BeforeAndAfterEach { * * private val FileName = "TempFile.txt" * private var reader: FileReader = _ * * // Set up the temp file needed by the test * override def beforeEach() { * val writer = new FileWriter(FileName) * try { * writer.write("Hello, test!") * } * finally { * writer.close() * } * * // Create the reader needed by the test * reader = new FileReader(FileName) * } * * // Close and delete the temp file * override def afterEach() { * reader.close() * val file = new File(FileName) * file.delete() * } * * "A FileReader" must { * "read in the contents of a file correctly" in { * var builder = new StringBuilder * var c = reader.read() * while (c != -1) { * builder.append(c.toChar) * c = reader.read() * } * assert(builder.toString === "Hello, test!") * } * * "read in the first character of a file correctly" in { * assert(reader.read() === 'H') * } * * "not be required" in { * assert(1 + 1 === 2) * } * } * } ** ** In this example, the instance variable
* *readeris avar, so * it can be reinitialized between tests by thebeforeEachmethod. ** Although the
* *BeforeAndAfterEachapproach should be familiar to the users of most * test other frameworks, ScalaTest provides another alternative that also allows you to perform cleanup * after each test: overridingwithFixture(NoArgTest). * To execute each test,Suite's implementation of therunTestmethod wraps an invocation * of the appropriate test method in a no-arg function.runTestpasses that test function to thewithFixture(NoArgTest)* method, which is responsible for actually running the test by invoking the function.Suite's * implementation ofwithFixture(NoArgTest)simply invokes the function, like this: ** // Default implementation * protected def withFixture(test: NoArgTest) { * test() * } ** ** The
* *withFixture(NoArgTest)method exists so that you can override it and set a fixture up before, and clean it up after, each test. * Thus, the previous temp file example could also be implemented without mixing inBeforeAndAfterEach, like this: ** import org.scalatest.WordSpec * import org.scalatest.BeforeAndAfterEach * import java.io.FileReader * import java.io.FileWriter * import java.io.File * * class MySuite extends WordSpec { * * private var reader: FileReader = _ * * override def withFixture(test: NoArgTest) { * * val FileName = "TempFile.txt" * * // Set up the temp file needed by the test * val writer = new FileWriter(FileName) * try { * writer.write("Hello, test!") * } * finally { * writer.close() * } * * // Create the reader needed by the test * reader = new FileReader(FileName) * * try { * test() // Invoke the test function * } * finally { * // Close and delete the temp file * reader.close() * val file = new File(FileName) * file.delete() * } * } * * "A FileReader" must { * "read in the contents of a file correctly" in { * var builder = new StringBuilder * var c = reader.read() * while (c != -1) { * builder.append(c.toChar) * c = reader.read() * } * assert(builder.toString === "Hello, test!") * } * * "read in the first character of a file correctly" in { * assert(reader.read() === 'H') * } * * "not be required" in { * assert(1 + 1 === 2) * } * } * } ** ** If you prefer to keep your test classes immutable, one final variation is to use the *
* *FixtureWordSpectrait from the *org.scalatest.fixturepackage. Tests in anorg.scalatest.fixture.FixtureWordSpeccan have a fixture * object passed in as a parameter. You must indicate the type of the fixture object * by defining theFixturetype member and define awithFixturemethod that takes a one-arg test function. * (AFixtureWordSpechas two overloadedwithFixturemethods, therefore, one that takes aOneArgTest* and the other, inherited fromSuite, that takes aNoArgTest.) * Inside thewithFixture(OneArgTest)method, you create the fixture, pass it into the test function, then perform any * necessary cleanup after the test function returns. Instead of invoking each test directly, aFixtureWordSpecwill * pass a function that invokes the code of a test towithFixture(OneArgTest). YourwithFixture(OneArgTest)method, therefore, * is responsible for actually running the code of the test by invoking the test function. * For example, you could pass the temp file reader fixture to each test that needs it * by overriding thewithFixture(OneArgTest)method of aFixtureWordSpec, like this: ** import org.scalatest.fixture.FixtureWordSpec * import java.io.FileReader * import java.io.FileWriter * import java.io.File * * class MySuite extends FixtureWordSpec { * * type FixtureParam = FileReader * * def withFixture(test: OneArgTest) { * * val FileName = "TempFile.txt" * * // Set up the temp file needed by the test * val writer = new FileWriter(FileName) * try { * writer.write("Hello, test!") * } * finally { * writer.close() * } * * // Create the reader needed by the test * val reader = new FileReader(FileName) * * try { * // Run the test using the temp file * test(reader) * } * finally { * // Close and delete the temp file * reader.close() * val file = new File(FileName) * file.delete() * } * } * * "A FileReader" must { * "read in the contents of a file correctly" in { reader => * var builder = new StringBuilder * var c = reader.read() * while (c != -1) { * builder.append(c.toChar) * c = reader.read() * } * assert(builder.toString === "Hello, test!") * } * * "read in the first character of a file correctly" in { reader => * assert(reader.read() === 'H') * } * * "not be required" in { () => * assert(1 + 1 === 2) * } * } * } ** ** It is worth noting that the only difference in the test code between the mutable *
* *BeforeAndAfterEachapproach shown here and the immutableFixtureWordSpec* approach shown previously is that two of theFixtureWordSpec's test functions take aFileReaderas * a parameter via the "reader =>" at the beginning of the function. Otherwise the test code is identical. * One benefit of the explicit parameter is that, as demonstrated * by the "A FileReader must not be required" test, aFixtureWordSpec* test need not take the fixture. So you can have some tests that take a fixture, and others that don't. * In this case, theFixtureWordSpecprovides documentation indicating which * tests use the fixture and which don't, whereas theBeforeAndAfterEachapproach does not. * (If you have want to combine tests that take different fixture types in the sameWordSpec, you can * use MultipleFixtureWordSpec.) ** If you want to execute code before and after all tests (and nested suites) in a suite, such * as you could do with
* *@BeforeClassand@AfterClass* annotations in JUnit 4, you can use thebeforeAllandafterAll* methods ofBeforeAndAfterAll. See the documentation forBeforeAndAfterAllfor * an example. *Shared tests
* ** Sometimes you may want to run the same test code on different fixture objects. In other words, you may want to write tests that are "shared" * by different fixture objects. To accomplish this in a
* *WordSpec, you first place shared tests in behavior functions. * These behavior functions will be invoked during the construction phase of anyWordSpecthat uses them, so that the tests they * contain will be registered as tests in thatWordSpec. For example, given this stack class: ** import scala.collection.mutable.ListBuffer * * class Stack[T] { * * val MAX = 10 * private var buf = new ListBuffer[T] * * def push(o: T) { * if (!full) * o +: buf * else * throw new IllegalStateException("can't push onto a full stack") * } * * def pop(): T = { * if (!empty) * buf.remove(0) * else * throw new IllegalStateException("can't pop an empty stack") * } * * def peek: T = { * if (!empty) * buf(0) * else * throw new IllegalStateException("can't pop an empty stack") * } * * def full: Boolean = buf.size == MAX * def empty: Boolean = buf.size == 0 * def size = buf.size * * override def toString = buf.mkString("Stack(", ", ", ")") * } ** ** You may want to test the
* *Stackclass in different states: empty, full, with one item, with one item less than capacity, * etc. You may find you have several tests that make sense any time the stack is non-empty. Thus you'd ideally want to run * those same tests for three stack fixture objects: a full stack, a stack with a one item, and a stack with one item less than * capacity. With shared tests, you can factor these tests out into a behavior function, into which you pass the * stack fixture to use when running the tests. So in yourWordSpecfor stack, you'd invoke the * behavior function three times, passing in each of the three stack fixtures so that the shared tests are run for all three fixtures. You * can define a behavior function that encapsulates these shared tests inside theWordSpecthat uses them. If they are shared * between differentWordSpecs, however, you could also define them in a separate trait that is mixed into eachWordSpec* that uses them. ** For example, here the
* *nonEmptyStackbehavior function (in this case, a behavior method) is * defined in a trait along with another method containing shared tests for non-full stacks: ** trait StackBehaviors { this: WordSpec => * * def nonEmptyStack(stack: Stack[Int], lastItemAdded: Int) { * * "be non-empty" in { * assert(!stack.empty) * } * * "return the top item on peek" in { * assert(stack.peek === lastItemAdded) * } * * "not remove the top item on peek" in { * val size = stack.size * assert(stack.peek === lastItemAdded) * assert(stack.size === size) * } * * "remove the top item on pop" in { * val size = stack.size * assert(stack.pop === lastItemAdded) * assert(stack.size === size - 1) * } * } * * def nonFullStack(stack: Stack[Int]) { * * "not be full" in { * assert(!stack.full) * } * * "add to the top on push" in { * val size = stack.size * stack.push(7) * assert(stack.size === size + 1) * assert(stack.peek === 7) * } * } * } ** * ** Given these behavior functions, you could invoke them directly, but
* *WordSpecoffers a DSL for the purpose, * which looks like this: ** behave like nonEmptyStack(stackWithOneItem, lastValuePushed) * behave like nonFullStack(stackWithOneItem) ** ** If you prefer to use an imperative style to change fixtures, for example by mixing in
* *BeforeAndAfterEachand * reassigning astackvarinbeforeEach, you could write your behavior functions * in the context of thatvar, which means you wouldn't need to pass in the stack fixture because it would be * in scope already inside the behavior function. In that case, your code would look like this: ** behave like nonEmptyStack // assuming lastValuePushed is also in scope inside nonEmptyStack * behave like nonFullStack ** ** The recommended style, however, is the functional, pass-all-the-needed-values-in style. Here's an example: *
* ** class SharedTestExampleSpec extends WordSpec with StackBehaviors { * * // Stack fixture creation methods * def emptyStack = new Stack[Int] * * def fullStack = { * val stack = new Stack[Int] * for (i <- 0 until stack.MAX) * stack.push(i) * stack * } * * def stackWithOneItem = { * val stack = new Stack[Int] * stack.push(9) * stack * } * * def stackWithOneItemLessThanCapacity = { * val stack = new Stack[Int] * for (i <- 1 to 9) * stack.push(i) * stack * } * * val lastValuePushed = 9 * * "A Stack" when { * "empty" should { * "be empty" in { * assert(emptyStack.empty) * } * * "complain on peek" in { * intercept[IllegalStateException] { * emptyStack.peek * } * } * * "complain on pop" in { * intercept[IllegalStateException] { * emptyStack.pop * } * } * } * * "it contains one item" should { * behave like nonEmptyStack(stackWithOneItem, lastValuePushed) * behave like nonFullStack(stackWithOneItem) * } * * * "it contains one item less than capacity" should { * behave like nonEmptyStack(stackWithOneItemLessThanCapacity, lastValuePushed) * behave like nonFullStack(stackWithOneItemLessThanCapacity) * } * * "full" should { * "be full" in { * assert(fullStack.full) * } * * behave like nonEmptyStack(fullStack, lastValuePushed) * * "complain on a push" in { * intercept[IllegalStateException] { * fullStack.push(10) * } * } * } * } * } ** ** If you load these classes into the Scala interpreter (with scalatest's JAR file on the class path), and execute it, * you'll see: *
* ** scala> (new SharedTestExampleSpec).execute() * A Stack (when empty) * - should be empty * - should complain on peek * - should complain on pop * A Stack (when it contains one item) * - should be non-empty * - should return the top item on peek * - should not remove the top item on peek * - should remove the top item on pop * - should not be full * - should add to the top on push * A Stack (when it contains one item less than capacity) * - should be non-empty * - should return the top item on peek * - should not remove the top item on peek * - should remove the top item on pop * - should not be full * - should add to the top on push * A Stack (when full) * - should be full * - should be non-empty * - should return the top item on peek * - should not remove the top item on peek * - should remove the top item on pop * - should complain on a push ** ** One thing to keep in mind when using shared tests is that in ScalaTest, each test in a suite must have a unique name. * If you register the same tests repeatedly in the same suite, one problem you may encounter is an exception at runtime * complaining that multiple tests are being registered with the same test name. A good way to solve this problem in a
* *FlatSpecis to make sure * each invocation of a behavior function is in the context of a differentbehavior ofclause, which will prepend a string to each test name. * For example, the following code in aFlatSpecwould register a test with the name"A Stack (when empty) should be empty": ** behavior of "A Stack (when empty)" * * it should "be empty" in { * assert(emptyStack.empty) * } * // ... ** ** Or, using the shorthand notation: *
* ** "A Stack (when empty)" should "be empty" in { * assert(emptyStack.empty) * } * // ... ** ** If the
* *"should be empty"test was factored out into a behavior function, it could be called repeatedly so long * as each invocation of the behavior function is in the context of a differentbehavior ofclause. *Tagging tests
* * AWordSpec's tests may be classified into groups by tagging them with string names. * As with any suite, when executing aWordSpec, groups of tests can * optionally be included and/or excluded. To tag aWordSpec's tests, * you pass objects that extend abstract classorg.scalatest.TagtotaggedAsmethod * invoked on the string that describes the test you want to tag. ClassTagtakes one parameter, * a string name. If you have * created Java annotation interfaces for use as group names in direct subclasses oforg.scalatest.Suite, * then you will probably want to use group names on yourWordSpecs that match. To do so, simply * pass the fully qualified names of the Java interfaces to theTagconstructor. For example, if you've * defined Java annotation interfaces with fully qualified names,com.mycompany.groups.SlowTestandcom.mycompany.groups.DbTest, then you could * create matching groups forSpecs like this: * * ** import org.scalatest.Tag * * object SlowTest extends Tag("com.mycompany.groups.SlowTest") * object DbTest extends Tag("com.mycompany.groups.DbTest") ** ** Given these definitions, you could place
* *WordSpectests into groups like this: ** import org.scalatest.WordSpec * * class MySuite extends WordSpec { * * "The Scala language" should { * * "add correctly" taggedAs(SlowTest) in { * val sum = 1 + 1 * assert(sum === 2) * assert(sum + 2 === 4) * } * * "subtract correctly" taggedAs(SlowTest, DbTest) in { * val diff = 4 - 1 * assert(diff === 3) * assert(diff - 2 === 1) * } * } * } ** ** This code marks both tests with the
* *com.mycompany.groups.SlowTesttag, * and test"The Scala language should subtract correctly"with thecom.mycompany.groups.DbTesttag. ** The primary
* *runmethod takes aFilter, whose constructor takes an optional *Set[String]s calledtagsToIncludeand aSet[String]called *tagsToExclude. IftagsToIncludeisNone, all tests will be run * except those those belonging to tags listed in the *tagsToExcludeSet. IftagsToIncludeis defined, only tests * belonging to tags mentioned in thetagsToIncludeset, and not mentioned intagsToExclude, * will be run. *Ignored tests
* * To support the common use case of “temporarily” disabling a test, with the * good intention of resurrecting the test at a later time,WordSpecadds a method *ignoreto strings that can be used instead ofinto register a test. For example, to temporarily * disable the test with the name"A Stack should pop values in last-in-first-out order", just * change “in” into “ignore,” like this: * * ** import org.scalatest.WordSpec * import scala.collection.mutable.Stack * * class StackSpec extends WordSpec { * * "A Stack" should { * * "pop values in last-in-first-out order" ignore { * val stack = new Stack[Int] * stack.push(1) * stack.push(2) * assert(stack.pop() === 2) * assert(stack.pop() === 1) * } * * "throw NoSuchElementException if an empty stack is popped" in { * val emptyStack = new Stack[String] * intercept[NoSuchElementException] { * emptyStack.pop() * } * } * } * } ** ** If you run this version of
* *StackSpecwith: ** scala> (new StackSpec).execute() ** ** It will run only the second test and report that the first test was ignored: *
* ** A Stack * - should pop values in last-in-first-out order !!! IGNORED !!! * - should throw NoSuchElementException if an empty stack is popped ** *Informers
* ** One of the parameters to the primary
* *runmethod is aReporter, which * will collect and report information about the running suite of tests. * Information about suites and tests that were run, whether tests succeeded or failed, * and tests that were ignored will be passed to theReporteras the suite runs. * Most often the reporting done by default byWordSpec's methods will be sufficient, but * occasionally you may wish to provide custom information to theReporterfrom a test. * For this purpose, anInformerthat will forward information to the currentReporter* is provided via theinfoparameterless method. * You can pass the extra information to theInformervia itsapplymethod. * TheInformerwill then pass the information to theReportervia anInfoProvidedevent. * Here's an example: ** import org.scalatest.WordSpec * * class ArithmeticSpec extends WordSpec { * * "The Scala language" should { * "add correctly" in { * val sum = 2 + 3 * assert(sum === 5) * info("addition seems to work") * } * * "subtract correctly" in { * val diff = 7 - 2 * assert(diff === 5) * } * } * } ** ** If you run this
* *WordSpecfrom the interpreter, you will see the following message * included in the printed report: ** scala> (new ArithmeticSpec).execute() * The Scala language * - should add correctly * + addition seems to work * - should subtract correctly ** ** One use case for the
* *Informeris to pass more information about a specification to the reporter. For example, * theGivenWhenThentrait provides methods that use the implicitinfoprovided byWordSpec* to pass such information to the reporter. Here's an example: ** import org.scalatest.WordSpec * import org.scalatest.GivenWhenThen * * class ArithmeticSpec extends WordSpec with GivenWhenThen { * * "The Scala language" should { * * "add correctly" in { * * given("two integers") * val x = 2 * val y = 3 * * when("they are added") * val sum = x + y * * then("the result is the sum of the two numbers") * assert(sum === 5) * } * * "subtract correctly" in { * * given("two integers") * val x = 7 * val y = 2 * * when("one is subtracted from the other") * val diff = x - y * * then("the result is the difference of the two numbers") * assert(diff === 5) * } * } * } ** ** If you run this
* *WordSpecfrom the interpreter, you will see the following messages * included in the printed report: ** scala> (new ArithmeticSpec).execute() * The Scala language * - should add correctly * + Given two integers * + When they are added * + Then the result is the sum of the two numbers * - should subtract correctly * + Given two integers * + When one is subtracted from the other * + Then the result is the difference of the two numbers ** *Pending tests
* ** A pending test is one that has been given a name but is not yet implemented. The purpose of * pending tests is to facilitate a style of testing in which documentation of behavior is sketched * out before tests are written to verify that behavior (and often, the before the behavior of * the system being tested is itself implemented). Such sketches form a kind of specification of * what tests and functionality to implement later. *
* ** To support this style of testing, a test can be given a name that specifies one * bit of behavior required by the system being tested. The test can also include some code that * sends more information about the behavior to the reporter when the tests run. At the end of the test, * it can call method
* *pending, which will cause it to complete abruptly withTestPendingException. * Because tests in ScalaTest can be designated as pending withTestPendingException, both the test name and any information * sent to the reporter when running the test can appear in the report of a test run. (In other words, * the code of a pending test is executed just like any other test.) However, because the test completes abruptly * withTestPendingException, the test will be reported as pending, to indicate * the actual test, and possibly the functionality it is intended to test, has not yet been implemented. * You can mark tests as pending in aWordSpeclike this: ** import org.scalatest.WordSpec * * class ArithmeticSpec extends WordSpec { * * // Sharing fixture objects via instance variables * val shared = 5 * * "The Scala language" should { * "add correctly" in { * val sum = 2 + 3 * assert(sum === shared) * } * * "subtract correctly" is (pending) * } * } ** ** If you run this version of
* *ArithmeticSpecwith: ** scala> (new ArithmeticSpec).execute() ** ** It will run both tests but report that
* *The Scala language should subtract correctlyis pending. You'll see: ** The Scala language * - should add correctly * - should subtract correctly (pending) ** ** One difference between an ignored test and a pending one is that an ignored test is intended to be used during a * significant refactorings of the code under test, when tests break and you don't want to spend the time to fix * all of them immediately. You can mark some of those broken tests as ignored temporarily, so that you can focus the red * bar on just failing tests you actually want to fix immediately. Later you can go back and fix the ignored tests. * In other words, by ignoring some failing tests temporarily, you can more easily notice failed tests that you actually * want to fix. By contrast, a pending test is intended to be used before a test and/or the code under test is written. * Pending indicates you've decided to write a test for a bit of behavior, but either you haven't written the test yet, or * have only written part of it, or perhaps you've written the test but don't want to implement the behavior it tests * until after you've implemented a different bit of behavior you realized you need first. Thus ignored tests are designed * to facilitate refactoring of existing code whereas pending tests are designed to facilitate the creation of new code. *
* ** One other difference between ignored and pending tests is that ignored tests are implemented as a test tag that is * excluded by default. Thus an ignored test is never executed. By contrast, a pending test is implemented as a * test that throws
* *TestPendingException(which is what calling thependingmethod does). Thus * the body of pending tests are executed up until they throwTestPendingException. The reason for this difference * is that it enables your unfinished test to sendInfoProvidedmessages to the reporter before it completes * abruptly withTestPendingException, as shown in the previous example onInformers * that used theGivenWhenThentrait. For example, the following snippet in aWordSpec: ** "The Scala language" should { * "add correctly" in { * given("two integers") * when("they are added") * then("the result is the sum of the two numbers") * pending * } * // ... ** ** Would yield the following output when run in the interpreter: *
* ** The Scala language * - should add correctly (pending) * + Given two integers * + When they are added * + Then the result is the sum of the two numbers ** * @author Bill Venners */ trait WordSpec extends Suite with ShouldVerb with MustVerb with CanVerb { thisSuite => private val IgnoreTagName = "org.scalatest.Ignore" private class Bundle private( val trunk: Trunk, val currentBranch: Branch, val tagsMap: Map[String, Set[String]], // All tests, in reverse order of registration val testsList: List[TestLeaf], // Used to detect at runtime that they've stuck a describe or an it inside an it, // which should result in a TestRegistrationClosedException val registrationClosed: Boolean ) { def unpack = (trunk, currentBranch, tagsMap, testsList, registrationClosed) } private object Bundle { def apply( trunk: Trunk, currentBranch: Branch, tagsMap: Map[String, Set[String]], testsList: List[TestLeaf], registrationClosed: Boolean ): Bundle = new Bundle(trunk, currentBranch, tagsMap, testsList, registrationClosed) def initialize( trunk: Trunk, tagsMap: Map[String, Set[String]], testsList: List[TestLeaf], registrationClosed: Boolean ): Bundle = new Bundle(trunk, trunk, tagsMap, testsList, registrationClosed) } private val atomic = new AtomicReference[Bundle]( Bundle.initialize(new Trunk, Map(), List[TestLeaf](), false) ) private def updateAtomic(oldBundle: Bundle, newBundle: Bundle) { val shouldBeOldBundle = atomic.getAndSet(newBundle) if (!(shouldBeOldBundle eq oldBundle)) throw new ConcurrentModificationException(Resources("concurrentWordSpecBundleMod")) } private def registerTest(specText: String, f: () => Unit) = { val oldBundle = atomic.get var (trunk, currentBranch, tagsMap, testsList, registrationClosed) = oldBundle.unpack val testName = getTestName(specText, currentBranch) if (testsList.exists(_.testName == testName)) { throw new DuplicateTestNameException(testName, getStackDepth("Spec.scala", "it")) } val testShortName = specText val test = TestLeaf(currentBranch, testName, specText, f) currentBranch.subNodes ::= test testsList ::= test updateAtomic(oldBundle, Bundle(trunk, currentBranch, tagsMap, testsList, registrationClosed)) testName } private class RegistrationInformer extends Informer { def apply(message: String) { if (message == null) throw new NullPointerException val oldBundle = atomic.get var (trunk, currentBranch, tagsMap, testsList, registrationClosed) = oldBundle.unpack currentBranch.subNodes ::= InfoLeaf(currentBranch, message) updateAtomic(oldBundle, Bundle(trunk, currentBranch, tagsMap, testsList, registrationClosed)) } } // The informer will be a registration informer until run is called for the first time. (This // is the registration phase of a WordSpec's lifecycle.) private final val atomicInformer = new AtomicReference[Informer](new RegistrationInformer) /** * Returns anInformerthat during test execution will forward strings (and other objects) passed to its *applymethod to the current reporter. If invoked in a constructor, it * will register the passed string for forwarding later during test execution. If invoked while this *WordSpecis being executed, such as from inside a test function, it will forward the information to * the current reporter immediately. If invoked at any other time, it will * throw an exception. This method can be called safely by any thread. */ implicit protected def info: Informer = atomicInformer.get private val zombieInformer = new Informer { private val complaint = Resources("cantCallInfoNow", "WordSpec") def apply(message: String) { if (message == null) throw new NullPointerException throw new IllegalStateException(complaint) } } /** * Register a test with the given spec text, optional tags, and test function value that takes no arguments. * An invocation of this method is called an “example.” * * This method will register the test for later execution via an invocation of one of theexecute* methods. The name of the test will be a concatenation of the text of all surrounding describers, * from outside in, and the passed spec text, with one space placed between each item. (See the documenation * fortestNamesfor an example.) The resulting test name must not have been registered previously on * thisSpecinstance. * * @param specText the specification text, which will be combined with the descText of any surrounding describers * to form the test name * @param testTags the optional list of tags for this test * @param testFun the test function * @throws DuplicateTestNameException if a test with the same name has been registered previously * @throws TestRegistrationClosedException if invoked afterrunhas been invoked on this suite * @throws NullPointerException ifspecTextor any passed test tag isnull*/ private def registerTestToRun(specText: String, testTags: List[Tag], testFun: () => Unit) { if (atomic.get.registrationClosed) throw new TestRegistrationClosedException(Resources("itCannotAppearInsideAnotherIt"), getStackDepth("Spec.scala", "it")) if (specText == null) throw new NullPointerException("specText was null") if (testTags.exists(_ == null)) throw new NullPointerException("a test tag was null") val testName = registerTest(specText, testFun) val oldBundle = atomic.get var (trunk, currentBranch, tagsMap, testsList, registrationClosed2) = oldBundle.unpack val tagNames = Set[String]() ++ testTags.map(_.name) if (!tagNames.isEmpty) tagsMap += (testName -> tagNames) updateAtomic(oldBundle, Bundle(trunk, currentBranch, tagsMap, testsList, registrationClosed2)) } /** * Register a test with the given spec text and test function value that takes no arguments. * * This method will register the test for later execution via an invocation of one of theexecute* methods. The name of the test will be a concatenation of the text of all surrounding describers, * from outside in, and the passed spec text, with one space placed between each item. (See the documenation * fortestNamesfor an example.) The resulting test name must not have been registered previously on * thisSpecinstance. * * @param specText the specification text, which will be combined with the descText of any surrounding describers * to form the test name * @param testFun the test function * @throws DuplicateTestNameException if a test with the same name has been registered previously * @throws TestRegistrationClosedException if invoked afterrunhas been invoked on this suite * @throws NullPointerException ifspecTextor any passed test tag isnull*/ /* protected def it(specText: String)(testFun: => Unit) { if (atomic.get.registrationClosed) throw new TestRegistrationClosedException(Resources("itCannotAppearInsideAnotherIt"), getStackDepth("Spec.scala", "it")) it(specText, Array[Tag](): _*)(testFun) } */ /** * Register a test to ignore, which has the given spec text, optional tags, and test function value that takes no arguments. * This method will register the test for later ignoring via an invocation of one of theexecute* methods. This method exists to make it easy to ignore an existing test by changing the call toit* toignorewithout deleting or commenting out the actual test code. The test will not be executed, but a * report will be sent that indicates the test was ignored. The name of the test will be a concatenation of the text of all surrounding describers, * from outside in, and the passed spec text, with one space placed between each item. (See the documenation * fortestNamesfor an example.) The resulting test name must not have been registered previously on * thisSpecinstance. * * @param specText the specification text, which will be combined with the descText of any surrounding describers * to form the test name * @param testTags the optional list of tags for this test * @param testFun the test function * @throws DuplicateTestNameException if a test with the same name has been registered previously * @throws TestRegistrationClosedException if invoked afterrunhas been invoked on this suite * @throws NullPointerException ifspecTextor any passed test tag isnull*/ private def registerTestToIgnore(specText: String, testTags: List[Tag], testFun: () => Unit) { if (atomic.get.registrationClosed) throw new TestRegistrationClosedException(Resources("ignoreCannotAppearInsideAnIt"), getStackDepth("Spec.scala", "ignore")) if (specText == null) throw new NullPointerException("specText was null") if (testTags.exists(_ == null)) throw new NullPointerException("a test tag was null") val testName = registerTest(specText, testFun) val tagNames = Set[String]() ++ testTags.map(_.name) val oldBundle = atomic.get var (trunk, currentBranch, tagsMap, testsList, registrationClosed) = oldBundle.unpack tagsMap += (testName -> (tagNames + IgnoreTagName)) updateAtomic(oldBundle, Bundle(trunk, currentBranch, tagsMap, testsList, registrationClosed)) } /** * Register a test to ignore, which has the given spec text and test function value that takes no arguments. * This method will register the test for later ignoring via an invocation of one of theexecute* methods. This method exists to make it easy to ignore an existing test by changing the call toit* toignorewithout deleting or commenting out the actual test code. The test will not be executed, but a * report will be sent that indicates the test was ignored. The name of the test will be a concatenation of the text of all surrounding describers, * from outside in, and the passed spec text, with one space placed between each item. (See the documenation * fortestNamesfor an example.) The resulting test name must not have been registered previously on * thisSpecinstance. * * @param specText the specification text, which will be combined with the descText of any surrounding describers * to form the test name * @param testFun the test function * @throws DuplicateTestNameException if a test with the same name has been registered previously * @throws TestRegistrationClosedException if invoked afterrunhas been invoked on this suite * @throws NullPointerException ifspecTextor any passed test tag isnull*/ /* protected def ignore(specText: String)(testFun: => Unit) { if (atomic.get.registrationClosed) throw new TestRegistrationClosedException(Resources("ignoreCannotAppearInsideAnIt"), getStackDepth("Spec.scala", "ignore")) ignore(specText, Array[Tag](): _*)(testFun) } */ /** * Describe a “subject” being specified and tested by the passed function value. The * passed function value may contain more describers (defined withdescribe) and/or tests * (defined withit). This trait's implementation of this method will register the * description string and immediately invoke the passed function. */ private def registerVerbBranch(description: String, verb: String, f: () => Unit) { registerBranch( f, currentBranch => { val desc = currentBranch match { // TODO, probably make a WhenDescriptionBranch so this is more type safe than looking for (when at the end case DescriptionBranch(parent, descriptionName) if descriptionName.endsWith(" (when") => description + ")" case _ => description } VerbBranch(currentBranch, desc, verb) } ) } private def registerDescriptionBranch(description: String, f: () => Unit) { registerBranch(f, DescriptionBranch(_, description)) } private def registerBranch(f: () => Unit, constructBranch: Branch => Branch) { if (atomic.get.registrationClosed) throw new TestRegistrationClosedException(Resources("describeCannotAppearInsideAnIt"), getStackDepth("Spec.scala", "describe")) def createNewBranch() = { val oldBundle = atomic.get var (trunk, currentBranch, tagsMap, testsList, registrationClosed) = oldBundle.unpack val newBranch = constructBranch(currentBranch) // val newBranch = VerbBranch(currentBranch, description, verb) val oldBranch = currentBranch currentBranch.subNodes ::= newBranch currentBranch = newBranch updateAtomic(oldBundle, Bundle(trunk, currentBranch, tagsMap, testsList, registrationClosed)) oldBranch } val oldBranch = createNewBranch() f() val oldBundle = atomic.get val (trunk, currentBranch, tagsMap, testsList, registrationClosed) = oldBundle.unpack updateAtomic(oldBundle, Bundle(trunk, oldBranch, tagsMap, testsList, registrationClosed)) } /** * Class that supports the registration of tagged tests. * ** Instances of this class are returned by the
* * @author Bill Venners */ protected final class ResultOfTaggedAsInvocationOnString(specText: String, tags: List[Tag]) { /** * Supports tagged test registration. * *taggedAsmethod of * classWordSpecStringWrapper. ** For example, this method supports syntax such as the following: *
* ** "complain on peek" taggedAs(SlowTest) in { ... } * ^ ** ** For more information and examples of this method's use, see the main documentation for trait
*/ def in(testFun: => Unit) { registerTestToRun(specText, tags, testFun _) } /** * Supports registration of tagged, pending tests. * *WordSpec. ** For example, this method supports syntax such as the following: *
* ** "complain on peek" taggedAs(SlowTest) is (pending) * ^ ** ** For more information and examples of this method's use, see the main documentation for trait
*/ def is(testFun: => PendingNothing) { registerTestToRun(specText, tags, testFun _) } /** * Supports registration of tagged, ignored tests. * *WordSpec. ** For example, this method supports syntax such as the following: *
* ** "complain on peek" taggedAs(SlowTest) ignore { ... } * ^ ** ** For more information and examples of this method's use, see the main documentation for trait
*/ def ignore(testFun: => Unit) { registerTestToIgnore(specText, tags, testFun _) } } /** * A class that via an implicit conversion (namedWordSpec. *convertToWordSpecStringWrapper) enables * methodswhen,that,in,is,taggedAs* andignoreto be invoked onStrings. * ** This class provides much of the syntax for
* * @author Bill Venners */ protected final class WordSpecStringWrapper(string: String) { /** * Supports test registration. * *WordSpec, however, it does not add * the verb methods (should,must, andcan) toString. * Instead, these are added via theShouldVerb,MustVerb, andCanVerb* traits, whichWordSpecmixes in, to avoid a conflict with implicit conversions provided * inShouldMatchersandMustMatchers. ** For example, this method supports syntax such as the following: *
* ** "complain on peek" in { ... } * ^ ** ** For more information and examples of this method's use, see the main documentation for trait
*/ def in(f: => Unit) { registerTestToRun(string, List(), f _) } /** * Supports ignored test registration. * *WordSpec. ** For example, this method supports syntax such as the following: *
* ** "complain on peek" ignore { ... } * ^ ** ** For more information and examples of this method's use, see the main documentation for trait
*/ def ignore(f: => Unit) { registerTestToIgnore(string, List(), f _) } /** * Supports pending test registration. * *WordSpec. ** For example, this method supports syntax such as the following: *
* ** "complain on peek" is (pending) * ^ ** ** For more information and examples of this method's use, see the main documentation for trait
*/ def is(f: => PendingNothing) { registerTestToRun(string, List(), f _) } /** * Supports tagged test registration. * *WordSpec. ** For example, this method supports syntax such as the following: *
* ** "complain on peek" taggedAs(SlowTest) in { ... } * ^ ** ** For more information and examples of this method's use, see the main documentation for trait
*/ def taggedAs(firstTestTag: Tag, otherTestTags: Tag*) = { val tagList = firstTestTag :: otherTestTags.toList new ResultOfTaggedAsInvocationOnString(string, tagList) } /** * Registers aWordSpec. *whenclause. * ** For example, this method supports syntax such as the following: *
* ** "A Stack" when { ... } * ^ ** ** For more information and examples of this method's use, see the main documentation for trait
*/ def when(f: => Unit) { registerDescriptionBranch(string + " (when", f _) } /** * Registers aWordSpec. *whenclause that is followed by an after word. * ** For example, this method supports syntax such as the following: *
* ** val theUser = afterWord("the user") * * "A Stack" when theUser { ... } * ^ ** ** For more information and examples of this method's use, see the main documentation for trait
*/ def when(resultOfAfterWordApplication: ResultOfAfterWordApplication) { registerDescriptionBranch(string + " (when " + resultOfAfterWordApplication.text, resultOfAfterWordApplication.f) } /** * Registers aWordSpec. *thatclause. * ** For example, this method supports syntax such as the following: *
* ** "a rerun button" that { * ^ ** ** For more information and examples of this method's use, see the main documentation for trait
*/ def that(f: => Unit) { registerDescriptionBranch(string + " that", f _) } /** * Registers aWordSpec. *thatclause that is followed by an after word. * ** For example, this method supports syntax such as the following: *
* ** def is = afterWord("is") * * "a rerun button" that is { * ^ ** ** For more information and examples of this method's use, see the main documentation for trait
*/ def that(resultOfAfterWordApplication: ResultOfAfterWordApplication) { registerDescriptionBranch(string + " that " + resultOfAfterWordApplication.text, resultOfAfterWordApplication.f) } } /** * Class whose instances are after words, which can be used to reduce text duplication. * *WordSpec. ** If you are repeating a word or phrase at the beginning of each string inside * a block, you can "move the word or phrase" out of the block with an after word. * You create an after word by passing the repeated word or phrase to the
* *afterWordmethod. * Once created, you can place the after word afterwhen, a verb * (should,must, orcan), or *that. (You can't place one afterinoris, the * words that introduce a test.) Here's an example that has after words used in all three * places: ** import org.scalatest.WordSpec * * class ScalaTestGUISpec extends WordSpec { * * def theUser = afterWord("the user") * def display = afterWord("display") * def is = afterWord("is") * * "The ScalaTest GUI" when theUser { * "clicks on an event report in the list box" should display { * "a blue background in the clicked-on row in the list box" in {} * "the details for the event in the details area" in {} * "a rerun button" that is { * "enabled if the clicked-on event is rerunnable" in {} * "disabled if the clicked-on event is not rerunnable" in {} * } * } * } * } ** ** Running the previous
* *WordSpecin the Scala interpreter would yield: ** scala> (new ScalaTestGUISpec).execute() * The ScalaTest GUI (when the user clicks on an event report in the list box) * - should display a blue background in the clicked-on row in the list box * - should display the details for the event in the details area * - should display a rerun button that is enabled if the clicked-on event is rerunnable * - should display a rerun button that is disabled if the clicked-on event is not rerunnable **/ protected final class AfterWord(text: String) { /** * Supports the use of after words. * ** This method transforms a block of code into a
ResultOfAfterWordApplication, which * is accepted bywhen,should,must,can, andthat* methods. For more information, see the main documentationWordSpec. * */ def apply(f: => Unit) = new ResultOfAfterWordApplication(text, f _) } /** * Creates an after word that an be used to reduce text duplication. * ** If you are repeating a word or phrase at the beginning of each string inside * a block, you can "move the word or phrase" out of the block with an after word. * You create an after word by passing the repeated word or phrase to the
* *afterWordmethod. * Once created, you can place the after word afterwhen, a verb * (should,must, orcan), or *that. (You can't place one afterinoris, the * words that introduce a test.) Here's an example that has after words used in all three * places: ** import org.scalatest.WordSpec * * class ScalaTestGUISpec extends WordSpec { * * def theUser = afterWord("the user") * def display = afterWord("display") * def is = afterWord("is") * * "The ScalaTest GUI" when theUser { * "clicks on an event report in the list box" should display { * "a blue background in the clicked-on row in the list box" in {} * "the details for the event in the details area" in {} * "a rerun button" that is { * "enabled if the clicked-on event is rerunnable" in {} * "disabled if the clicked-on event is not rerunnable" in {} * } * } * } * } ** ** Running the previous
* *WordSpecin the Scala interpreter would yield: ** scala> (new ScalaTestGUISpec).execute() * The ScalaTest GUI (when the user clicks on an event report in the list box) * - should display a blue background in the clicked-on row in the list box * - should display the details for the event in the details area * - should display a rerun button that is enabled if the clicked-on event is rerunnable * - should display a rerun button that is disabled if the clicked-on event is not rerunnable **/ protected def afterWord(text: String) = new AfterWord(text) /** * Implicitly convertsStrings toWordSpecStringWrapper, which enables * methodswhen,that,in,is,taggedAs* andignoreto be invoked onStrings. */ protected implicit def convertToWordSpecStringWrapper(s: String) = new WordSpecStringWrapper(s) // Used to enable should/can/must to take a block (except one that results in type string. May // want to mention this as a gotcha.) /* import org.scalatest.WordSpec class MySpec extends WordSpec { "bla bla bla" should { "do something" in { assert(1 + 1 === 2) } "now it is a string" } } delme.scala:6: error: no implicit argument matching parameter type (String, String, String) => org.scalatest.verb.ResultOfStringPassedToVerb was found. "bla bla bla" should { ^ one error found */ /** * Supports the registration of subjects. * ** For example, this method enables syntax such as the following: *
* ** "A Stack" should { ... * ^ ** ** This function is passed as an implicit parameter to a
*/ protected implicit val subjectRegistrationFunction: StringVerbBlockRegistration = new StringVerbBlockRegistration { def apply(left: String, verb: String, f: () => Unit) = registerVerbBranch(left, verb, f) } /** * Supports the registration of subject descriptions with after words. * *shouldmethod * provided inShouldVerb, amustmethod * provided inMustVerb, and acanmethod * provided inCanVerb. When invoked, this function registers the * subject and executes the block. ** For example, this method enables syntax such as the following: *
* ** def provide = afterWord("provide") * * "The ScalaTest Matchers DSL" can provide { ... } * ^ ** ** This function is passed as an implicit parameter to a
*/ protected implicit val subjectWithAfterWordRegistrationFunction: (String, String, ResultOfAfterWordApplication) => Unit = { (left, verb, resultOfAfterWordApplication) => { val afterWordFunction = () => { registerDescriptionBranch(resultOfAfterWordApplication.text, resultOfAfterWordApplication.f) } registerVerbBranch(left, verb, afterWordFunction) } } /** * Ashouldmethod * provided inShouldVerb, amustmethod * provided inMustVerb, and acanmethod * provided inCanVerb. When invoked, this function registers the * subject and executes the block. *Mapwhose keys areStringtag names to which tests in thisSpecbelong, and values * theSetof test names that belong to each tag. If thisWordSpeccontains no tags, this method returns an emptyMap. * ** This trait's implementation returns tags that were passed as strings contained in
*/ override def tags: Map[String, Set[String]] = atomic.get.tagsMap private def runTestsInBranch(branch: Branch, reporter: Reporter, stopper: Stopper, filter: Filter, configMap: Map[String, Any], tracker: Tracker) { val stopRequested = stopper // Wrap any non-DispatchReporter, non-CatchReporter in a CatchReporter, // so that exceptions are caught and transformed // into error messages on the standard error stream. val report = wrapReporterIfNecessary(reporter) branch match { case desc @ VerbBranch(_, descriptionName, verb) => // Need to use the full name of the description, which includes all the descriptions it is nested inside // Call getPrefix and pass in this Desc, to get the full name val descriptionFullName = getPrefixWithoutVerb(desc).trim report(InfoProvided(tracker.nextOrdinal(), descriptionFullName, Some(NameInfo(thisSuite.suiteName, Some(thisSuite.getClass.getName), None)), None, None, Some(IndentedText(descriptionFullName, descriptionFullName, 0)))) case _ => } branch.subNodes.reverse.foreach( _ match { case TestLeaf(parent, tn, specText, _) => if (!stopRequested()) { // TODO: Seems odd to me to check for stop here but still fire infos val (filterTest, ignoreTest) = filter(tn, tags) if (!filterTest) if (ignoreTest) { val testSucceededIcon = Resources("testSucceededIconChar") val formattedSpecText = Resources("iconPlusShortName", testSucceededIcon, getFormattedSpecTextPrefix(parent) + " " + specText) report(TestIgnored(tracker.nextOrdinal(), thisSuite.suiteName, Some(thisSuite.getClass.getName), tn, Some(IndentedText(formattedSpecText, specText, 1)))) } else runTest(tn, report, stopRequested, configMap, tracker) } case InfoLeaf(_, message) => val infoProvidedIcon = Resources("infoProvidedIconChar") val formattedText = Resources("iconPlusShortName", infoProvidedIcon, message) report(InfoProvided(tracker.nextOrdinal(), message, Some(NameInfo(thisSuite.suiteName, Some(thisSuite.getClass.getName), None)), None, None, Some(IndentedText(formattedText, message, 1)))) case branch: Branch => runTestsInBranch(branch, reporter, stopRequested, filter, configMap, tracker) } ) } /** * Run a test. This trait's implementation runs the test registered with the name specified by *Tagobjects passed to * methodstestandignore. *testName. Each test's name is a concatenation of the text of all describers surrounding a test, * from outside in, and the test's spec text, with one space placed between each item. (See the documenation * fortestNamesfor an example.) * * @param testName the name of one test to execute. * @param reporter theReporterto which results will be reported * @param stopper theStopperthat will be consulted to determine whether to stop execution early. * @param configMap aMapof properties that can be used by thisSpec's executing tests. * @throws NullPointerException if any oftestName,reporter,stopper, orconfigMap* isnull. */ protected override def runTest(testName: String, reporter: Reporter, stopper: Stopper, configMap: Map[String, Any], tracker: Tracker) { if (testName == null || reporter == null || stopper == null || configMap == null) throw new NullPointerException atomic.get.testsList.find(_.testName == testName) match { case None => throw new IllegalArgumentException("Requested test doesn't exist: " + testName) case Some(test) => { val report = wrapReporterIfNecessary(reporter) val testSucceededIcon = Resources("testSucceededIconChar") val formattedSpecText = Resources("iconPlusShortName", testSucceededIcon, getFormattedSpecTextPrefix(test.parent) + " " + test.specText) // Create a Rerunner if the Spec has a no-arg constructor val hasPublicNoArgConstructor = Suite.checkForPublicNoArgConstructor(getClass) val rerunnable = if (hasPublicNoArgConstructor) Some(new TestRerunner(getClass.getName, testName)) else None val testStartTime = System.currentTimeMillis // A TestStarting event won't normally show up in a specification-style output, but // will show up in a test-style output. report(TestStarting(tracker.nextOrdinal(), thisSuite.suiteName, Some(thisSuite.getClass.getName), test.testName, Some(MotionToSuppress), rerunnable)) val formatter = IndentedText(formattedSpecText, getFormattedSpecTextPrefix(test.parent) + " " + test.specText, 1) val informerForThisTest = new MessageRecordingInformer(NameInfo(thisSuite.suiteName, Some(thisSuite.getClass.getName), Some(testName))) { def apply(message: String) { if (message == null) throw new NullPointerException if (shouldRecord) record(message) else { val infoProvidedIcon = Resources("infoProvidedIconChar") val formattedText = " " + Resources("iconPlusShortName", infoProvidedIcon, message) report(InfoProvided(tracker.nextOrdinal(), message, nameInfoForCurrentThread, None, None, Some(IndentedText(formattedText, message, 2)))) } } } val oldInformer = atomicInformer.getAndSet(informerForThisTest) var testWasPending = false var swapAndCompareSucceeded = false try { val theConfigMap = configMap withFixture( new NoArgTest { def name = testName def apply() { test.f() } def configMap = theConfigMap } ) val duration = System.currentTimeMillis - testStartTime report(TestSucceeded(tracker.nextOrdinal(), thisSuite.suiteName, Some(thisSuite.getClass.getName), test.testName, Some(duration), Some(formatter), rerunnable)) } catch { case _: TestPendingException => report(TestPending(tracker.nextOrdinal(), thisSuite.suiteName, Some(thisSuite.getClass.getName), test.testName, Some(formatter))) testWasPending = true case e if !anErrorThatShouldCauseAnAbort(e) => val duration = System.currentTimeMillis - testStartTime handleFailedTest(e, false, test.testName, test, formattedSpecText, rerunnable, report, tracker, duration) case e => throw e } finally { // send out any recorded messages for (message <- informerForThisTest.recordedMessages) { val infoProvidedIcon = Resources("infoProvidedIconChar") val formattedText = " " + Resources("iconPlusShortName", infoProvidedIcon, message) report(InfoProvided(tracker.nextOrdinal(), message, informerForThisTest.nameInfoForCurrentThread, Some(testWasPending), None, Some(IndentedText(formattedText, message, 2)))) } val shouldBeInformerForThisTest = atomicInformer.getAndSet(oldInformer) swapAndCompareSucceeded = shouldBeInformerForThisTest eq informerForThisTest } if (!swapAndCompareSucceeded) // Do outside finally to workaround Scala compiler bug throw new ConcurrentModificationException(Resources("concurrentInformerMod", thisSuite.getClass.getName)) } } } private def handleFailedTest(throwable: Throwable, hasPublicNoArgConstructor: Boolean, testName: String, test: TestLeaf, formattedSpecText: String, rerunnable: Option[Rerunner], report: Reporter, tracker: Tracker, duration: Long) { val message = if (throwable.getMessage != null) // [bv: this could be factored out into a helper method] throwable.getMessage else throwable.toString val formatter = IndentedText(formattedSpecText, getFormattedSpecTextPrefix(test.parent) + " " + test.specText, 1) report(TestFailed(tracker.nextOrdinal(), message, thisSuite.suiteName, Some(thisSuite.getClass.getName), testName, Some(throwable), Some(duration), Some(formatter), rerunnable)) } /** * Run zero to many of thisWordSpec's tests. * ** This method takes a
* *testNameparameter that optionally specifies a test to invoke. * IftestNameisSome, this trait's implementation of this method * invokesrunTeston this object, passing in: *
-
*
testName- theStringvalue of thetestNameOptionpassed * to this method
* reporter- theReporterpassed to this method, or one that wraps and delegates to it
* stopper- theStopperpassed to this method, or one that wraps and delegates to it
* configMap- theconfigMappassed to this method, or one that wraps and delegates to it
*
* This method takes a Set of tag names that should be included (tagsToInclude), and a Set
* that should be excluded (tagsToExclude), when deciding which of this Suite's tests to execute.
* If tagsToInclude is empty, all tests will be executed
* except those those belonging to tags listed in the tagsToExclude Set. If tagsToInclude is non-empty, only tests
* belonging to tags mentioned in tagsToInclude, and not mentioned in tagsToExclude
* will be executed. However, if testName is Some, tagsToInclude and tagsToExclude are essentially ignored.
* Only if testName is None will tagsToInclude and tagsToExclude be consulted to
* determine which of the tests named in the testNames Set should be run. For more information on trait tags, see the main documentation for this trait.
*
* If testName is None, this trait's implementation of this method
* invokes testNames on this Suite to get a Set of names of tests to potentially execute.
* (A testNames value of None essentially acts as a wildcard that means all tests in
* this Suite that are selected by tagsToInclude and tagsToExclude should be executed.)
* For each test in the testName Set, in the order
* they appear in the iterator obtained by invoking the elements method on the Set, this trait's implementation
* of this method checks whether the test should be run based on the tagsToInclude and tagsToExclude Sets.
* If so, this implementation invokes runTest, passing in:
*
-
*
testName- theStringname of the test to run (which will be one of the names in thetestNamesSet)
* reporter- theReporterpassed to this method, or one that wraps and delegates to it
* stopper- theStopperpassed to this method, or one that wraps and delegates to it
* configMap- theconfigMappassed to this method, or one that wraps and delegates to it
*
None, all relevant tests should be run.
* I.e., None acts like a wildcard that means run all relevant tests in this Suite.
* @param reporter the Reporter to which results will be reported
* @param stopper the Stopper that will be consulted to determine whether to stop execution early.
* @param filter a Filter with which to filter tests based on their tags
* @param configMap a Map of key-value pairs that can be used by the executing Suite of tests.
* @param distributor an optional Distributor, into which to put nested Suites to be run
* by another entity, such as concurrently by a pool of threads. If None, nested Suites will be run sequentially.
* @param tracker a Tracker tracking Ordinals being fired by the current thread.
* @throws NullPointerException if any of the passed parameters is null.
* @throws IllegalArgumentException if testName is defined, but no test with the specified test name
* exists in this Suite
*/
protected override def runTests(testName: Option[String], reporter: Reporter, stopper: Stopper, filter: Filter,
configMap: Map[String, Any], distributor: Option[Distributor], tracker: Tracker) {
if (testName == null)
throw new NullPointerException("testName was null")
if (reporter == null)
throw new NullPointerException("reporter was null")
if (stopper == null)
throw new NullPointerException("stopper was null")
if (filter == null)
throw new NullPointerException("filter was null")
if (configMap == null)
throw new NullPointerException("configMap was null")
if (distributor == null)
throw new NullPointerException("distributor was null")
if (tracker == null)
throw new NullPointerException("tracker was null")
val stopRequested = stopper
testName match {
case None => runTestsInBranch(atomic.get.trunk, reporter, stopRequested, filter, configMap, tracker)
case Some(tn) => runTest(tn, reporter, stopRequested, configMap, tracker)
}
}
/**
* An immutable Set of test names. If this WordSpec contains no tests, this method returns an
* empty Set.
*
*
* This trait's implementation of this method will return a set that contains the names of all registered tests. The set's
* iterator will return those names in the order in which the tests were registered. Each test's name is composed
* of the concatenation of the text of each surrounding describer, in order from outside in, and the text of the
* example itself, with all components separated by a space. For example, consider this WordSpec:
*
* import org.scalatest.WordSpec
*
* class StackSpec {
* "A Stack" when {
* "not empty" must {
* "allow me to pop" in {}
* }
* "not full" must {
* "allow me to push" in {}
* }
* }
* }
*
*
*
* Invoking testNames on this Spec will yield a set that contains the following
* two test name strings:
*
* "A Stack (when not empty) must allow me to pop" * "A Stack (when not full) must allow me to push" **/ override def testNames: Set[String] = ListSet(atomic.get.testsList.map(_.testName): _*) override def run(testName: Option[String], reporter: Reporter, stopper: Stopper, filter: Filter, configMap: Map[String, Any], distributor: Option[Distributor], tracker: Tracker) { val stopRequested = stopper // Set the flag that indicates registration is closed (because run has now been invoked), // which will disallow any further invocations of "describe", it", or "ignore" with // an RegistrationClosedException. val oldBundle = atomic.get var (trunk, currentBranch, tagsMap, testsList, registrationClosed) = oldBundle.unpack if (!registrationClosed) updateAtomic(oldBundle, Bundle(trunk, currentBranch, tagsMap, testsList, true)) val report = wrapReporterIfNecessary(reporter) val informerForThisSuite = new ConcurrentInformer(NameInfo(thisSuite.suiteName, Some(thisSuite.getClass.getName), None)) { def apply(message: String) { if (message == null) throw new NullPointerException report(InfoProvided(tracker.nextOrdinal(), message, nameInfoForCurrentThread)) } } atomicInformer.set(informerForThisSuite) var swapAndCompareSucceeded = false try { super.run(testName, report, stopRequested, filter, configMap, distributor, tracker) } finally { val shouldBeInformerForThisSuite = atomicInformer.getAndSet(zombieInformer) swapAndCompareSucceeded = shouldBeInformerForThisSuite eq informerForThisSuite } if (!swapAndCompareSucceeded) // Do outside finally to workaround Scala compiler bug throw new ConcurrentModificationException(Resources("concurrentInformerMod", thisSuite.getClass.getName)) } /** * Supports shared test registration in
WordSpecs.
*
* * This field enables syntax such as the following: *
* ** behave like nonFullStack(stackWithOneItem) * ^ ** *
* For more information and examples of the use of