Detecting Multiple Errors in a Single Test with JUnit

Now, it's the turn of another little useful thing. Recalling my test examples, and taking one with more details (i.e. testing some metadata values):

package it.tidalwave.imageio.raf;

import javax.annotation.Nonnull;
import java.util.Collection;
import it.tidalwave.imageio.ExpectedResults;
import it.tidalwave.imageio.NewImageReaderTestSupport;
import org.junit.runners.Parameterized.Parameters;

public class RAFImageReaderImageTest extends NewImageReaderTestSupport
  {
    public RAFImageReaderImageTest (final @Nonnull ExpectedResults expectedResults)
      {
        super(expectedResults);
      }

    @Nonnull
    @Parameters
    public static Collection<Object[]> expectedResults()
      {
        return fixed
          (
            // S9500
            ExpectedResults.create("https://imaging.dev.java.net/nonav/TestSets/peterbecker/Fujifilm/FinePixS9500/RAF/DSCF3756.RAF").
                            image(4292, 4291, 3, 16, "f53e19fbd1f512ddf052e13097735383").
                            thumbnail(160, 120).
                            thumbnail(1600, 1200).
                            issues("JRW-252").
                            metadata("metadata.fujiRawData.header", "FUJIFILMCCD-RAW 0201FF393101FinePix S9500  \u0000\u0000\u0000\u0000\u0000").
                            metadata("metadata.fujiRawData.version", "\u0000\u0000\u0000\u0000").
                            metadata("metadata.fujiRawData.b1", new byte[]{0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 48, 50, 54, 57}).
                            metadata("metadata.fujiRawData.b2", new byte[]{0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0}).
                            metadata("metadata.fujiRawData.JPEGImageOffset", 148).
                            metadata("metadata.fujiRawData.JPEGImageLength", 611759).
                            metadata("metadata.fujiRawData.table1Offset", 611914).
                            metadata("metadata.fujiRawData.table1Length", 3958).
                            metadata("metadata.fujiRawData.CFAOffset", 615872).
                            metadata("metadata.fujiRawData.CFALength", 18528512).
                            metadata("metadata.fujiRawData.unused1", 0).
                            metadata("metadata.fujiRawData.unused2", 18528512).
                            metadata("metadata.fujiRawData.unused3", 0).
                            metadata("metadata.fujiRawData.unused4", 0).
                            metadata("metadata.fujiRawData.unused5", 0).
                            metadata("metadata.fujiRawData.unused6", 0).
                            metadata("metadata.fujiRawData.unused7", 0).
                            metadata("metadata.fujiRawData.unused8", 0).
                            metadata("metadata.fujiRawData.unused9", 0).
                            metadata("metadata.fujiRawData.unused10", 0).
                            metadata("metadata.fujiRawData.fujiTable1.width", 2448).
                            metadata("metadata.fujiRawData.fujiTable1.height", 3688).
                            metadata("metadata.fujiRawData.fujiTable1.rawWidth", 2512).
                            metadata("metadata.fujiRawData.fujiTable1.rawHeight", 3688).
                            metadata("metadata.fujiRawData.fujiTable1.fujiLayout", true).
                            metadata("metadata.fujiRawData.fujiTable1.coefficients", new short[]{320, 502, 320, 422})
          );
      }
  }

,,,you can see that there are a lot of things that can fail: image size, raster, thumbnail size, any metadata item; there can be multiple failures at the same time, but with the usualy style of handling test errors (that is with plain asserting) you can only see the first. You fix it, just to discover another, etc. For instance, if the image size is different than the expected, the whole section of assertions for metadata wont' be executed.

In my experience with jrawio, many errors with a new sample file could be fixed at the same time; wouldn't be much better if you could see *all* the failures immediately?