Test runner icon meaning

Hi,

I've been using ReSharper 6 for quite some time, but there's a thing I've been wondering.

What does the icons in the test runner actually mean? There are no tooltip, and the online help isn't updated for the new version yet.

This is what I know:
1. Number of testclasses/fixtures (125)
2. Number of passed tests (169)
3. Number of failed tests (0)
4. Number of ignored tests (2)
5. I have no clue about this one (-46?)

I can see it is a difference between the number of tests and testfixtures (testclasses - (passing + ignored)), but what is it good for? Can it ever be positive?


Thanks,
Kenneth



Attachment(s):
Capture.PNG
5 comments
Comment actions Permalink

Hello Kenneth,

This number should show how many tests from the session were not run. For
instance, if you have a test session with 5 tests, but you select only 3
and run them, this indicator should be set to 2. Negative number could indicate
a problem in ReSharper. Can you reproduce this behavior? Thank you!

Andrey Serebryansky
Senior Support Engineer
JetBrains, Inc
http://www.jetbrains.com
"Develop with pleasure!"

Hi,

I've been using ReSharper 6 for quite some time, but there's a thing
I've been wondering.

What does the icons in the test runner actually mean? There are no
tooltip, and the online help isn't updated for the new version yet.

This is what I know:
1. Number of testclasses/fixtures (125)
2. Number of passed tests (169)
3. Number of failed tests (0)
4. Number of ignored tests (2)
5. I have no clue about this one (-46?)
I can see it is a difference between the number of tests and
testfixtures (testclasses - (passing + ignored)), but what is it good
for? Can it ever be positive?

Thanks,
Kenneth
---
Original message URL:
http://devnet.jetbrains.net/message/5323388#5323388



0
Comment actions Permalink

Hi,

Okay, I can see that. It disappeared again, but I just thought the number was strange since it was negative (it ran MORE tests than was in the project??? ;))
Anyway, I am not sure how to reproduce it, as I said, it disappeared again. We are using a lot of [TestCase] annotations with NUnit. Could that be what's messing up the number?

I do recall that removing all tests from the testrunner and re-running them all for the entire solution cleared it up, so maybe it was just some old statistics showing up.


Thanks,
Kenneth

0
Comment actions Permalink

Hello Kenneth,

Lots of attributes could cause this problem, however it would
be great if you could monitor this indicator during daily work and when it
starts showing negative numbers again, write a post here with some details
on what you were doing prior to that. Meanwhile, we'll try investigating
this problem on our side. Thank you!

Andrey Serebryansky
Senior Support Engineer
JetBrains, Inc
http://www.jetbrains.com
"Develop with pleasure!"

Hi,

Okay, I can see that. It disappeared again, but I just thought the
number was strange since it was negative (it ran MORE tests than was
in the project??? )

Anyway, I am not sure how to reproduce it, as I said, it disappeared
again. We are using a lot of annotations with NUnit. Could
that be what's messing up the number?

I do recall that removing all tests from the testrunner and re-running
them all for the entire solution cleared it up, so maybe it was just
some old statistics showing up.

Thanks,
Kenneth
---
Original message URL:
http://devnet.jetbrains.net/message/5323563#5323563



0
Comment actions Permalink

Hi,

Actually it started again. I'm still not quite sure what is causing it, but I have a strong feeling it's caused by the TestCase attribute. I was converting some existing tests to use testcase and now it's currently showing -4 :)

So, that might be what's going on. If I clear my tests and re-run them, it returns to 0, so I guess it can't quite handle me turning single tests into multiple (which I can understand might be difficult, as they change signature).

Kenneth

0
Comment actions Permalink

Hello Kenneth,

Oh, this seems to be a known issue and it should get fixed in ReSharper 6.1
Thank you!

Andrey Serebryansky
Senior Support Engineer
JetBrains, Inc
http://www.jetbrains.com
"Develop with pleasure!"

Hi,

Actually it started again. I'm still not quite sure what is causing
it, but I have a strong feeling it's caused by the TestCase attribute.
I was converting some existing tests to use testcase and now it's
currently showing -4

So, that might be what's going on. If I clear my tests and re-run
them, it returns to 0, so I guess it can't quite handle me turning
single tests into multiple (which I can understand might be difficult,
as they change signature).

Kenneth

---
Original message URL:
http://devnet.jetbrains.net/message/5323608#5323608



0

Please sign in to leave a comment.