476864 - as3/sampling tests failing intermittently

Status: RESOLVED WONTFIX

(Tamarin Graveyard :: Virtual Machine, defect)

Description

[Chris Peyer]

The following sampling tests are failing intermittently on all platforms:

  as3/sampling/Callback.abc
  as3/sampling/ProcessSampling.abc
  as3/sampling/SimpleSampling.abc
  as3/sampling/StartSamplingErrors.abc

Here are two runs from OSX 10.5:
One run:

  as3/sampling/Callback.abc : Callback: callback with parameters throws exception =  FAILED! expected: ArgumentError: Error #1063
  as3/sampling/ProcessSampling.abc : FAILED! expected:
  as3/sampling/SimpleSampling.abc : test getSampleCount on simple loop internalAllocs=true = false FAILED! expected: true
  as3/sampling/StartSamplingErrors.abc : PauseSamplingTwice: call pauseSamples() twice in a row = false FAILED! expected: true

Another run:

  as3/sampling/Callback.abc : Callback: callback with parameters throws exception =  FAILED! expected: ArgumentError: Error #1063
  as3/sampling/ProcessSampling.abc : FAILED! expected:
  as3/sampling/SimpleSampling.abc : test getSampleCount on simple loop internalAllocs=false = false FAILED! expected: true
  as3/sampling/SimpleSampling.abc : test getSamples length on simple loop internalAllocs=false = false FAILED! expected: true
  as3/sampling/SimpleSampling.abc : test getSampleCount on simple loop internalAllocs=true = false FAILED! expected: true
  as3/sampling/StartSamplingErrors.abc : PauseSamplingTwice: call pauseSamples() twice in a row = false FAILED! expected: true

Comment 1

[Chris Peyer]

Tests disabled in testconfig.

Comment 2

[Edwin Smith]

further commentary:  i want to be able to diff the (process status, stdout, stderr) data from successive runs of many vm's, so these tests should not output anything transient.  Transient output is things like #of samples, bytes, pages, milliseconds, etc, and could still be output in a performance test, separately from an acceptance test.

Comment 3

[Brent Baker]

We are still seeing as3/sampling/ProcessSamples fail intermittently. This needs to be investigated and resolved.

as3/sampling/ProcessSampling.abc : GetSizeSamples: test getSize on NewObjectSamples returns a positive value = false FAILED! expected: true

We saw this fail a couple of weeks ago on multiple mac machines and was moved into the "smokes" testing. It just failed on a PPC machine and I was able to reproduce the failure in about 1 in 10 runs of the abc file.

This test is being skipped until this is resolved. Changes to acceptance/testconfig to skip the test were pushed in 2417:a589a53c760e

Comment 4

[Brent Baker]

setting QRB request to "+", bug has been targeted and assigned

Comment 5

[Dan Schaffer]

moving bug to future since it is not required for 10.1 release.  I will continue to test and hopefully reenable the tests soon.

Comment 6

[Dan Schaffer]

Attachment: patch for sampling tests

will test in sandbox and more thoroughly on platforms with histories of failures.

Comment 7

[Dan Schaffer]

Attachment: patch for sampling tests modified so release does not stack overflow

Comment 8

[Brent Baker]

Dan any updates on the patch?

Comment 9

[Sylvestre Ledru [:Sylvestre]]

Tamarin is a dead project now. Mass WONTFIX.

Comment 10

[Sylvestre Ledru [:Sylvestre]]

Tamarin isn't maintained anymore. WONTFIX remaining bugs.