EMJ PIC CONDUCTS RTO FOR BLEED VALVE FAILURE ANNUNCIATION BUT BELIEVES FOLLOW ON MAINT TEST PROCS DO NOT ACCURATELY SIMULATE TKOF PWR BEING USED WHEN ANNUNCIATION OCCURRED.

Narrative

REJECTED TKOF AT ZZZ DUE TO AMBER CAS; SINGLE CHIME; FOR BLEED VALVE 2 FAIL. AT APPROX 50 KTS WE HAD THE SINGLE CHIME AND MASTER CAUTION ALERT FOR THE ABOVE MESSAGE. THE ALERT WENT OUT WITHIN 1 TO 2 SECONDS WITHOUT ANY ACTION BEING TAKEN BY US; AND PRIOR TO ANY REJECT. THE TKOF CONTINUED NORMALLY FOR ANOTHER FEW SECONDS (5 TO 8?) WHEREUPON THE ALERT RE-OCCURRED. REJECTED TKOF PROCS WERE ACCOMPLISHED AT SOMEWHERE AROUND 80 TO 90 KIAS. BRAKES NEVER ENTERED THE AMBER ZONE AND THE TAXI BACK TO THE GATE WAS UNEVENTFUL. A REJECTED TKOF WOULD HAVE LIKELY OCCURRED AGAIN WITH THE NEXT TKOF HAS WE SIMPLY FOLLOWED MAINT AND EMBRAER TECH ORDER GUIDANCE. PER MAINT REQUEST; WE RAN SEVERAL TESTS; TO INCLUDE THE EMBRAER TEST PROFILE TECH ORDER GUIDANCE FOR THIS CONDITION; AS FAXED TO THE A & P TECHNICIAN. THE ACFT PASSED ALL WITHOUT PROB. BEING A SKEPTICAL SORT; HOWEVER; I REQUESTED CLRNC FROM TWR TO ADVANCE THE #2 ENG TO TKOF POWER. WITH A GND RAMPER MONITORING AS WELL (AT THE FRONT OF THE ACFT) WE WERE ABLE TO ENSURE A SAFE TEST. WITHIN 4 OR 5 SECONDS WE HAD THE SAME CAS MESSAGE; MASTER CAUTION AND SINGLE CHIME. THIS RE-OCCURRED FIVE TIMES; WITH EACH ADVANCE OF THE #2 ENG TO ANYWHERE NEAR TKOF -1 POWER LEVELS (AT OR ABOVE APPROX 73% AND APPROX 93% N2). I STRONGLY RECOMMEND WE ADVISE THE FAA AND EMBRAER THAT THE TEST FOR THIS SIT; AS PUBLISHED IN THE MATERIAL WE RECEIVED; IS INSUFFICIENTLY THOROUGH. IF THIS CONDITION PRESENTS ITSELF AT TKOF POWER SETTINGS; THEN THE TEST SHOULD BE ACCOMPLISHED; REPEATEDLY AND FOR SEVERAL SECONDS; AT THOSE THRUST SETTINGS AS WELL. (CURRENT GUIDANCE HAS ALL TESTING DONE AT IDLE THRUST.)