When a product says it’s water resistant, you probably aren’t going to test that claim out yourself (at least not intentionally). That’s why we’ve got the fine folks at Consumer Reports, who recently subjected the Samsung Galaxy S7 Active to a “dunk test” to see if the phone would live up to its watertight claims.

The company claims the S7 Active (an AT&T exclusive) is water resistant in up to five feet for 30 minutes, so Consumer Reports went ahead and did just that, submerging the phone in a pressurized tank to simulate that effect. The phone failed that test… twice.

The screen on the first phone didn’t work after its bath, and the second’s screen flickered on and off. Days after the dunk test, neither phone worked.

Samsung calls the Galaxy S7 Active “one of the most rugged phones to date,” but said “There may be a chance some Samsung phones aren’t as watertight.” The company told Consumer Reports it would be looking into the submersion issue.

For more info, head over to Consumer Reports, and check out the testing process in the video below:

Want more consumer news? Visit our parent organization, Consumer Reports, for the latest on scams, recalls, and other consumer issues.