The instance mask: 8 bits (as in DXR) at bits 8-15 of the instance flags
word. A masked trace skips an instance whose (mask & rayMask) == 0 at the
top level, before entering its tree. The builders write
INSTANCE_MASK_ALL unless the instance gives a mask. A trace module
built with rayMasks: false ignores it.
The instance mask: 8 bits (as in DXR) at bits 8-15 of the instance
flagsword. A masked trace skips an instance whose(mask & rayMask) == 0at the top level, before entering its tree. The builders write INSTANCE_MASK_ALL unless the instance gives a mask. A trace module built withrayMasks: falseignores it.