This avoids spurious errors like "row_major and column_major are mutually exclusive" when an invalid modifier is used. Fixes: cf7c05f4315dd21a96f60653497c1228a38f61af