Relevant Fields

Both ports
SYN/FIN/RST/ACK flags
ack/seq number fields
Options
Other fields are important as well and must certainly be verified (e.g. does the reserved field really contain 0's only?)

Both ports