This FET Mixer example explains how to setup a nonlinear simulation from adding the
nonlinear ports to simulating both single-tone and multi-tone non-linear
measurements.

Setup Harmonic Balance Ports

 

Setup of a Constant IF with a Swept RF

Setup of a Multi Tone Analysis (IP3)