An open source computational fluid dynamics (CFD) solver has been incorporated into the WindNinja modeling framework widely used by wildland fire managers as well as researchers and practitioners in other fields, such as wind energy, wind erosion, and search and rescue. Here we describe incorporation of the CFD solver and evaluate its performance compared to the conservation of mass (COM) solver in WindNinja and previously published large-eddy simulations (LES) for three field campaigns conducted over isolated terrain obstacles of varying terrain complexity: Askervein Hill, Bolund Hill, and Big Southern Butte. We also compare the effects of two important model settings in the CFD solver and provide guidance on model sensitivity to these settings. Additionally, we investigate the computational mesh and difficulties regarding terrain representation. Two important findings from this work are: (1) the choice of discretization scheme for advection has a significantly larger effect on the simulated winds than the choice of turbulence model and (2) CFD solver predictions are significantly better than the COM solver predictions at windward and lee side observation locations, but no difference was found in predicted speed-up at ridgetop locations between the two solvers.