Searched refs:scaling (Results 1 – 2 of 2) sorted by relevance
652 float scaling; // scaling factor in pivoting in fmatrixAeqInvA() local761 scaling = A[m][iPivotCol]; in fmatrixAeqInvA()769 if ((A[iPivotCol][l] != 0.0F) && (scaling != 0.0F)) in fmatrixAeqInvA()770 A[m][l] -= A[iPivotCol][l] * scaling; in fmatrixAeqInvA()
12 … is performed. The legacy APIs have a fixed point format with power of 2 scaling. This simplifies …