Skip to content

Graphorin API reference v0.8.0


Graphorin API reference / @graphorin/reranker-transformersjs / / defaultRerankerDtype

Function: defaultRerankerDtype()

ts
function defaultRerankerDtype(device): RerankerDtype;

Defined in: packages/reranker-transformersjs/src/cross-encoder.ts:36

Device-aware default precision. The fp16 ONNX exports of the default BGE rerankers fail session initialisation on the onnxruntime-node CPU execution provider (SimplifiedLayerNormFusion cast error, N-01/22), so the CPU default is the q8 quantization; non-CPU devices ('webgpu', ...) keep fp16.

Parameters

ParameterType
devicestring | undefined

Returns

RerankerDtype

Stable