Available Commands¶

Backends¶

enum [anonymous]¶

Values:

enumerator CCV_NNC_NO_BACKEND¶

enumerator CCV_NNC_BACKEND_CPU_OPT¶

enumerator CCV_NNC_BACKEND_CPU_REF¶

enumerator CCV_NNC_BACKEND_GPU_CUBLAS¶

enumerator CCV_NNC_BACKEND_GPU_CUDNN¶

enumerator CCV_NNC_BACKEND_GPU_NCCL¶

enumerator CCV_NNC_BACKEND_GPU_REF¶

enumerator CCV_NNC_BACKEND_MPS¶

enumerator CCV_NNC_BACKEND_COUNT¶

Commands¶

The list is available once you included <nnc/ccv_nnc_easy.h>. To do it the hard way, you should check the underlying implementation. These APIs can be called in places that requires ccv_nnc_cmd_t data structure.

CMD_NOOP()¶

CMD_CUSTOM_FORWARD(f)¶

CMD_ADAM_FORWARD(_step, _rate, _beta1, _beta2, _decay, _epsilon, _amsgrad)¶

CMD_ADAMW_FORWARD(_step, _rate, _beta1, _beta2, _decay, _epsilon, _amsgrad)¶

CMD_GEMM_FORWARD(...)¶

CMD_GEMM_BACKWARD(...)¶

CMD_ADD_FORWARD(_p, _q)¶

CMD_ADD_BACKWARD(_p, _q)¶

CMD_MUL_FORWARD(_p)¶

CMD_MUL_BACKWARD(_p)¶

CMD_SCALAR_MUL_FORWARD(_a)¶

CMD_SCALAR_MUL_BACKWARD(_a)¶

CMD_CMUL_FORWARD()¶

CMD_CMUL_BACKWARD()¶

CMD_COMM_ALLREDUCE_FORWARD()¶

CMD_COMM_ALLREDUCE_BACKWARD()¶

CMD_COMM_BROADCAST_FORWARD()¶

CMD_COMM_BROADCAST_BACKWARD()¶

CMD_COMM_REDUCE_FORWARD()¶

CMD_COMM_REDUCE_BACKWARD()¶

CMD_MIN_FORWARD()¶

CMD_MIN_BACKWARD()¶

CMD_MAX_FORWARD()¶

CMD_MAX_BACKWARD()¶

CMD_COMPRESSION_LSSC_FORWARD()¶

CMD_COMPRESSION_LSSC_BACKWARD()¶

CMD_CONVOLUTION_FORWARD(_groups, _count, ...)¶

CMD_CONVOLUTION_BACKWARD(_groups, _count, ...)¶

CMD_CONVOLUTION_TRANSPOSE_FORWARD(_groups, _count, _output_padding, ...)¶

CMD_CONVOLUTION_TRANSPOSE_BACKWARD(_groups, _count, _output_padding, ...)¶

CMD_DROPOUT_FORWARD_X_F(...)¶

CMD_DROPOUT_FORWARD_X_1(_p)¶

CMD_DROPOUT_FORWARD_X_2(_p, _entirety)¶

CMD_DROPOUT_FORWARD_X_SEL(_0, _1, _2, _FX, ...)¶

CMD_DROPOUT_FORWARD(...)¶

CMD_DROPOUT_BACKWARD_X_F(...)¶

CMD_DROPOUT_BACKWARD_X_1(_p)¶

CMD_DROPOUT_BACKWARD_X_2(_p, _entirety)¶

CMD_DROPOUT_BACKWARD_X_SEL(_0, _1, _2, _FX, ...)¶

CMD_DROPOUT_BACKWARD(...)¶

CMD_EWSUM_FORWARD()¶

CMD_EWSUM_BACKWARD()¶

CMD_EWPROD_FORWARD()¶

CMD_EWPROD_BACKWARD()¶

CMD_EWDIV_FORWARD()¶

CMD_EWDIV_BACKWARD()¶

CMD_EWEXP_FORWARD()¶

CMD_EWEXP_BACKWARD()¶

CMD_EWLOG_FORWARD()¶

CMD_EWLOG_BACKWARD()¶

CMD_EWSQRT_FORWARD()¶

CMD_EWSQRT_BACKWARD()¶

CMD_EWABS_FORWARD()¶

CMD_EWABS_BACKWARD()¶

CMD_CLAMP_FORWARD(_min, _max)¶

CMD_CLAMP_BACKWARD(_min, _max)¶

CMD_GELU_FORWARD(_tanh)¶

CMD_GELU_BACKWARD(_tanh)¶

CMD_HISTOGRAM_EVEN(_bins, _min, _max)¶

CMD_HISTOGRAM_LOG_X_0()¶

CMD_HISTOGRAM_LOG_X_F(...)¶

CMD_HISTOGRAM_LOG_X_2(_min, _max, _rate)¶

CMD_HISTOGRAM_LOG_X_SEL(_0, _1, _2, _3, _FX, ...)¶

CMD_HISTOGRAM_LOG(...)¶

CMD_HISTOGRAM_BINS()¶

CMD_INDEX_SELECT_FORWARD()¶

CMD_INDEX_SELECT_BACKWARD()¶

CMD_REDUCE_ISNAN_FORWARD(...)¶

CMD_REDUCE_ISNAN_BACKWARD(...)¶

CMD_LAMB_FORWARD(_step, _rate, _beta1, _beta2, _decay, _epsilon)¶

CMD_LEAKY_RELU_FORWARD(_negative_slope)¶

CMD_LEAKY_RELU_BACKWARD(_negative_slope)¶

CMD_BINARY_CROSSENTROPY_FORWARD_X_0()¶

CMD_BINARY_CROSSENTROPY_FORWARD_X_F(...)¶

CMD_BINARY_CROSSENTROPY_FORWARD_X_1(_pos_weight)¶

CMD_BINARY_CROSSENTROPY_FORWARD_X_SEL(_0, _1, _FX, ...)¶

CMD_BINARY_CROSSENTROPY_FORWARD(...)¶

CMD_BINARY_CROSSENTROPY_BACKWARD_X_0()¶

CMD_BINARY_CROSSENTROPY_BACKWARD_X_F(...)¶

CMD_BINARY_CROSSENTROPY_BACKWARD_X_1(_pos_weight)¶

CMD_BINARY_CROSSENTROPY_BACKWARD_X_SEL(_0, _1, _FX, ...)¶

CMD_BINARY_CROSSENTROPY_BACKWARD(...)¶

CMD_CATEGORICAL_CROSSENTROPY_FORWARD_X_0()¶

CMD_CATEGORICAL_CROSSENTROPY_FORWARD_X_F(...)¶

CMD_CATEGORICAL_CROSSENTROPY_FORWARD_X_2(_trim0, _trim1)¶

CMD_CATEGORICAL_CROSSENTROPY_FORWARD_X_SEL(_0, _1, _2, _FX, ...)¶

CMD_CATEGORICAL_CROSSENTROPY_FORWARD(...)¶

CMD_CATEGORICAL_CROSSENTROPY_BACKWARD_X_0()¶

CMD_CATEGORICAL_CROSSENTROPY_BACKWARD_X_F(...)¶

CMD_CATEGORICAL_CROSSENTROPY_BACKWARD_X_2(_trim0, _trim1)¶

CMD_CATEGORICAL_CROSSENTROPY_BACKWARD_X_SEL(_0, _1, _2, _FX, ...)¶

CMD_CATEGORICAL_CROSSENTROPY_BACKWARD(...)¶

CMD_MSE_FORWARD(_reduce_op)¶

CMD_MSE_BACKWARD(_reduce_op)¶

CMD_SMOOTH_L1_FORWARD(_b)¶

CMD_SMOOTH_L1_BACKWARD(_b)¶

CMD_NMS_FORWARD(_iou_threshold)¶

CMD_NMS_BACKWARD(_iou_threshold)¶

CMD_BATCH_NORM_FORWARD(_epsilon, _is_test, _momentum, ...)¶

CMD_BATCH_NORM_BACKWARD(_epsilon, _is_test, _momentum, ...)¶

CMD_LAYER_NORM_FORWARD(_epsilon, _elementwise_affine, ...)¶

CMD_LAYER_NORM_BACKWARD(_epsilon, _elementwise_affine, ...)¶

CMD_GROUP_NORM_FORWARD(_group_axis, _groups, _epsilon, _elementwise_affine, ...)¶

CMD_GROUP_NORM_BACKWARD(_group_axis, _groups, _epsilon, _elementwise_affine, ...)¶

CMD_RMSNORM_FORWARD(_epsilon, ...)¶

CMD_RMSNORM_BACKWARD(_epsilon, ...)¶

CMD_PAD_FORWARD(_type, _begin, _end)¶

CMD_PAD_BACKWARD(_type, _begin, _end)¶

CMD_MAX_POOL_FORWARD(rows, cols)¶

CMD_MAX_POOL_BACKWARD(rows, cols)¶

CMD_AVERAGE_POOL_FORWARD(rows, cols)¶

CMD_AVERAGE_POOL_BACKWARD(rows, cols)¶

CMD_RANDOM_UNIFORM_FORWARD(_lb, _ub)¶

CMD_RANDOM_UNIFORM_BACKWARD(_lb, _ub)¶

CMD_RANDOM_NORMAL_FORWARD(_std, _mean)¶

CMD_RANDOM_NORMAL_BACKWARD(_std, _mean)¶

CMD_REDUCE_SUM_FORWARD(...)¶

CMD_REDUCE_SUM_BACKWARD(...)¶

CMD_REDUCE_MEAN_FORWARD(...)¶

CMD_REDUCE_MEAN_BACKWARD(...)¶

CMD_REDUCE_MAX_FORWARD(...)¶

CMD_REDUCE_MAX_BACKWARD(...)¶

CMD_REDUCE_MIN_FORWARD(...)¶

CMD_REDUCE_MIN_BACKWARD(...)¶

CMD_REDUCE_NORM2_FORWARD(...)¶

CMD_REDUCE_NORM2_BACKWARD(...)¶

CMD_ARGMAX_FORWARD(...)¶

CMD_ARGMAX_BACKWARD(...)¶

CMD_ARGMIN_FORWARD(...)¶

CMD_ARGMIN_BACKWARD(...)¶

CMD_RELU_FORWARD()¶

CMD_RELU_BACKWARD()¶

CMD_RMSPROP_FORWARD(_rate, _decay, _alpha, _momentum, _epsilon)¶

CMD_LSTM_FORWARD(_hidden_size, _proj_size, _num_layers, _bias, _batch_first, _bidirectional, _dropout, _is_test)¶

CMD_LSTM_BACKWARD(_hidden_size, _proj_size, _num_layers, _bias, _batch_first, _bidirectional, _dropout, _is_test)¶

CMD_ROI_ALIGN_FORWARD(rows, cols)¶

CMD_ROI_ALIGN_BACKWARD(rows, cols)¶

CMD_SCALED_DOT_PRODUCT_ATTENTION_FORWARD(_scale, _is_causal)¶

CMD_SCALED_DOT_PRODUCT_ATTENTION_BACKWARD(_scale, _is_causal)¶

CMD_SGD_FORWARD(_nesterov, _rate, _scale, _decay, _momentum, _dampening)¶

CMD_SIGMOID_FORWARD()¶

CMD_SIGMOID_BACKWARD()¶

CMD_SIGMOID_BINARY_CROSSENTROPY_FORWARD_X_0()¶

CMD_SIGMOID_BINARY_CROSSENTROPY_FORWARD_X_F(...)¶

CMD_SIGMOID_BINARY_CROSSENTROPY_FORWARD_X_1(_pos_weight)¶

CMD_SIGMOID_BINARY_CROSSENTROPY_FORWARD_X_SEL(_0, _1, _FX, ...)¶

CMD_SIGMOID_BINARY_CROSSENTROPY_FORWARD(...)¶

CMD_SIGMOID_BINARY_CROSSENTROPY_BACKWARD_X_0()¶

CMD_SIGMOID_BINARY_CROSSENTROPY_BACKWARD_X_F(...)¶

CMD_SIGMOID_BINARY_CROSSENTROPY_BACKWARD_X_1(_pos_weight)¶

CMD_SIGMOID_BINARY_CROSSENTROPY_BACKWARD_X_SEL(_0, _1, _FX, ...)¶

CMD_SIGMOID_BINARY_CROSSENTROPY_BACKWARD(...)¶

CMD_SOFTMAX_FORWARD()¶

CMD_SOFTMAX_BACKWARD()¶

CMD_SOFTMAX_CROSSENTROPY_FORWARD_X_0()¶

CMD_SOFTMAX_CROSSENTROPY_FORWARD_X_F(...)¶

CMD_SOFTMAX_CROSSENTROPY_FORWARD_X_2(_trim0, _trim1)¶

CMD_SOFTMAX_CROSSENTROPY_FORWARD_X_SEL(_0, _1, _2, _FX, ...)¶

CMD_SOFTMAX_CROSSENTROPY_FORWARD(...)¶

CMD_SOFTMAX_CROSSENTROPY_BACKWARD_X_0()¶

CMD_SOFTMAX_CROSSENTROPY_BACKWARD_X_F(...)¶

CMD_SOFTMAX_CROSSENTROPY_BACKWARD_X_2(_trim0, _trim1)¶

CMD_SOFTMAX_CROSSENTROPY_BACKWARD_X_SEL(_0, _1, _2, _FX, ...)¶

CMD_SOFTMAX_CROSSENTROPY_BACKWARD(...)¶

CMD_SWISH_FORWARD()¶

CMD_SWISH_BACKWARD()¶

CMD_TANH_FORWARD()¶

CMD_TANH_BACKWARD()¶

CMD_UPSAMPLE_FORWARD(_type, _width_scale, _height_scale, _align_corners)¶

CMD_UPSAMPLE_BACKWARD(_type, _width_scale, _height_scale, _align_corners)¶

CMD_SET_FORWARD(_val)¶

CMD_SET_BACKWARD(_val)¶

CMD_MASKED_FILL_FORWARD(_eq, _fill)¶

CMD_MASKED_FILL_BACKWARD(_eq, _fill)¶

CMD_DATA_TRANSFER_FORWARD()¶

CMD_DATA_TRANSFER_BACKWARD()¶

CMD_FORMAT_TRANSFORM_FORWARD()¶

CMD_FORMAT_TRANSFORM_BACKWARD()¶

CMD_TRANSPOSE_FORWARD(_axis_a, _axis_b)¶

CMD_TRANSPOSE_BACKWARD(_axis_a, _axis_b)¶

CMD_DATATYPE_CONVERSION_FORWARD()¶

CMD_DATATYPE_CONVERSION_BACKWARD()¶

Command Identifiers¶

enum [anonymous]¶

Values:

enumerator CCV_NNC_NOOP¶

enumerator CCV_NNC_CUSTOM_FORWARD¶

enumerator CCV_NNC_CUSTOM_BACKWARD¶

enumerator CCV_NNC_GRAPH_FORWARD¶

enumerator CCV_NNC_GRAPH_BACKWARD¶

enumerator CCV_NNC_ADAM_FORWARD¶

enumerator CCV_NNC_ADAM_BACKWARD¶

enumerator CCV_NNC_ADAMW_FORWARD¶

enumerator CCV_NNC_ADAMW_BACKWARD¶

enumerator CCV_NNC_ADD_FORWARD¶

enumerator CCV_NNC_ADD_BACKWARD¶

enumerator CCV_NNC_ARGMAX_FORWARD¶

enumerator CCV_NNC_ARGMAX_BACKWARD¶

enumerator CCV_NNC_ARGMIN_FORWARD¶

enumerator CCV_NNC_ARGMIN_BACKWARD¶

enumerator CCV_NNC_AVERAGE_POOL_FORWARD¶

enumerator CCV_NNC_AVERAGE_POOL_BACKWARD¶

enumerator CCV_NNC_BATCH_NORM_FORWARD¶

enumerator CCV_NNC_BATCH_NORM_BACKWARD¶

enumerator CCV_NNC_BINARY_CROSSENTROPY_FORWARD¶

enumerator CCV_NNC_BINARY_CROSSENTROPY_BACKWARD¶

enumerator CCV_NNC_CATEGORICAL_CROSSENTROPY_FORWARD¶

enumerator CCV_NNC_CATEGORICAL_CROSSENTROPY_BACKWARD¶

enumerator CCV_NNC_CLAMP_FORWARD¶

enumerator CCV_NNC_CLAMP_BACKWARD¶

enumerator CCV_NNC_CMUL_FORWARD¶

enumerator CCV_NNC_CMUL_BACKWARD¶

enumerator CCV_NNC_COMM_ALLREDUCE_FORWARD¶

enumerator CCV_NNC_COMM_ALLREDUCE_BACKWARD¶

enumerator CCV_NNC_COMM_BROADCAST_FORWARD¶

enumerator CCV_NNC_COMM_BROADCAST_BACKWARD¶

enumerator CCV_NNC_COMM_REDUCE_FORWARD¶

enumerator CCV_NNC_COMM_REDUCE_BACKWARD¶

enumerator CCV_NNC_COMPRESSION_LSSC_FORWARD¶

enumerator CCV_NNC_COMPRESSION_LSSC_BACKWARD¶

enumerator CCV_NNC_CONVOLUTION_FORWARD¶

enumerator CCV_NNC_CONVOLUTION_BACKWARD¶

enumerator CCV_NNC_CONVOLUTION_TRANSPOSE_FORWARD¶

enumerator CCV_NNC_CONVOLUTION_TRANSPOSE_BACKWARD¶

enumerator CCV_NNC_DATATYPE_CONVERSION_FORWARD¶

enumerator CCV_NNC_DATATYPE_CONVERSION_BACKWARD¶

enumerator CCV_NNC_DATA_TRANSFER_FORWARD¶

enumerator CCV_NNC_DATA_TRANSFER_BACKWARD¶

enumerator CCV_NNC_DROPOUT_FORWARD¶

enumerator CCV_NNC_DROPOUT_BACKWARD¶

enumerator CCV_NNC_EWABS_FORWARD¶

enumerator CCV_NNC_EWABS_BACKWARD¶

enumerator CCV_NNC_EWDIV_FORWARD¶

enumerator CCV_NNC_EWDIV_BACKWARD¶

enumerator CCV_NNC_EWEXP_FORWARD¶

enumerator CCV_NNC_EWEXP_BACKWARD¶

enumerator CCV_NNC_EWLOG_FORWARD¶

enumerator CCV_NNC_EWLOG_BACKWARD¶

enumerator CCV_NNC_EWPROD_FORWARD¶

enumerator CCV_NNC_EWPROD_BACKWARD¶

enumerator CCV_NNC_EWSQRT_FORWARD¶

enumerator CCV_NNC_EWSQRT_BACKWARD¶

enumerator CCV_NNC_EWSUM_FORWARD¶

enumerator CCV_NNC_EWSUM_BACKWARD¶

enumerator CCV_NNC_FORMAT_TRANSFORM_FORWARD¶

enumerator CCV_NNC_FORMAT_TRANSFORM_BACKWARD¶

enumerator CCV_NNC_GELU_FORWARD¶

enumerator CCV_NNC_GELU_BACKWARD¶

enumerator CCV_NNC_GEMM_FORWARD¶

enumerator CCV_NNC_GEMM_BACKWARD¶

enumerator CCV_NNC_GROUP_NORM_FORWARD¶

enumerator CCV_NNC_GROUP_NORM_BACKWARD¶

enumerator CCV_NNC_HISTOGRAM_FORWARD¶

enumerator CCV_NNC_HISTOGRAM_BACKWARD¶

enumerator CCV_NNC_INDEX_SELECT_FORWARD¶

enumerator CCV_NNC_INDEX_SELECT_BACKWARD¶

enumerator CCV_NNC_LAMB_FORWARD¶

enumerator CCV_NNC_LAMB_BACKWARD¶

enumerator CCV_NNC_LAYER_NORM_FORWARD¶

enumerator CCV_NNC_LAYER_NORM_BACKWARD¶

enumerator CCV_NNC_LEAKY_RELU_FORWARD¶

enumerator CCV_NNC_LEAKY_RELU_BACKWARD¶

enumerator CCV_NNC_LSTM_FORWARD¶

enumerator CCV_NNC_LSTM_BACKWARD¶

enumerator CCV_NNC_MASKED_FILL_FORWARD¶

enumerator CCV_NNC_MASKED_FILL_BACKWARD¶

enumerator CCV_NNC_MAX_FORWARD¶

enumerator CCV_NNC_MAX_BACKWARD¶

enumerator CCV_NNC_MAX_POOL_FORWARD¶

enumerator CCV_NNC_MAX_POOL_BACKWARD¶

enumerator CCV_NNC_MIN_FORWARD¶

enumerator CCV_NNC_MIN_BACKWARD¶

enumerator CCV_NNC_MSE_FORWARD¶

enumerator CCV_NNC_MSE_BACKWARD¶

enumerator CCV_NNC_MUL_FORWARD¶

enumerator CCV_NNC_MUL_BACKWARD¶

enumerator CCV_NNC_NMS_FORWARD¶

enumerator CCV_NNC_NMS_BACKWARD¶

enumerator CCV_NNC_PAD_FORWARD¶

enumerator CCV_NNC_PAD_BACKWARD¶

enumerator CCV_NNC_RANDOM_NORMAL_FORWARD¶

enumerator CCV_NNC_RANDOM_NORMAL_BACKWARD¶

enumerator CCV_NNC_RANDOM_UNIFORM_FORWARD¶

enumerator CCV_NNC_RANDOM_UNIFORM_BACKWARD¶

enumerator CCV_NNC_REDUCE_ISNAN_FORWARD¶

enumerator CCV_NNC_REDUCE_ISNAN_BACKWARD¶

enumerator CCV_NNC_REDUCE_MAX_FORWARD¶

enumerator CCV_NNC_REDUCE_MAX_BACKWARD¶

enumerator CCV_NNC_REDUCE_MEAN_FORWARD¶

enumerator CCV_NNC_REDUCE_MEAN_BACKWARD¶

enumerator CCV_NNC_REDUCE_MIN_FORWARD¶

enumerator CCV_NNC_REDUCE_MIN_BACKWARD¶

enumerator CCV_NNC_REDUCE_NORM2_FORWARD¶

enumerator CCV_NNC_REDUCE_NORM2_BACKWARD¶

enumerator CCV_NNC_REDUCE_SUM_FORWARD¶

enumerator CCV_NNC_REDUCE_SUM_BACKWARD¶

enumerator CCV_NNC_RELU_FORWARD¶

enumerator CCV_NNC_RELU_BACKWARD¶

enumerator CCV_NNC_RMSNORM_FORWARD¶

enumerator CCV_NNC_RMSNORM_BACKWARD¶

enumerator CCV_NNC_RMSPROP_FORWARD¶

enumerator CCV_NNC_RMSPROP_BACKWARD¶

enumerator CCV_NNC_ROI_ALIGN_FORWARD¶

enumerator CCV_NNC_ROI_ALIGN_BACKWARD¶

enumerator CCV_NNC_SCALAR_MUL_FORWARD¶

enumerator CCV_NNC_SCALAR_MUL_BACKWARD¶

enumerator CCV_NNC_SCALED_DOT_PRODUCT_ATTENTION_FORWARD¶

enumerator CCV_NNC_SCALED_DOT_PRODUCT_ATTENTION_BACKWARD¶

enumerator CCV_NNC_SET_FORWARD¶

enumerator CCV_NNC_SET_BACKWARD¶

enumerator CCV_NNC_SGD_FORWARD¶

enumerator CCV_NNC_SGD_BACKWARD¶

enumerator CCV_NNC_SIGMOID_FORWARD¶

enumerator CCV_NNC_SIGMOID_BACKWARD¶

enumerator CCV_NNC_SIGMOID_BINARY_CROSSENTROPY_FORWARD¶

enumerator CCV_NNC_SIGMOID_BINARY_CROSSENTROPY_BACKWARD¶

enumerator CCV_NNC_SMOOTH_L1_FORWARD¶

enumerator CCV_NNC_SMOOTH_L1_BACKWARD¶

enumerator CCV_NNC_SOFTMAX_FORWARD¶

enumerator CCV_NNC_SOFTMAX_BACKWARD¶

enumerator CCV_NNC_SOFTMAX_CROSSENTROPY_FORWARD¶

enumerator CCV_NNC_SOFTMAX_CROSSENTROPY_BACKWARD¶

enumerator CCV_NNC_SWISH_FORWARD¶

enumerator CCV_NNC_SWISH_BACKWARD¶

enumerator CCV_NNC_TANH_FORWARD¶

enumerator CCV_NNC_TANH_BACKWARD¶

enumerator CCV_NNC_TRANSPOSE_FORWARD¶

enumerator CCV_NNC_TRANSPOSE_BACKWARD¶

enumerator CCV_NNC_UPSAMPLE_FORWARD¶

enumerator CCV_NNC_UPSAMPLE_BACKWARD¶

enumerator CCV_NNC_COUNT¶