Collaboration diagram for package.infer.session:

Public Member Functions
	__init__ (self, nnpackage_path, backends="cpu")

	set_inputs (self, size, inputs_array=[])

	set_outputs (self, size)

	inference (self)

Data Fields
	inputs

	outputs

Detailed Description

Class inherited nnfw_session for easily processing input/output

Definition at line 16 of file infer.py.

Constructor & Destructor Documentation

◆ init()

package.infer.session.__init__	(	self,
		nnpackage_path,
		backends = `"cpu"`
	)

Definition at line 18 of file infer.py.

    def __init__(self, nnpackage_path, backends="cpu"):
        super().__init__(nnpackage_path, backends)
        self.inputs = []
        self.outputs = []
        self.set_outputs(self.output_size())
 

References package.infer.session.__init__().

Referenced by package.infer.session.__init__().

Member Function Documentation

◆ inference()

package.infer.session.inference ( self )

Inference model and get outputs

Definition at line 50 of file infer.py.

    def inference(self):
        """Inference model and get outputs"""
        self.run()
 
        return self.outputs

◆ set_inputs()

package.infer.session.set_inputs	(	self,
		size,
		inputs_array = `[]`
	)

Set inputs for each index

Definition at line 24 of file infer.py.

    def set_inputs(self, size, inputs_array=[]):
        """Set inputs for each index"""
        for i in range(size):
            input_tensorinfo = self.input_tensorinfo(i)
 
            if len(inputs_array) > i:
                input_array = np.array(inputs_array[i], dtype=input_tensorinfo.dtype)
            else:
                print(
                    f"model's input size is {size} but given inputs_array size is {len(inputs_array)}.\n{i}-th index input is replaced by an array filled with 0."
                )
                input_array = np.zeros((num_elems(input_tensorinfo)),
                                       dtype=input_tensorinfo.dtype)
 
            self.set_input(i, input_array)
            self.inputs.append(input_array)
 

References NNFW_SESSION.input_tensorinfo(), nnfw_session.input_tensorinfo(), Operation.inputs, Request.inputs, circlechef::CircleImport.inputs(), crew::Part.inputs, luci::CircleReader.inputs(), luci::PGroup.inputs, luci::pass::Expression.inputs, mio::circle::Reader.inputs(), moco::ModelSignature.inputs(), nnc::sir::CallFunction.inputs, validate_onnx2circle.OnnxRunner.inputs, tflinspect::Reader.inputs(), tflchef::TFliteImport.inputs(), tflread::Reader.inputs(), luci_interpreter::CircleReader.inputs(), onert_micro::core::reader::OMCircleReader.inputs(), moco::tf::test::TFNodeBuildTester.inputs(), moco::test::TFNodeBuildTester.inputs(), moco::test::TFNodeBuildTester.inputs(), luci::CircleFakeQuant.inputs(), moco::TFFakeQuantWithMinMaxVars.inputs(), luci::CircleAddN.inputs(), luci::CircleCustom.inputs(), luci::CircleAddN.inputs(), luci::CircleCustom.inputs(), loco::Graph.inputs(), nnkit::support::onnx::Runner.inputs(), ann::Operation.inputs(), loco::Graph.inputs(), luci::CircleFakeQuant.inputs(), moco::TFFakeQuantWithMinMaxVars.inputs(), onert_micro::execute::OMRuntimeKernel.inputs, nnfw_custom_kernel_params.inputs, package.infer.session.inputs, onert::exec::IODescription.inputs, package.infer.num_elems(), nnfw_session.set_input(), NNFW_SESSION.set_input(), and locomotiv::Session.set_input().

◆ set_outputs()

package.infer.session.set_outputs	(	self,
		size
	)

Set outputs for each index

Definition at line 41 of file infer.py.

    def set_outputs(self, size):
        """Set outputs for each index"""
        for i in range(size):
            output_tensorinfo = self.output_tensorinfo(i)
            output_array = np.zeros((num_elems(output_tensorinfo)),
                                    dtype=output_tensorinfo.dtype)
            self.set_output(i, output_array)
            self.outputs.append(output_array)
 

References package.infer.num_elems(), NNFW_SESSION.output_tensorinfo(), nnfw_session.output_tensorinfo(), Operation.outputs, Request.outputs, circlechef::CircleImport.outputs(), crew::Part.outputs, luci::CircleReader.outputs(), luci::PGroup.outputs, mio::circle::Reader.outputs(), moco::ModelSignature.outputs(), nnc::sir::CallFunction.outputs, validate_onnx2circle.OnnxRunner.outputs, tflinspect::Reader.outputs(), tflchef::TFliteImport.outputs(), tflread::Reader.outputs(), luci_interpreter::CircleReader.outputs(), onert_micro::core::reader::OMCircleReader.outputs(), mio::circle::Reader.outputs(), loco::Graph.outputs(), nnkit::support::onnx::Runner.outputs(), ann::Operation.outputs(), loco::Graph.outputs(), onert_micro::execute::OMRuntimeKernel.outputs, nnfw_custom_kernel_params.outputs, package.infer.session.outputs, onert::exec::IODescription.outputs, nnfw_session.set_output(), and NNFW_SESSION.set_output().

Field Documentation

◆ inputs

package.infer.session.inputs

Definition at line 20 of file infer.py.

Referenced by validate_onnx2circle.OnnxRunner.feed_random_inputs(), and package.infer.session.set_inputs().

◆ outputs

package.infer.session.outputs

Definition at line 21 of file infer.py.

Referenced by validate_onnx2circle.OnnxRunner.get_outputs(), package.infer.session.inference(), and package.infer.session.set_outputs().

The documentation for this class was generated from the following file:

runtime/onert/api/python/package/infer.py

Public Member Functions

Data Fields