luci::RequantizePass Class Reference

Pass to re-quantize graph (ex: int8 -> uint8) More...

#include <RequantizePass.h>

Collaboration diagram for luci::RequantizePass:

Public Member Functions
	RequantizePass (loco::DataType input_dtype, loco::DataType output_dtype)
virtual const char *	name (void) const
bool	run (loco::Graph *graph)
	Run the pass.
Public Member Functions inherited from logo::Pass
virtual	~Pass ()=default

Detailed Description

Pass to re-quantize graph (ex: int8 -> uint8)

Definition at line 32 of file RequantizePass.h.

Constructor & Destructor Documentation

RequantizePass()

luci::RequantizePass::RequantizePass ( loco::DataType  input_dtype, loco::DataType  output_dtype  )

inline

Definition at line 35 of file RequantizePass.h.

    : _input_dtype{input_dtype}, _output_dtype{output_dtype}
  {
    // DO NOTHING
  }

Member Function Documentation

name()

virtual const char * luci::RequantizePass::name ( void  ) const

inlinevirtual

Reimplemented from logo::Pass.

Definition at line 40 of file RequantizePass.h.

{ return "luci::RequantizePass"; }

run()

bool luci::RequantizePass::run ( loco::Graph *  graph )

virtual

Run the pass.

Returns

false if there was nothing changed

Implements logo::Pass.

Definition at line 126 of file RequantizePass.cpp.

{
  LOGGER(l);
  INFO(l) << "RequantizePass Start" << std::endl;
 
  // Input: int8 model
  // Output: uint8 model
  if (_input_dtype == loco::DataType::S8 and _output_dtype == loco::DataType::U8)
  {
    for (auto node : loco::active_nodes(loco::output_nodes(g)))
    {
      RequantizeS8ToU8 rq;
      auto circle_node = loco::must_cast<luci::CircleNode *>(node);
      circle_node->accept(&rq);
    }
  }
  else
  {
    // Ignore other cases
    return false;
  }
 
  // Fix wrong quantized_dimension
  for (auto node : loco::active_nodes(loco::output_nodes(g)))
  {
    auto circle_node = loco::must_cast<luci::CircleNode *>(node);
 
    auto qparam = circle_node->quantparam();
    if (not qparam)
      continue;
 
    if (circle_node->rank() != 1)
      continue;
 
    if (qparam->quantized_dimension == 0)
      continue;
 
    // For rank 1 node, quantized_dimension should be 0
    qparam->quantized_dimension = 0;
    WARN(l) << "Wrong quantized_dimension is fixed (" << circle_node->name() << ")" << std::endl;
  }
 
  // Update output dtype
  auto graph_outputs = g->outputs();
  for (auto node : loco::output_nodes(g))
  {
    auto circle_node = loco::must_cast<luci::CircleOutput *>(node);
    auto from_node = loco::must_cast<luci::CircleNode *>(circle_node->from());
    if (from_node->dtype() == _output_dtype)
    {
      circle_node->dtype(_output_dtype);
      auto graph_output = graph_outputs->at(circle_node->index());
      graph_output->dtype(_output_dtype);
    }
  }
 
  INFO(l) << "RequantizePass End" << std::endl;
  return false; // one time run
}

References loco::active_nodes(), INFO, LOGGER, loco::output_nodes(), and WARN.

Referenced by package.infer.session::inference().

---

The documentation for this class was generated from the following files:

• compiler/luci/pass/include/luci/Pass/RequantizePass.h
• compiler/luci/pass/src/RequantizePass.cpp