Abstract: An electronic device mounted on a fixed or a movable apparatus is provided. The electronic device may comprise a neural processing unit (NPU), including a plurality of processing elements (PEs), configured to process an operation of an artificial neural network model trained to detect or track at least one object and output an inference result based on at least one image acquired from at least one camera; and a signal generator generating a signal applicable to the at least one camera.

Abstract: A method may comprise receiving a first neural network (NN) model including one or more functions; generating a second NN model in a form of directed acyclic graph (DAG) including one or more graph modules by converting the one or more functions; calculating one or more scale values by obtaining maximum and minimum values of parameters input to the one or more graph modules; updating the parameters based on the one or more scale values; and generating a third NN model, in a form of machine code executable on a particular neural processing unit, including the updated parameters.

Abstract: A method may comprise: converting one or more functions or function call instructions of a first neural network (NN) model into one or more graph modules; analyzing a relationship between one or more inputs and one or more outputs of the one or more graph modules; generating a second NN model including the one or more graph modules as one or more nodes of a directed acyclic graph (DAG) by coupling the one or more inputs and outputs of the graph modules based on the relationship; adding one or more markers corresponding to a weight parameter of one or more layers of the second NN model; and updating the one or more markers according to a pruning algorithm that removes at least a portion of the weight parameter.

Abstract: An electronic device mounted on a fixed or a movable apparatusapparatus is provided. The electronic device may comprise an image signal processor (ISP) for at least one camera; a neural processing unit (NPU), including a plurality of processing elements (PEs), configured to: process an operation of an artificial neural network model trained to detect or track at least one object, based on an input feature map generated from at least one image, which is acquired via the ISP from the at least one camera, and output an inference result; and a signal generator generating a signal applicable to the at least one camera or the ISP.

Abstract: A method may comprise receiving a first neural network (NN) model including one or more functions; generating a second NN model in a form of directed acyclic graph (DAG) including one or more graph modules by converting the one or more functions; calculating one or more scale values by obtaining maximum and minimum values of parameters input to the one or more graph modules; updating the parameters based on the one or more scale values; and generating a third NN model, in a form of machine code executable on a particular neural processing unit, including the updated parameters.

Abstract: An electronic device mounted on a fixed or a movable apparatus is provided. The electronic device may comprise an image signal processor (ISP) for at least one camera; a neural processing unit (NPU), including a plurality of processing elements (PEs), configured to: process an operation of an artificial neural network model trained to detect or track at least one object, based on an input feature map generated from at least one image, which is acquired via the ISP from the at least one camera, and output an inference result; and a signal generator generating a signal applicable to the at least one camera or the ISP.

Abstract: A method may comprise: adding a plurality of markers to a plurality of graph modules in a first neural network (NN) model in a form of a directed acyclic graph (DAG); generating calibration data by collecting input values and output values of each of the plurality of graph modules using the plurality of markers; determining, based on the calibration data, a scale value and an offset value applicable to the first NN model; generating, based on the scale value and the offset value, a second NN model including a weight parameter in integer format through quantization; obtaining first output values of the first NN model with respect to a first retraining data; and updating, based on the first output values of the first NN model, at least one weight parameter included in the second NN model by performing a quantization-aware retraining technique on the second NN model.

Abstract: Embodiments relate to converting functions or function call instructions of a first neural network (NN) model to graph modules. Relationships between inputs and outputs of the of graphing modules are analyzed and a second NN model in the form of a directed acyclic graph (DAG) using the graph modules corresponding to the first NN model. Markers are added to the graph modules in the second NN model. Calibration data is generated by collecting input values and output values of each of the graph modules by using the markers. A scale value and an offset value applicable to the second NN model is determined. Based on the scale value and the offset value, a third NN model including weight parameters quantized in the form of integers are generated and training is performed to update the weight parameters of the third NN model.

Abstract: A method may comprise: adding a plurality of markers to a plurality of graph modules in a first neural network (NN) model in a form of a directed acyclic graph (DAG); generating calibration data by collecting input values and output values of each of the plurality of graph modules using the plurality of markers; determining, based on the calibration data, a scale value and an offset value applicable to the first NN model; generating, based on the scale value and the offset value, a second NN model including a weight parameter in integer format through quantization; and updating at least one parameter included in the second NN model by performing a quantization-aware retraining technique on the second NN model.

Abstract: Embodiments relate to converting functions or function call instructions of a first neural network (NN) model into graph module. The relationship between one or more inputs and one or more outputs of the graph modules are analyzed. A second neural network (NN) model in a form of a directed acyclic graph (DAG) including using the graph modules is generated by mapping inputs and outputs of the graph modules based on the relationship. Markers are added to the graph modules in the second NN model. First calibration data is generated by collecting input values and output values of each of the graph modules using the markers. An adjustment value for outlier alleviation for each of the graph modules is generated based on the first calibration data. For each graph module of the second NN model, an input parameter and a weight parameter are updated based on the adjustment value.

Abstract: A method comprises: converting a plurality of functions or function call instructions of a first neural network (NN) model into a plurality of graph modules; analyzing a relationship between one or more inputs and one or more outputs of the plurality of graph modules; generating a second neural network (NN) model in a form of a directed acyclic graph (DAG) using the plurality of graph modules corresponding to the first NN model, by mapping the one or more inputs and the one or more outputs of the plurality of graph modules to each other based on the relationship; adding a plurality of markers to the plurality of graph modules in the second NN model; and generating calibration data by collecting input values and output values of each of the plurality of graph modules using the plurality of markers.

Abstract: A method may comprise receiving a first neural network (NN) model including one or more functions; generating a second NN model in a form of directed acyclic graph (DAG) including one or more graph modules by converting the one or more functions; calculating one or more scale values by obtaining maximum and minimum values of parameters input to the one or more graph modules; updating the parameters based on the one or more scale values; and generating a third NN model, in a form of machine code executable on a particular neural processing unit, including the updated parameters.

Abstract: A method comprises: converting a plurality of functions or function call instructions of a first neural network (NN) model into a plurality of graph modules; analyzing a relationship between one or more inputs and one or more outputs of the plurality of graph modules; generating a second NN model in a form of a directed acyclic graph (DAG) using the plurality of graph modules corresponding to the first NN model, by mapping the one or more inputs and the one or more outputs of the plurality of graph modules to each other based on the relationship; adding a plurality of markers to the plurality of graph modules in the second NN model; generating calibration data by collecting input values and output values of each of the plurality of graph modules using the plurality of markers; and determining a scale value and an offset value applicable to the second NN model.

Abstract: According to an example of the present disclosure, a neural processing unit (NPU) capable of encoding is provided. The NPU comprises one or more processing elements (PEs) which perform operations for a plurality of layers of an artificial neural network and generate a plurality of output feature maps. The NPU also comprises an encoder which encodes at least one particular output feature map among a plurality of output feature maps into a bitstream and then transmits thereof.

Abstract: According to an example of the present disclosure, a neural processing unit (NPU) capable of encoding is provided. The NPU comprises one or more processing elements (PEs) which perform operations for a plurality of layers of an artificial neural network and generate a plurality of output feature maps. The NPU also comprises an encoder which encodes at least one particular output feature map among a plurality of output feature maps into a bitstream and then transmits thereof.

Abstract: A neural processing unit (NPU) mounted on a movable device for detecting object is provided. The NPU may comprise a plurality of processing elements (PEs), configured to process an operation of a first artificial neural network model (ANN) and an operation of a second ANN different from the first ANN; a memory configured to store a portion of a data of the first ANN and the second ANN; and a controller configured to control the PEs and the memory to selectively perform a convolution operation of the first ANN or the second ANN based on a determination data, wherein the determination data may include an object detection performance data of the first ANN and the second ANN, respectively.

Abstract: A method for stabilizing an image based on artificial intelligence includes acquiring tremor detection data with respect to the image, the tremor detection data acquired from two or more sensors; outputting stabilization data for compensating for an image shaking, the stabilization data outputted using an artificial neural network (ANN) model trained to output the stabilization data based on the tremor detection data; and compensating for the image shaking using the stabilization data. A camera module includes a lens; an image sensor to output an image captured through the lens; two or more sensors to output tremor detection data with respect to the image; a controller to output stabilization data based on the tremor detection data using an ANN model; and a stabilization unit to compensate for an image shaking using the stabilization data. The ANN model is trained to output the stabilization data based on the tremor detection data.

Abstract: A neural processing unit (NPU) mounted on a movable device for detecting object is provided. The NPU may comprise a plurality of processing elements (PEs), configured to process an operation of a first artificial neural network model (ANN) and an operation of a second ANN different from the first ANN; a memory configured to store a portion of a data of the first ANN and the second ANN; and a controller configured to control the PEs and the memory to selectively perform a convolution operation of the first ANN or the second ANN based on a determination data, wherein the determination data may include an object detection performance data of the first ANN and the second ANN, respectively.

Abstract: A method for stabilizing an image based on artificial intelligence includes acquiring tremor detection data with respect to the image, the tremor detection data acquired from two or more sensors; outputting stabilization data for compensating for an image shaking, the stabilization data outputted using an artificial neural network (ANN) model trained to output the stabilization data based on the tremor detection data; and compensating for the image shaking using the stabilization data. A camera module includes a lens; an image sensor to output an image captured through the lens; two or more sensors to output tremor detection data with respect to the image; a controller to output stabilization data based on the tremor detection data using an ANN model; and a stabilization unit to compensate for an image shaking using the stabilization data. The ANN model is trained to output the stabilization data based on the tremor detection data.

Abstract: An electronic device mounted on a fixed or a movable apparatus is provided. The electronic device may comprise a neural processing unit (NPU), including a plurality of processing elements (PEs), configured to process an operation of an artificial neural network model trained to detect or track at least one object and output an inference result based on at least one image acquired from at least one camera; and a signal generator generating a signal applicable to the at least one camera.