Incremental Learning

Incremental Learning is a key feature when dealing with tiny and embedded devices. Many have claimed that only inference can be performed on embedded devices. At Ekkono, we have built a library that can train and run machine learning algorithms not only on big machines efficiently but also on tiny microcontrollers. All of this directly on the device, with no need for an internet connection, through incremental learning. 

Incremental learning consists of training a machine learning model from streaming data to continuously learn over time as more data and insights are being gathered. The model is being built and updated as the data arrives, and predictions are made at any point in time. Traditional machine learning algorithms in an IoT setting would collect data from many different devices to build a generic algorithm that is representative of all devices. However, this requires extra processing on the device to send the data to the cloud or a specific machine. When there is a change in the environment, which can occur frequently, or when some sort of maintenance needs to be performed, data needs to be gathered again, incurring in energy and power consumption costs. 

Incremental learning builds a personalized model for each device, without the need to send any data to the cloud. Since the algorithm runs directly on the device, the model is adaptive to the changing environment in real-time. 

While the algorithm might be less general, since it is learning from only that device, it is also more accurate since not all devices operate under the same conditions. 

Related content

More Research from Ekkono

Federated Learning

Federated Learning

Federated Learning is a machine learning technique to train a global model from different clients or devices while keeping the data decentralized.  A central server is in charge of coordinating the transfer of the models’ data between the server and the clients,...

Change Detection

Change Detection

On edge machine learning we are constantly dealing with non-stationary environments. These non-stationary environments can range from changes in temperature or humidity in sensors to changes in the way a machine, such as a gas turbine, is operating. Time dependent...

Conformal Prediction

Conformal Prediction

Many machine learning systems involve making predictions, through estimating the value of a dependent variable with an a priori unknown ground truth. Verification of such predictive systems, in particular when applied in high-risk applications, is crucial. Traditional...