Machine Studying, Illustrated: Incremental Studying | by Shreya Rao | Sep, 2023

Welcome again to the Illustrated Machine Studying sequence. For those who learn the opposite articles in the series, you already know the drill. We take a (boring sounding) machine studying idea and make it enjoyable by illustrating it! This text will cowl an idea referred to as Incremental Studying, the place machine studying fashions study new data over time, sustaining and constructing upon earlier information. However earlier than stepping into that, let’s first discuss what the mannequin constructing course of appears like as we speak.
We normally observe a course of referred to as static studying when constructing fashions. On this course of, we practice a mannequin utilizing the most recent obtainable information. We tweak and tune the mannequin within the coaching course of. And as soon as we’re proud of its efficiency, we deploy it. This mannequin is in manufacturing for some time. Then we discover that the mannequin efficiency is getting worse over time. That’s once we throw away the present mannequin and construct a brand new one utilizing the most recent obtainable information. And we rinse and repeat this similar course of.
Let’s illustrate this utilizing a concrete instance. Take into account this hypothetical state of affairs. We began constructing a fraud mannequin on the finish of January 2023. This mannequin detects whether or not a bank card transaction is fraudulent or not. We practice our mannequin utilizing all of the bank card transaction information that we had from the previous one-year interval (January 2022 to December 2022) and use transaction information from this month (January 2023) to check the mannequin.
On the finish of subsequent month we discover that the mannequin isn’t doing too effectively in opposition to new information. So we constructed one other mannequin, however this time utilizing information from the previous one-year interval (February 2022 to January 2023) to coach it after which use the present month’s information (February 2023) to check it. And all information exterior of those coaching and testing intervals is thrown out.