Three lessons from our AI projects
Over two years, we supported dozens of AI projects, from initial exploration to a model that runs every night. Some went exactly as planned; others…
For years, the prospect of lower MRO costs and greater profitability through intelligent maintenance techniques has been music to many organisations’ ears. The idea behind predictive maintenance is fairly simple: use sensor data and AI to maintain machines at the right time, reducing MRO costs and unplanned downtime. Until recently, the algorithms needed for predictive maintenance had not been developed, were not sufficiently advanced or were too costly to use.
In recent years, however, computing power has increased considerably, advances in AI have come in rapid succession, and sensors have become more accurate and less expensive. This lowers the initially high investment barrier and makes predictive maintenance more accessible and attractive to a growing number of organisations.
The energy, transport, manufacturing and information technology sectors are leading the way in predictive maintenance. This is hardly surprising, especially in aviation. According to an annual report by IATA’s Maintenance Cost Technical Group, airlines worldwide spent a combined 69 billion dollars on MRO in 2018[2], accounting for approximately 9% of their operating costs. Understandably, airlines are trying to reduce MRO costs with state-of-the-art predictive maintenance algorithms. The Dutch aviation sector is actively working on this: KLM’s most recent annual report[3] states that predictive maintenance delivered the largest reduction in its MRO costs.
In manufacturing, MRO costs are even higher[4] and, depending on the industry, can account for between 15-60% of operating costs. It is therefore crucial for these organisations to optimise MRO.
There are different approaches to inspecting and maintaining equipment. These are generally categorised as reactive, preventive and predictive. The main difference lies in how they use the equipment’s service life, a typical pattern of which is shown in the figure below.
Predictive maintenance is an approach that aims to detect machine failure mechanisms at the right time and prevent further degradation through inspections and maintenance.
Intelligent algorithms detect failure mechanisms by predicting the current condition or remaining useful life of machines based on sensor data. The sensors measure vibrations, temperature, sound, lubricant composition, machine performance and many other operating characteristics. These algorithms use complex mathematical formulas whose parameters continuously adapt to new sensor data and the accuracy of their predictions. As a result, their predictions about the actual condition of machines can be highly accurate, provided enough high-quality data is available.
There are two ways to predict maintenance needs. The first is to calculate the probability that components or machines will fail within a given period. The second is to predict when components will fail. The first provides information about the current condition of components and machines, and therefore indirectly about their remaining useful life. The second estimates their remaining useful life directly.
Applying predictive maintenance requires a great deal of high-quality data, and machines need to be fitted with sensors. The initial investment is therefore relatively high. In most cases, however, organisations already have extensive historical data that they use to manage and control their processes. This data can help assess the potential of predictive maintenance for specific applications. While the initial investment may be relatively high, the benefits are greater. A study[5] by the US Department of Energy shows that an effective predictive maintenance programme can reduce maintenance costs by 30%, cut downtime by 45% and reduce failures by as much as 75%.
By now, it is clear that predictive maintenance offers many benefits, particularly in cost savings and risk management. The benefits of using intelligent algorithms to predict maintenance needs can be summarised as follows:
Predictive maintenance therefore leads to greater operational efficiency through lower costs, higher quality, fewer risks and more sustainable practices. There are also drawbacks, however, which can be summarised as:
This section demonstrates the accuracy of predictive maintenance models using a scientific paper[6] published at the International Conference on Circuits and Systems.
The paper applies predictive maintenance algorithms to sensor data to predict the number of flights remaining before aircraft engines fail, known as Remaining-Useful-Lifetime (RUL). It uses NASA’s Turbofan Degradation Simulation dataset. This four-part dataset consists of time series covering three operating settings and 21 sensor measurements from a fleet of aircraft engines over a period of time. The engines are of the same type but vary in how they were manufactured and in the amount of wear they have sustained. These differences are not recorded in the dataset.
At the start of the time series, the aircraft engines function as they should, but over time, wear causes the first faults to develop. These failure mechanisms progress until the engines eventually fail. The time series used to train the algorithms end some time before the engines fail. The algorithms are then trained to predict as accurately as possible how much time remains until failure in each time series.
The article compares several algorithms, but Random Forest performs best. Figure 1 shows the Random Forest algorithm’s predictions for different aircraft engines in the first part of the dataset. Accurate predictions lie close to the diagonal, where the predicted RUL equals the actual RUL.
Figure 1: Random Forest algorithm for predicting remaining useful life.
The Random Forest algorithm’s mean squared error on the first part of the dataset is approximately 25. This means its predictions of how many flights an aircraft engine can make before it fails differ from the actual number by an average of 5 flights. Figure 1 also shows that the algorithm is more accurate when failure is imminent. This is as expected: predicting the near future is easier than predicting the distant future. With predictions this accurate, you can intervene in time and extend the operational life of your machines. The predicted number of remaining flights can also be higher than the actual number. In this unwanted scenario, an aircraft engine fails unexpectedly, bringing significant risks and costs. It is therefore important that human expertise in MRO and artificial intelligence complement rather than replace each other. For equipment whose operation directly affects the wellbeing of people and nature, preventive maintenance and predictive maintenance need to go hand in hand.Does your organisation rely heavily on machines? Are you looking for a more sustainable approach to maintenance? Do you want to reduce MRO costs and increase operational efficiency? We’d be happy to welcome you to our Lab to explore together which techniques your organisation needs and which are right for you.
For more information about the possibilities of predictive maintenance, see the sources below.
Over two years, we supported dozens of AI projects, from initial exploration to a model that runs every night. Some went exactly as planned; others…
Many organisations have now run an AI pilot. The model works, the demo gets applause, and then nothing else happens. In our experience, most projects…
Artificial Intelligence is developing rapidly. New models appear almost every week, and more and more organisations are experimenting with AI. At the…
Want to be the first to hear about a new blog post?
Thanks for signing up!