Just-in-Time inference is a term from the fields of Artificial Intelligence, Industry 4.0, and automation. It describes a method in which artificial intelligence (AI) performs its calculations or predictions precisely at the moment they are needed – thus „just in time“. This saves storage space and energy because no permanent calculations and temporary storage are necessary.
Imagine a scenario in a modern factory where an AI-based system controls the production process. Instead of constantly evaluating all sensor data in its entirety, the system only analyses the most crucial information when, for example, a part appears on the conveyor belt. The AI calculates in a flash whether the part has the correct shape and quality. Only then, precisely at the opportune moment, is just-in-time inference employed.
This method allows for efficient use of resources. This is particularly advantageous on mobile devices or in factory production because there is little processing power and memory available. Just-in-time inference thus supports companies in reacting more quickly and effectively to new situations – without having to retroactively install expensive hardware.
Deutsch 
English (UK)