The AAXLP Project
In order to support factory layout planning and its education, we are exploring the integration of XR and AI technologies for an intuitive way of creating factory planning scenarios. An AI-based method such as a large language model (LLM) can be utilized to perform actions based on the user’s voice prompt.
Technology
Ainak Oy is developing a solution in collaboration with Metropolia University to tackle this challenge. At the current stage, the prototype shows the connection of a Unity app functions to an LLM. This eliminates the need for the older approaches of using buttons or dragging and dropping models to plan a layout.
- User's voice prompt is first converted to text .
- Then sent to an LLM which is configured to send back commands understandable by the XR application
- The commands include the necessary parameters like the object name and position information.
In the prototype implementation of this idea, the user can spawn, move, and delete factory planning objects like robotic arms, forklifts, and assembly desks in an environment powered by Unity. The user can also perform actions using buttons and the AI tool will still understand the objects created or moved with the normal UI.
At the current state, the implementation is in the process of preparing the core basis of the solution. After further development, the system can be configured to be used in any suitable Unity-based environment and XR applications. The project will also further study the possible role of AI in assisting the user to effectively generate relevant safety-driven and efficient factory layouts. The goal is to enhance the accessibility of industrial layout planning for students and professional industrial roles in factory planning and operations.
