Closed-loop rescheduling using deep reinforcement learning | ||
| dc.conicet.organizacion | Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - Córdoba. Centro de Investigaciones y Transferencia de Villa María. Universidad Nacional de Villa María. Centro de Investigaciones y Transferencia de Villa María | |
| dc.conicet.organizacion | Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - Santa Fe. Instituto de Desarrollo y Diseño. Universidad Tecnológica Nacional. Facultad Regional Santa Fe. Instituto de Desarrollo y Diseño | |
| dc.contributor.author | Palombarini, Jorge Andrés | |
| dc.contributor.author | Martínez, Ernesto Carlos | |
| dc.date.issued | 2019-07 | |
| dc.description.abstract | Modern socio-technical manufacturing systems are characterized by high levels of variability which gives rise to poor predictability of environmental conditions at the shop-floor. Therefore, a closed-loop rescheduling strategy for handling unforeseen events and unplanned disturbances has become a key element for any real-time disruption management strategy in order to guarantee highly efficient production in uncertain and dynamic conditions. In this work, a real-time rescheduling task is modeled as a closed-loop control problem in which an artificial intelligent agent implements control knowledge generated offline using a schedule simulator to learn schedule repair policies directly from high-dimensional sensory inputs. The rescheduling control knowledge is stored in a deep Q-network, which is used closed-loop to select repair actions to achieve a small set of repaired goal states. The network is trained using the deep Q-learning algorithm with experience replay over a variety of simulated transitions between schedule states based on color-rich Gantt chart images and negligible prior knowledge as inputs. An industrial example is discussed to highlight that the proposed approach enables end-to-end learning of comprehensive rescheduling policies and encoding plant-specific knowledge that can be understood by human experts. | es |
| dc.description.fil | Fil: Palombarini, Jorge Andrés. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - Córdoba. Centro de Investigaciones y Transferencia de Villa María. Universidad Nacional de Villa María. Centro de Investigaciones y Transferencia de Villa María; Argentina | |
| dc.description.fil | Fil: Martínez, Ernesto Carlos. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - Santa Fe. Instituto de Desarrollo y Diseño. Universidad Tecnológica Nacional. Facultad Regional Santa Fe. Instituto de Desarrollo y Diseño; Argentina | |
| dc.format | application/pdf | es |
| dc.identifier.citation | Palombarini, Jorge Andrés; Martínez, Ernesto Carlos; Closed-loop rescheduling using deep reinforcement learning; Elsevier B.V.; IFAC-PapersOnLine; 52; 1; 7-2019; 231-236 | es |
| dc.identifier.eissn | 2405-8963 | es |
| dc.identifier.institucional | CONICET | |
| dc.identifier.repo | CONICET Digital | |
| dc.identifier.uri | http://hdl.handle.net/11336/128207 | |
| dc.journal.ciudad | Amsterdam | es |
| dc.journal.number | 1 | es |
| dc.journal.pagination | 231-236 | es |
| dc.journal.pais | Países Bajos | es |
| dc.journal.title | IFAC-PapersOnLine | es |
| dc.journal.volume | 52 | es |
| dc.language.iso | eng | es |
| dc.publisher | Elsevier B.V. | es |
| dc.relation.alternativeid | info:eu-repo/semantics/altIdentifier/url/https://linkinghub.elsevier.com/retrieve/pii/S2405896319301521 | |
| dc.relation.alternativeid | info:eu-repo/semantics/altIdentifier/doi/http://dx.doi.org/10.1016/j.ifacol.2019.06.067 | |
| dc.rights | info:eu-repo/semantics/restrictedAccess | * |
| dc.rights.uri | https://creativecommons.org/licenses/by-nc-sa/2.5/ar/ | * |
| dc.subject | DEEP REINFORCEMENT LEARNING | es |
| dc.subject | MANUFACTURING SYSTEMS | es |
| dc.subject | REAL-TIME RESCHEDULING | es |
| dc.subject | UNCERTAINTY | es |
| dc.subject.classification | Ingeniería de Sistemas y Comunicaciones | es |
| dc.subject.classification | Ingeniería Eléctrica, Ingeniería Electrónica e Ingeniería de la Información | es |
| dc.subject.classification | INGENIERÍAS Y TECNOLOGÍAS | es |
| dc.title | Closed-loop rescheduling using deep reinforcement learning | es |
| dc.type | info:eu-repo/semantics/article | |
| dc.type | info:ar-repo/semantics/artículo | |
| dc.type | info:eu-repo/semantics/publishedVersion | |
Archivos
Bloque original
Cargando...
- Nombre:
- CONICET_Digital_Nro.d44c6a27-a4fb-4abc-9b25-4964707d69dc_A.pdf
- Tamaño:
- 1.04 MB
- Formato:
- Adobe Portable Document Format