1. A graph pointer network-based multi-objective deep reinforcement learning algorithm for solving the traveling salesman problemJeewaka Perera, Shih-Hsi Liu, Marjan Mernik, Matej Črepinšek, Miha Ravber, 2023, original scientific article Abstract: Traveling Salesman Problems (TSPs) have been a long-lasting interesting challenge to researchers in different areas. The difficulty of such problems scales up further when multiple objectives are considered concurrently. Plenty of work in evolutionary algorithms has been introduced to solve multi-objective TSPs with promising results, and the work in deep learning and reinforcement learning has been surging. This paper introduces a multi-objective deep graph pointer network-based reinforcement learning (MODGRL) algorithm for multi-objective TSPs. The MODGRL improves an earlier multi-objective deep reinforcement learning algorithm, called DRL-MOA, by utilizing a graph pointer network to learn the graphical structures of TSPs. Such improvements allow MODGRL to be trained on a small-scale TSP, but can find optimal solutions for large scale TSPs. NSGA-II, MOEA/D and SPEA2 are selected to compare with MODGRL and DRL-MOA. Hypervolume, spread and coverage over Pareto front (CPF) quality indicators were selected to assess the algorithms’ performance. In terms of the hypervolume indicator that represents the convergence and diversity of Pareto-frontiers, MODGRL outperformed all the competitors on the three well-known benchmark problems. Such findings proved that MODGRL, with the improved graph pointer network, indeed performed better, measured by the hypervolume indicator, than DRL-MOA and the three other evolutionary algorithms. MODGRL and DRL-MOA were comparable in the leading group, measured by the spread indicator. Although MODGRL performed better than DRL-MOA, both of them were just average regarding the evenness and diversity measured by the CPF indicator. Such findings remind that different performance indicators measure Pareto-frontiers from different perspectives. Choosing a well-accepted and suitable performance indicator to one’s experimental design is very critical, and may affect the conclusions. Three evolutionary algorithms were also experimented on with extra iterations, to validate whether extra iterations affected the performance. The results show that NSGA-II and SPEA2 were greatly improved measured by the Spread and CPF indicators. Such findings raise fairness concerns on algorithm comparisons using different fixed stopping criteria for different algorithms, which appeared in the DRL-MOA work and many others. Through these lessons, we concluded that MODGRL indeed performed better than DRL-MOA in terms of hypervolumne, and we also urge researchers on fair experimental designs and comparisons, in order to derive scientifically sound conclusions. Keywords: multi-objective optimization, traveling salesman problems, deep reinforcement learning Published in DKUM: 28.03.2024; Views: 184; Downloads: 32
Full text (7,89 MB) This document has many files! More... |
2. Reinforcement learning relocation assignment in the multiple-deep storage systemJakob Marolt, Bojan Rosi, Tone Lerher, 2022, published scientific conference contribution Abstract: The field of reinforcement learning shows promising results in recent publications for solving complex combinatorial problems. In this paper, an agent is trained to tackle the relocation problem that appears in various logistics systems. The relocation problem was formulated as an array that is accessible only from the top side. The agent has to relocate blocking SKUs and thus enable access to the SKU with the highest dispatch priority. We utilised the Deep Q-learning Network (DQN) to train the agent. Two case studies are presented – one with 1.2 ∙ 10 and another with 2 ∙ 10 possible states. The results display that the agents made a significantly better decision toward the learning process’s end than at the beginning Keywords: relocation problem, reinforcement learning, DQN, multiple-deep, storage system Published in DKUM: 14.03.2023; Views: 551; Downloads: 16
Full text (659,02 KB) |
3. Modeling of a geocell-reinforced pavement : an experimental validationSamo Peter Medved, Bojan Žlender, Stanislav Lenart, Primož Jelušič, 2016, original scientific article Abstract: This article details how the serviceability of a flexural pavement structure is improved by incorporating the Cellular Confinement System (geocells). For this purpose, two different pavement structures, with and without embedded geocells, were manufactured in a laboratory and an accelerated traffic type of loading was applied. The vertical and horizontal cyclic loads were applied simultaneously to simulate the effect of principal stress rotation. A comparative study between the conventional flexible pavement and the geocell-reinforced flexible pavement is presented. Additionally, numerical models of the laboratory tests were built and the results were compared. The simulation of the experimental tests using the Traffic Load Simulator (TLS) are carried out using the FEM and advanced models that describe the permanent strain behavior of the unbound granular material. The development of permanent deformation within the pavement structure, with and without the geocells, is also presented through the numerical model, which was verified by the experimental results. Keywords: flexible pavement, reinforcement, geocell, traffic load simulator, permanent deformation, numerical modeling Published in DKUM: 18.06.2018; Views: 1313; Downloads: 104
Full text (1,39 MB) This document has many files! More... |
4. The stability of the excavation face of shallow civil and mining tunnelsPierpaolo Oreste, 2011, original scientific article Abstract: The stability of the excavation face of shallow tunnels excavated in difficult ground conditions is currently a relevant problem in the sector for tunnelling and mining. Even though face-reinforcement interventions with fibreglass dowels have proved to be efficient, there is still no reliable analysis and dimensioning method available. A new calculation procedure is illustrated in this paper for the analysis of the face static condition in shallow tunnels, also when reinforcement interventions with fibreglass dowels are used. The procedure is based on the limit-equilibrium method applied to the ground core ahead of the face. The main result of the calculation is that the safety factor of the excavation face is also obtained in the presence of reinforcements and from this it is then possible to proceed with the dimensioning of the intervention. The procedure has been applied to two real cases and satisfactory results have been obtained. Keywords: fibreglass dowels, face reinforcement, surface tunnel, limit equilibrium method, factor of safety Published in DKUM: 13.06.2018; Views: 1309; Downloads: 201
Full text (213,90 KB) This document has many files! More... |
5. New trends in rock mass characterisation for designing geotechnical structuresDrago Ocepek, 2005, original scientific article Abstract: The investigation on designing supporting measures for geotechnical structures consists of the proper selection of the input data for the stress – strain analysis of the excavation process and the selection of retaining measures. In the preliminary phase of investigation the area must be geologically mapped in detail, and discontinuities precisely measured, boreholes and their “in situ” tests listed and samples for laboratory examinations taken. The new method allows rock mass classification for different rock quality, from soft rocks to mixed rock masses, as well as determination of the geological strength index GSI. The limits for using the suggested method are persistent discontinuities in rock mass which lead to translation or rotation failure mechanisms, either in a single plane or as a wedge. In all cases where discontinuities play a significant role, the rock mass structure must be considered and kinematical analyses performed. In other circumstances, a rock may be uniform and reasonably isotropic due to the geometry of discontinuities and their mutual intersections. The value range of GSI is first determined in the beginning of investigation and later in the excavation phase by considering the disturbance factor D, which expresses disturbances caused by excavation methods and rock mass relaxation. The strength and deformability parameters of rocks of different quality are determined by the generalized Hoek-Brown failure criterion and applied to shallow and deep tunnels or slopes. Before the start of excavations work and after establishing the retaining measures, the analysis results are checked by monitoring. New methods include the determination of post peak strength parameters of rock mass after relaxation, and routine measurements. The newest measurement system however allows direct readings of displacements of the rock mass in both the elastic and post-peak states. With back analyses we determine the softening behavior of the rock mass and a possible need for increasing retaining measures. Such a design method enables the optimization of retaining measures and the reduction of investment costs. Keywords: geological strength index – GSI, simulation of a triaxial large scale »in situ« test, numerical modeling, retaining measures, rock reinforcement, monitoring, back analyses, strain softening, rock mass relaxation Published in DKUM: 16.05.2018; Views: 1325; Downloads: 69
Full text (1,05 MB) This document has many files! More... |
6. Experimental investigation of the stability of particulate dispersoid suspensions in aluminium and magnesium meltsVaružan Kevorkijan, 2000, original scientific article Abstract: The rejection of Si3N4,Mg3N2, AlN and Si particles from different slurries consisting of molten aluminum and magnesium alloy with 10% of silicon or pure molten metals was experimentally investigated by measuring changes in the electrical resistance of the slurries before and after rejection occurred. In stirring experiments, only individual powder fractions which passed through a 45 µm sieve screen and remained on a 30 µm screenwere applied. The experiments showed that the rejection of Si3N4 particles from Al-10%Si and Mg-10%Si melts occurs when more than 17-18 vol.% of the ceramic phase is dispersed into the melt, while in pure Al and Mg molten metals spontaneous rejection occurs at 7-8 vol.% of the introduced ceramic phase. A similar tendency of rejection (at 16-18 vol.% of particulate in slurry) was also observed during the introduction of silicon particles into Al-10%Si and Mg-10%Si melts. Keywords: metal matrix composites, particle reinforcement, interface, chemically activated wetting Published in DKUM: 01.06.2012; Views: 1877; Downloads: 93
Full text (215,84 KB) This document has many files! More... |
7. Analysis of timber-framed walls coated with CFRP strips strengthened fibre-plaster boardsMiroslav Premrov, Peter Dobrila, Branko Bedenik, 2004, original scientific article Abstract: This paper provides an experimental analysis of timber-framed walls, coated with carbon fibre-reinforced polymers (CFRP) strengthened fibre-plaster boards, usually used as main bearing capacity elements in the construction of prefabricated timber structures. The tensile strength of the fibre-plaster boards is lower than the strength of timber frame, therefore it is convenient to strengthen boards with high-strength materials in order to gain a higher capacity. It has been shown that the inclusion of CFRP diagonal strip reinforcement on the load-carrying capacity can be quite high and that it is maximized when the carbon strips are connected to the timber frame. On the other hand, the ductility itself was not significantly improved. The test samples proved an important distinction in behaviour in timber frame-fibreboard connecting area, dependant on the boundary conditions between inserted CFRP strips and timber frame. It has been shown that proposed simplified Eurocode 5 methods, applicable for wood-based sheathing boards, could be unsuitable for the problems presented. Keywords: civil engineering, timber structures, panel walls, fibre-plaster boards, steel reinforcement, carbon fibres Published in DKUM: 01.06.2012; Views: 2542; Downloads: 101
Link to full text |
8. Approximate analytical solutions for diagonal reinforced timber-framed walls with fibre-plaster coating materialMiroslav Premrov, Peter Dobrila, Branko Bedenik, 2004, original scientific article Abstract: This paper provides approximate analytical solutions for diagonally reinforced timber-framed panel walls usually used as main bearing capacity elements in the construction of prefabricated timber structures. These walls can be mathematically treated as composite elements made of a timber frame and fibre-plaster boards as a coating material. As boards are the weakest part of the system they are reinforced with steel diagonals. The proposed approximate analytical models with the fictitious thickness and width of fibre-plaster boards enable simultaneously to consider the influence of inserted steel diagonals, flexibility of mechanical fasteners between the boards and the timber frame and any appearing cracks in the tensile area of the fibre-plaster boards. The obtained numerical results show good agreement with the measured experimental results. Keywords: civil engineering, timber structures, panel walls, fibre-plaster boards, steel reinforcement, steel diagonals, mathematical modelling Published in DKUM: 01.06.2012; Views: 2501; Downloads: 97
Link to full text |
9. Modelling of fastener flexibility in CFRP strengthened timber-framed walls using modified [gamma]-methodMiroslav Premrov, Peter Dobrila, 2008, original scientific article Abstract: The paper provides semi-analytical modelling for prefabricated timber-framed walls using the modified ▫$/gamma$▫-method. The walls are composed of a timber frame and gypsum plasterboards (GPB) which are flexibly connected to the timber frame. Because the tensile strength of the GPB is approximately 10-times lower than the compressive one, it is convenient to strengthen the boards in their tensile diagonal direction with carbon fibre-reinforced polymer (CFRP) strips, which are glued to the boards. Additionally, in the proposed mathematical model the classical beam theory is used taking into account a fasteners' flexibility in the timber frame - GPB connecting area, as well as crack appearing in the GPB and an influence of the inserted CFRP strips. Therefore the CFRP strip contribution is considered with a modified slip modulus which results in the fictive increased stiffness coefficient of the fasteners. Keywords: civil engineering, timber structures, frame walls, fibre-plaster boards, steel reinforcement, CFRP strips, carbon fibre-reinforced polymer, mathematical modelling Published in DKUM: 01.06.2012; Views: 2349; Downloads: 32
Link to full text |
10. Mathematical modelling of timber-framed walls strengthened with CFRP stripsMiroslav Premrov, Peter Dobrila, 2008, original scientific article Abstract: This paper provides mathematical modelling for prefabricated timber-framed walls composed of a timber frame and fibre-plaster boards. Because the tensile strength of the fibre-plaster boards is approximately 10-times lower than the compressive one, it is convenient to strengthen the boards in their tensile diagonal direction with carbon fibre-reinforced polymer (CFRP) strips, which are glued to the boards. Based on analysis of experimental research results [7] special approximate mathematical models have been developed. The models enable simultaneously to consider the influence of inserted CFRP strips, flexibility of mechanical fasteners in the connecting areas and any appearing of tensile cracks in the coating boards. Keywords: civil engineering, timber structures, frame walls, fibre-plaster boards, steel reinforcement, CFRP strips, mathematical modelling Published in DKUM: 01.06.2012; Views: 2311; Downloads: 99
Link to full text |