Publication

Multidisciplinary Optimization of Shoe Midsole Structures using Swarm Intelligence

Maksudul Alam and Tsz Ho Kwok
Structural and Multidisciplinary Optimization, accepted.
[PDF][doi:10.1007/s00158-024-03845-4][SharedIt]

Abstract:
Creating functional midsoles for shoes is a challenging task that involves considering different aspects such as stability, comfort, manufacturability, and aesthetics. No single approach exists to design a midsole that meets all these objectives effectively. Therefore, this study aims to introduce a multidisciplinary optimization method to develop custom shoe midsole structures. Our approach involves utilizing generative methods to generate diverse structures and leveraging swarm intelligence to search for optimal designs. Without loss of generality, we use tetrahedral mesh generation to create midsole structures because tetrahedral structures are renowned for their exceptional strength. To enhance the swarm's exploration of the design space and discover more local optima, we developed a swarm behavior that promotes diversity. Furthermore, we created a quantitative measurement tool to evaluate various objectives. In order to test the effectiveness of our generative approach, we analyzed the midsoles generated from our design exploration that performed the best and the worst in relation to each objective. Our findings revealed a substantial difference between them, with scores differing by two to four times. Additionally, when compared to other lattice structures, the tetrahedral midsole structure created by our method demonstrated superior compliance with the foot and better redistribution of plantar stress. The multidisciplinary optimization technique we have proposed is a valuable resource for engineers and designers in the footwear industry, allowing them to develop high-performance midsole structures that meet the needs of both consumers and athletes. Furthermore, this method can be applied to optimize other complex structures in various industries, such as civil, automotive, and aerospace engineering.

Closed-Loop Control of Surface Preparation for Metallizing Fiber-Reinforced Polymer Composites

Shiva Shokri, Pooria Sedigh, Mehdi Hojjati, Tsz Ho Kwok
Transactions of the Canadian Society for Mechanical Engineering, accepted. Open Access.
[doi:10.1139/tcsme-2024-0035]

Abstract:
This study introduces a novel approach to enhance the surface properties of fiber-reinforced polymer composites through thermal spray coatings, utilizing a metal mesh as an anchor to improve coating adhesion. A critical step in this process is achieving optimal exposure of the metal mesh by sandblasting prior to coating. To address this challenge, we propose a closed-loop control system designed to inspect and blast parts effectively. Our method leverages top-view microscope images as inputs, employing a convolutional neural network (CNN) to correlate these images with the corresponding exposure levels of the metal mesh, measured via a destructive method. Upon training, the CNN model accurately estimates the exposure level solely from the top-view images, facilitating real-time feedback to guide subsequent sandblasting operations. Unlike traditional manual inspection methods, which demand expertise and experience, our automated approach streamlines the inspection process using a cost-effective portable digital microscope. Experimental findings validate the efficacy of our method in successfully discerning surface preparation status with an accuracy rate of 95% and demonstrate its practical utility in closed-loop control. Our study not only offers a robust methodology for quantifying surface preparation data but also presents a significant advancement in automating the inspection process. Moreover, the broader implications of our approach extend to various manufacturing sectors, where defect detection and closed-loop control are crucial for optimizing production efficiency and product quality.

A Production Interface to Enable Legacy Factories for Industry 4.0

Tsz Ho Kwok and Tom Gaasenbeek
Engineering Research Express, 5(4):045019, 2023. Open Access.
[doi:10.1088/2631-8695/acfeca]

Abstract:
Due to the recent pandemic, our factory operations have experienced significant setbacks, prompting the need for factory automation to maintain productivity. However, most of our factories rely heavily on human input and oversight and cannot operate remotely. Automating our factories has revealed technological gaps that fall short of our expectations, needs, and vision. Therefore, the purpose of this paper is to bridge this gap by introducing practical methodologies and applied technology that can enhance legacy factories and their equipment. Our proposed solution is the ORiON Production Interface (OPI) unit, which can function as a smart networked edge device for virtually any machine, allowing the factory to operate efficiently. We have incorporated various computer vision algorithms into the OPI unit, enabling it to autonomously detect errors, make decentralized decisions, and control quality. Despite the concept of Industry 4.0 (I4.0) being known, many machines in use today are closed source and unable to communicate or join a network. Our research offers a viable solution to implement Industry 4.0 in existing factories, and experimental results have demonstrated various applications such as process monitoring, part positioning, and broken tool detection. Our intelligent networked system is novel and enables factories to be more innovative and responsive, ultimately leading to enhanced productivity. All manufacturing companies interested in adopting Industry 4.0 technology can benefit from it, and the OPI, being an IoT device, is also an appealing option for developers and hobbyists alike.

Prevalence of Musculoskeletal Disorders and Postural Analysis of Beekeepers

Mohsen Rasoulivalajoozi, Mojtaba Rasouli, Carmela Cucuzzella, Tsz Ho Kwok
International Journal of Industrial Ergonomics, Volume 98, November 2023, 103504.
[PDF][doi:10.1016/j.ergon.2023.103504]

Abstract:
Work-related musculoskeletal disorders (WRMSDs) lead to fatigue and decreased productivity in workers, resulting in the need for many affected individuals to seek medical treatment annually. Beekeepers, like other agricultural workers, are susceptible to WRMSDs due to the continuous demands of their work and the repetitive movements involved. Thus, the objective of this study is to determine the prevalence of WRMSDs and assess the level of risk associated with different postures among beekeepers to improve their musculoskeletal health. To achieve this, a cross-sectional study was conducted involving 33 beekeepers, consisting of two stages. Firstly, the Nordic Questionnaire was utilized to assess the prevalence of WRMSDs. Subsequently, the Ovako Working Posture Analysis System (OWAS) was employed to analyze and categorize the riskiest postures into four levels of corrective measures. The findings indicate that the most commonly affected areas were the back (51.5%) and waist (45.4%). The occurrence of WRMSDs in various body regions was significantly associated with the beekeepers' years of experience and weekly working hours. Additionally, the prevalence of neck and back pain was significantly related to their body mass index (BMI). The OWAS postural analysis revealed that the back (36.75%) and arm (21.08%) regions required corrective measures as soon as possible (level III), while the back (26.47%) and legs (14.70%) fell under the category of corrective measures needed in the near future (level II). Combining the postural analysis results, 28.43% were classified as Action Levels (AL) II, 37.73% as level III, and 0.98\% as level IV. This study demonstrates that WRMSDs are relatively common among beekeepers, primarily due to their extensive work experience and the adoption of awkward postures during their tasks. As a result, recommendations regarding ergonomics and physiotherapy are provided to alleviate pain and reduce the strain on critical postures.

Embedding Ionic Hydrogel in 3D Printed Human-Centric Devices for Mechanical Sensing

Baanu Payandehjoo, Tsz Ho Kwok
Journal of Manufacturing Processes, Volume 100, August 2023, Pages 1-10.
[PDF][doi:10.1016/j.jmapro.2023.05.017]

Abstract:
Flexible sensor applications have increasingly focused on ionically conductive hydrogels due to their notable deformability and easily tunable properties compared to rigid materials. These hydrogels possess electrical properties, thanks to their high water content and porous structure that facilitate effective ion transfer. Despite their attractive features, hydrogels have limitations in terms of water retention and shape fidelity, and they are more typically inspected as two dimensional films and patches. In this paper, 3D printed thermoplastic polyurethane (TPU) elastomer frames with various geometries were injected with ionic conductive polyacrylamide (PAAm) based hydrogels to create durable, robust soft mechanical sensors for detecting strain, pressure, and bending through changes in their electrical resistance. After the effectiveness of the TPU encasement in maintaining the hydrogel water content was demonstrated, hydrogel embedded frames with varying geometries were designed. Their response to mechanical loading was investigated in relation to their dimensions and geometric shape. Finally, glove-shaped frames were fabricated to fit human fingers and injected with ionic hydrogel for sensing abilities. The wearable sensors accommodated free movement of the fingers in multiple directions and were able to detect simultaneous and independent bending and stretching of the fingers. Through comprehensive observation of the electrical behavior of all soft ionic sensors in response to different kinds of mechanical stimuli, it was concluded that the resistance change following mechanical loading was dependent on the specific geometric features of each individual hybrid sensor. Thus, ionic hydrogel-embedded TPU encasement could be designed with targeted geometry to dictate the type and direction of mechanical sensing with regard to its application. This work presents a facile approach to fabricating multi-component soft geometric sensors with potential to be used for wearable electronics and human-machine interactions.

Improving the Diversity of Topology-Optimized Designs by Swarm Intelligence

Tsz Ho Kwok
Structural and Multidisciplinary Optimization, 65, 202 (2022).
[PDF][doi:10.1007/s00158-022-03295-w][GitHub]

Abstract:
Although additive manufacturing can produce nearly any geometry, users have limited choices in the designs. Topology optimization can create complex shapes, but it provides only one solution for one problem, and existing design exploration methods are ineffective when the design space is huge and high-dimensional. Therefore, this paper develops a new generative design method to improve the diversity of topology-optimized designs. Based on the observation that topology optimization places materials along the principal directions to maximize stiffness, this paper creates a rule of principal direction and applies it to swarm intelligence for form-finding. The shapes got by the swarming process possess both randomness and optimality. After they are further optimized, the final designs have high diversity. This is the first time integrating structural stiffness as a swarm principle to influence the collective behavior of decentralized, self-organized systems. The experimental results show that this method can generate interesting designs that have not been seen in the literature. Some results are even better than those got by the original topology optimization method, especially when the problem is more complex. This work not only allows users to choose unique designs according to their preference, but also helps users find better designs for their application.

Interlacing Infills for Multi-Material Fused Filament Fabrication using Layered Depth Material Images

Irfan Mustafa, Tsz-Ho Kwok
Micromachines, 13(5):773, 2022. Open Access.
[doi:10.3390/mi13050773]

Abstract:
One major concern of multi-material additive manufacturing (MMAM) is the strength at the interface between materials. Based on the observation of how nature puts materials together, this paper hypothesizes that overlapping and interlacing materials with each other enhance the interface bonding strength. To test this hypothesis, this research develops a new slicing framework that can efficiently identify the multi-material regions and develop interlaced infills. Based on a ray-tracing technology, we develop layered depth material images (LDMI) to process the material information of digital models for toolpath planning. Each sample point in the LDMI has an associated material and geometric properties that are used to recover the material distribution in each slice. With this material distribution, this work generates an interlocking joint and an interlacing infill in the regions with multiple materials. The experiments include comparisons between similar materials and different materials. Tensile tests have shown that our proposed infill outperforms the interlocking joint in all cases. Fractures occur even outside the interlacing area, meaning that the joint is at least as strong as the materials. The experimental results verify the enhancement of interface strength by overlapping and interlacing materials. In addition, existing computational tools have limitations in full use of material information. To the best of our knowledge, this is the first time a slicer can process overlapped material regions and create interlacing infills. The interlacing infills improve the bonding strength, making the interface no longer the weakest area. This enables MMAM to fabricate truly functional parts. Also, the new LDMI framework has rich information on geometry and material, and it allows future research in multi-material modeling.

Analysis and Design of Lattice Structures for Rapid Investment Casting

Christopher Richard, Tsz-Ho Kwok
Materials, 14(17):4867, 2021. Open Access.
[doi:10.3390/ma14174867][Data - CAD models]

Abstract:
This paper aims at designing lattice structures for rapid investment casting (RIC), and the goal of the design methodology is to minimize casting defects that are related to the lattice topology. RIC can take full advantage of the unprecedented design freedom provided by AM. Since design for RIC has multiple objectives, we limit our study to lattice structures that already have good printability, i.e., self-supported and open-celled, and improve their castability. To find the relationship between topological features and casting performance, various lattice topologies underwent mold flow simulation, finite element analysis, casting experiments, and grain structure analysis. From the results, the features established to affect casting performance in descending order of importance are relative strut size, joint number, joint valence, and strut angle distribution. The features deemed to have the most significant effect on tensile and shear mechanical performance are strut angle distribution, joint number, and joint valence. The practical application of these findings is the ability to optimize the lattice topology with the end goal of manufacturing complex lattice structures using RIC. These lattice structures can be used to create lightweight components with optimized functionality for various applications like aerospace and medical.

Development of Intertwined Infills to Improve Multi-Material Interfacial Bond Strength

Irfan Mustafa, Tsz-Ho Kwok
Journal of Manufacturing Science and Engineering, 144(3): 031009, March 2022.
[PDF][doi:10.1115/1.4051884][Presentation]

Abstract:
Recently the availability of various materials and ongoing research in developing advanced systems for multi-material additive manufacturing (MMAM) have opened doors for innovation in functional products. One major concern of MMAM is the strength at the interface between materials. This paper hypothesizes overlapping and interlacing materials to enhance the bonding strength. To test this hypothesis, we need a computer-aided manufacturing (CAM) tool that can process the overlapped material regions. However, existing computational tools lack key multi-material design processing features and have certain limitations in making full use of the material information, which restricts the testing of our hypothesis. Therefore, this research also develops a new MMAM slicing framework that efficiently identifies the boundaries for materials to develop different advanced features. By modifying a ray tracing technology, we develop layered depth material images (LDMI) to process the material information from computer-aided design (CAD) models for slicing and process planning. Each sample point in the LDMI has associated material and geometric properties that are used to identify the multi-material regions. Based on the material information in each slice, interlocking joint (T-Joint) and interlacing infill are generated in the regions with multiple materials. Tensile tests have been performed to verify the enhancement of mechanical properties by the use of overlapping and interlacing materials.

Escaping Tree-Support (ET-Sup): Minimizing Contact Points for Tree-like Support Structures in Additive Manufacturing

Tsz-Ho Kwok
Rapid Prototyping Journal, Vol. 27 No. 8, pp. 1562-1572.
[PDF][doi:10.1108/RPJ-12-2020-0317][Presentation]

Abstract:
Support structures are often needed in additive manufacturing (AM) to print overhangs. However, they are the extra materials that must be removed afterwards. When the supports have many contacts to the model or are even enclosed inside some concavities, removing them is very challenging and has a risk of damaging the part. Therefore, the purpose of this paper is to develop a new type of tree-support, named escaping tree-support (ET-Sup), which tries to build all the supports onto the build plate in order to minimize the number of contact points. The methodology is to first classify the support points into three categories: clear, obstructed, and enclosed. A clear point has nothing between it and the build plate; an obstructed point is not clear, but there exists a path for it to reach the build plate; and an enclosed point has no way to reach the build plate. With this classification, the path for the obstructed points to come clear can be found through linking them to the clear points. All the operations are performed efficiently with the help of a ray representation. The method is tested on different overhang features, including a lattice ball and a mushroom shape with a concave cap. All the supports generated for the examples can find their way to the build plate, which looks like they are escaping from the model. The computation time is around one second for these cases. This is the first time truly realizing this `escaping' property in the generation of tree-like support structures. With this ET-Sup, it is expected that the AM industries can reduce the manufacturing lead time and save much labor work in post-processing.

Numerical Assessment of Directional Energy Performance for 3D Printed Midsole Structures

Ankhy Sultana, Tsz-Ho Kwok,  Hoi Dick Ng
Mathematical Biosciences and Engineering, 18(4), 4429-4449, 2021. Open Access.
[doi:10.3934/mbe.2021224]

Abstract:
Energy can be represented in the form of deformation obtained by the applied force. Energy transfer is defined in physics as the energy is moved from one place to another. To make the energy transfer functional, energy should be moved into the right direction. If it is possible to make a better use of the energy in the right direction, the energy efficiency of the structure can be enhanced. This idea leads to the concept of directional energy transfer (DET), which refers to transferring energy from one direction to a specific direction. With the recent development of additive manufacturing and topology optimization, complex structures can be applied to various applications to enhance performances, like a wheel and shoe midsole. While many works are related to structural strength, there is limited research in optimization for energy performance. In this study, a theoretical approach is proposed to measure the directional energy performance of a structure, which can be used to measure the net energy in an intended direction. The purpose is to understand the energy behavior of a structure and to measure if a structure is able to increase energy in the desired direction.

Segmentation-based Wireframe Generation for Parametric Modeling of Human Body Shapes

Jida Huang, Tsz-Ho Kwok
ASME Journal of Computing and Information Science in Engineering, 21(6): 061007, Dec 2021.
[PDF][doi:10.1115/1.4050758][JCISE Spotlight]

Abstract:
Wireframes have been proved useful as an intermediate layer of the neural network to learn the relationship between the human body and semantic parameters. However, the definition of the wireframe needs to have anthropological meaning and is highly dependent on experts' experience. Hence, it is usually not easy to obtain a well-defined wireframe for a new set of shapes in available databases. An automated wireframe generation method would help relieve the need for the manual anthropometric definition to overcome such difficulty. One way to find such an automated wireframe generation method is to apply segmentation to divide the models into small mesh patches. Nevertheless, different segmentation approaches could have various segmented patches, thus resulting in various wireframes. How do these different sets of wireframes affect learning performance? In this paper, we attempt to answer this research question by defining several critical quantitative estimators to evaluate different wireframes' learning performance. To find how such estimators influence wireframe-assisted learning accuracy, we conduct experiments by comparing different segmentation methods on human body shapes. We summarized several meaningful design guidelines for developing an automatic wireframe-aware segmentation method for human body learning with such verification.

Function-aware Slicing Using Principal Stress Line for Toolpath Planning in Additive Manufacturing

Eder Sales, Tsz-Ho Kwok, Yong Chen
Journal of Manufacturing Processes, Volume 64, April 2021, Pages 1420-1433.
[PDF][doi:10.1016/j.jmapro.2021.02.050]

Abstract:
Additive manufacturing (AM) has been widely used in many different areas due to its unique advantages, such as the possibility of creating complex shapes, no specific tools required, relatively fast, and less material waste with light-weight designs. The design freedom enabled by AM also allows a component to be highly optimized on its topology and shape according to its function. Currently, there are advanced algorithms that enable designers to perform topology optimization (TO) in the computer-aided design (CAD) phase. However, the optimization results are not considered during the downstream AM process planning like toolpath generation, and the optimized structure may lose its designed performance. Instead of only considering TO in the CAD phase, this work presents a breakthrough in adopting the TO principles in the toolpath planning process and considering the toolpath characteristics presented in the AM processes. Since toolpaths are lines, this paper applies a line-based TO method that uses the principal stress line (PSL) as the guidance to the generation of toolpaths to improve structural rigidity. The PSL-based method is efficient, controllable, and able to consider the characteristics of the AM process. The computation results can be directly converted into toolpaths that can be faithfully fabricated and achieve the component function specified in the design phase. Structural tests were performed on the developed method. The experimented results demonstrate that the strategy of applying the PSL-based toolpath planning is a promising direction to incorporate topology optimization from the CAD phase to computer-aided manufacturing (CAM). To the best of our knowledge, this study is the first to explore the use of PSL in the AM’s toolpath planning.

Simulation of Hyper-Elasticity by Shape Estimation

Christopher-Denny Matte, Tsz-Ho Kwok
ASME Journal of Computing and Information Science in Engineering, 21(5): 050903, Oct 2021.
[PDF][doi:10.1115/1.4050045]

Abstract:
The simulation of complex geometries and non-linear deformation has been a challenge for standard simulation methods. There has traditionally been a trade-off between performance and accuracy. With the popularity of additive manufacturing and the new design space it enables, the challenges are even more prevalent. Additionally, multiple additive manufacturing techniques now allow hyperelastic materials as raw material for fabrication and multi-material capabilities. This allows designers more freedom but also introduces new challenges for control and simulation of the printed parts. In this paper, a novel approach to implementing non-linear material capabilities is devised with negligible additional computations for geometry-based methods. Material curves are fitted with a polynomial expression, which can determine the tangent modulus, or stiffness, of a material based on strain energy. The moduli of all elements are compared to determine relative shape factors used to establish an element's blended shape. This process is done dynamically to update a material's stiffness in real-time, for any number of materials, regardless of linear or non-linear material curves.

Folding Photopolymerized Origami Sheets by Post-Curing

Xiaodong He, Christopher-Denny Matte, Tsz-Ho Kwok
Springer Nature - Applied Sciences, 3, 133, 2021. Open Access.
[doi:10.1007/s42452-020-04018-w]

Abstract:
The paper presents a novel manufacturing approach to fabricate origami based on 3D printing utilizing digital light processing. Specifically, we propose to leave part of the model uncured during the printing step, and then cure it in the post-processing step to set the shape in a folded configuration. While the cured regions in the first step try to regain their unfolded shape, the regions cured in the second step attempt to keep their folded shape. As a result, the final shape is obtained when both regions’ stresses reach equilibrium. Finite element analysis is performed in ANSYS to obtain the stress distribution on common hinge designs, demonstrating that the square-hinge has a lower maximum principal stress than elliptical and triangle hinges. Based on the square-hinge and rectangular cavity, two variables - the hinge width and the cavity height - are selected as principal variables to construct an empirical model with the final folding angle. In the end, experimental verification shows that the developed method is valid and reliable to realize the proposed deformation and 3D development of 2D hinges.

Geometry-Based Thick Origami Simulation

Tsz-Ho Kwok
ASME Transactions - Journal of Mechanical Design, 143(6), 061701 (Nov 17, 2020).
[PDF][doi:10.1115/1.4048744]

Abstract:
Origami is the art of creating a three-dimensional (3D) shape by folding paper. It has drawn much attention from researchers, and the designs that origami has inspired are used in various engineering applications. Most of these designs are based on familiar origami patterns and their known deformations, but origami patterns were originally intended for materials of near-zero thickness, primarily paper. To use the designs in engineering applications, it is necessary to simulate origami in a way that enables designers to explore and understand the designs while taking the thickness of the material to be folded into account. Because origami is primarily a problem in geometric design, this paper develops a geometric simulation for thick origami. The actuation, constraints, and assignment of mountain and valley folds in origami are also incorporated into the geometric formulation. The experimental results show that the proposed method is efficient and accurate. The method can successfully simulate a flat-foldable degree-four vertex, two different action origami, the bistable property of a waterbomb base, and the elasticity of non-rigid origami panels.

Reinforcing Silicone with Hemp Fiber for Additive Manufacturing

Pantea Koushki, Tsz-Ho Kwok, Lucas Hof, Rolf Wuthrich
Composites Science and Technology, Volume 194, 7 July 2020, 108139.
[PDF][doi:10.1016/j.compscitech.2020.108139]

Abstract:
This study explores the 3D printability of a new material based on silicone and hemp fibers from renewable, sustainable and non-petroleum resources with the aim of enhancing mechanical properties of silicone. Incorporation of fibers improved the mechanical properties of the silicone matrix, but it also adversely affected the printability of silicone due to the high viscosity. Therefore, an additional solvent is added into the composition to alter the viscosity. To mature the composite printing technology, this research aims to find out the desired mixing composition of silicone, hemp fiber, and solvent. The behavior of the new engineered material was analyzed using rheological study to obtain a printable material. The composition containing 15wt% hemp fibers and 20wt% solvent with enhanced mechanical properties displayed the desirable printability. Moreover, the mechanical properties of the 3D printed and molded samples were studied. The results revealed that 3D printed samples outperformed the molded counterparts. Finally, a honeycomb structure and a simple gripper were fabricated to demonstrate the application of the developed material.

Geometric Deep Learning for Shape Correspondence in Mass Customization by 3D Printing

Jida Huang, Hongyue Sun, Tsz-Ho Kwok, Chi Zhou, Wenyao Xu
ASME Journal of Manufacturing Science and Engineering, 142(6), 061003 (Apr 13, 2020).
[PDF][doi:10.1115/1.4046746]

Abstract:
Many industries, such as human-centric product manufacturing, are calling for mass customization with personalized products. One key enabler of mass customization is 3D printing, which makes flexible design and manufacturing possible. However, the personalized designs bring challenges for the shape matching and analysis, owing to the high complexity and shape variations. Traditional shape matching methods are limited to spatial alignment and finding a transformation matrix for two shapes, which cannot determine a vertex-to-vertex or feature-to-feature correlation on the two shapes. Hence, such a method cannot measure the deformation of the shape and interested features directly. To measure the deformations widely seen in the mass customization paradigm and address the issues of alignment methods in shape matching, we identify the geometry matching of deformed shapes as a correspondence problem. The problem is challenging due to the huge solution space and nonlinear complexity, which is difficult for conventional optimization methods to solve. According to the observation that the well-established massive databases provide the correspondence results of the treated teeth models, a learning-based method is proposed for the shape correspondence problem. Specifically, a state-of-the-art geometric deep learning method is used to learn the correspondence of a set of collected deformed shapes. Through learning the deformations of the models, the underlying variations of the shapes are extracted and used for finding the vertex-to-vertex mapping among these shapes. We demonstrate the application of the proposed approach in the orthodontics industry, and the experimental results show that the proposed method can predict correspondence fast and accurate, also robust to extreme cases. Furthermore, the proposed method is favorably suitable for deformed shape analysis in mass customization enabled by 3D printing.

Kinematics of Soft Robots by Geometric Computing

Guoxin Fang, Christopher-Denny Matte, Rob B. N. Scharff, Tsz-Ho Kwok, Charlie C. L. Wang
IEEE Transactions on Robotics, Volume: 36 , Issue: 4 , Aug. 2020.
[PDF][doi:10.1109/TRO.2020.2985583][video][GitHub]

Abstract:
Robots fabricated with soft materials can provide higher flexibility and thus better safety while interacting in unpredictable situations. However, the usage of soft material makes it challenging to predict the deformation of a continuum body under actuation and therefore brings difficulty to the kinematic control of its movement. In this paper, we present a geometry-based framework for computing the deformation of soft robots within the range of linear material elasticity. After formulating both manipulators and actuators with geometry elements, deformation can be efficiently computed by solving a constrained optimization problem. Based on its efficiency, forward and inverse kinematics for soft manipulators can be effectively solved by an iterative algorithm. Meanwhile, components with multiple materials can also be geometrically modeled in our framework with the help of a simple calibration. Numerical and physical experimental tests are conducted on soft manipulators driven by different actuators with large deformation to demonstrate the performance of our approach.

Digital Material Design Using Tensor-based Error Diffusion for Additive Manufacturing

Yuen-Shan Leung, Tsz-Ho Kwok, Huachao Mao, Yong Chen
Computer-Aided Design, Volume 114, September 2019, Pages 224-235.
[PDF][doi:10.1016/j.cad.2019.05.031]

Abstract:
Recent multi-material additive manufacturing (AM) technologies enable the fabrication of an object with accurate deposition of different types of materials. Hence, in addition to geometric shapes, it is possible to use different material compositions to optimize the mechanical properties of a component for given design requirements. However, current AM processes have a limitation on the number of materials that can be deposited during the fabrication process. Due to the constraint, it is critical to optimize the material distribution using the limited base materials; however, an extremely large design space exists in a design domain that is enabled by the AM technologies. In this paper, we introduce a digital material design framework to generate digital material compositions that can be printed and be able to achieve the desired behavior. We take analog material composition as the input and perform the analog-to-digital conversion using an exemplar-based approach based on a pre-computed material library. The patterns in the library are constructed with different combinations of the given base materials, and their mechanical properties are computed using finite element simulation. Accordingly, the design goal of the analog-to-digital conversion is to find material composition in the design domain with matching mechanical properties. A tensor-based error diffusion algorithm has been developed to reduce the approximation error during the conversion effectively. Experimental tests based on the design framework have been performed. The test results demonstrate our framework can quickly find effective solutions for various multi-material design problems.

Comparing Slicing Technologies for Digital Light Processing Printing

Tsz-Ho Kwok
ASME Transactions - Journal of Computing and Information Science in Engineering, 19(4), 044502 (Jun 13, 2019).
[PDF][doi:10.1115/1.4043672]

Abstract:
In Additive Manufacturing (AM), slicing is a crucial step in process planning to convert a Computer-Aided Design (CAD) model to a machine-specific format. Digital Light Processing (DLP) printing is an important AM process that has a good surface finish, high accuracy and fabrication speed, and is widely applied in many dental and engineering industries. However, as DLP uses images for fabrication different from other toolpath-based processes, its process planning is understudied. Therefore, the main goal of this paper is to study and compare the slicing technologies for DLP printing. Three slicing technologies are compared: contour, voxelization, and ray-tracing.

Surfel Convolutional Neural Network for Support Detection in Additive Manufacturing

Jida Huang, Tsz-Ho Kwok, Chi Zhou, and Wenyao Xu
The International Journal of Advanced Manufacturing Technology, Dec 2019, 105(9), 3593-3604.
[PDF][doi:10.1007/s00170-019-03792-1]

Abstract:
Support generation is one of the crucial steps in 3D printing to make sure the overhang structures can be fabricated. The first step of support generation is to detect which regions need support structures. Normal-based methods can determine the support regions fast but find many unnecessary locations which could be potentially self-supported. Image-based methods conduct a layer-by-layer comparison to find support regions, which could make use of material self-support capability; however, it sacrifices the computational cost and may still fail in some applications due to the loss of topology information when conducting offset and boolean operations based on the image. In order to overcome the difficulties of image-based methods, this paper proposes a surfel convolutional neural network (SCNN) based approach for support detection. In this method, the sampling point on the surface with normal information, named surfel (surface element), is defined through layered depth-normal image (LDNI) sampling method. A local surfel image which represents the local topology information of the sampling point in the solid model is then constructed. A set of models with ground-truth support regions is used to train the deep neural network. Experimental results show that the proposed method outperforms the normal-based method and image-based method in terms of accuracy, reliability and computational cost.

Automated Storage and Active Cleaning for Multi-Material Digital-Light-Processing Printer

Christopher-Denny Matte, Michael Pearson, Felix Trottier-Cournoyer, Andrew Dafoe and Tsz-Ho Kwok
Rapid Prototyping Journal, Jun 2019, Vol. 25 No. 5, pp. 864-874.
[PDF][doi:10.1108/RPJ-08-2018-0211]

Abstract:
Digital light processing (DLP) printing uses a digital projector to selectively cure a full layer of resin using a mask image. One of the challenges with DLP printing is the difficulty of incorporating multiple materials within the same part. As the part is cured within a liquid basin, resin switching introduces issues of cross-contamination and significantly increased print time. In this paper, a novel technique for printing with multiple materials using the DLP method is introduced. The material handling challenges are investigated and addressed by taking inspiration from automated storage and retrieval systems, and utilizing an active cleaning solution. The material tower is a compact design to facilitate the storage and retrieval of different materials during the printing process. A spray mechanism is used for actively cleaning excess resin from the part between material changes. Challenges encountered within the multi-material DLP technology are addressed, and the experimental prototype validates the proposed solution. Our system has a cleaning effectiveness of over 90% in 15 seconds with the build area of 72 inches, in contrast to the previous work of 50% cleaning effectiveness in 2 minutes with only 6 inches build area. Our method can also hold more materials than the previous work. The techniques from automated storage and retrieval system (ASRS) is applied to develop a storage system, so that the time complexity of swapping is reduced from linear to constant. The whole system is sustainable and scalable by using a spraying mechanism. The design of the printer is modular and highly customizable, and the material waste for build materials and cleaning solution is minimized.

Customization and Topology Optimization of Compression Casts/Braces on Two-Manifold Surfaces

Yunbo Zhang and Tsz-Ho Kwok
Computer-Aided Design, Volume 111, June 2019, Pages 113-122.
[PDF][doi:10.1016/j.cad.2019.02.005]

Abstract:
This paper applies the topology optimization (TO) technique to the design of custom compression casts/braces on two-manifold mesh surfaces. Conventional braces or casts, usually made of plaster or fiberglass, have the drawbacks of being heavy and unventilated to wear. To reduce the weight and improve the performance of a custom brace, TO methods are adopted to optimize the geometry of the brace in the three-dimensional (3D) space, but they are computationally expensive. Based on our observation that the brace has a much smaller thickness compared to other dimensions and the applied loads are normal forces, this paper presents a novel TO method based on thin plate elements on the two-dimensional manifold (2-manifold) surfaces instead of 3D solid elements. Our working pipeline starts from a 3D scan of a human body represented by a 2-manifold mesh surface, which is the base design domain for the custom brace. Similar to the concept of isoparametric representation, the 3D design domain is mapped onto a two-dimensional (2D) parametric domain. An Finite Element Analysis (FEA) with bending moments is performed on the parameterized 2D design domain, and the Solid Isotropic Material with Penalization (SIMP) method is applied to optimize the pattern in the parametric domain. After the optimized cast/brace is obtained on the 2-manifold mesh surface, a solid model is generated by our design interface and then sent to a 3D printer for fabrication. Compared with the optimization method with solid elements, our method is more efficient and controllable due to the high efficiency of solving FEA in the 2D domain.

Parametric Design for Human Body Modeling by Wireframe-Assisted Deep Learning

Jida Huang, Tsz-Ho Kwok, and Chi Zhou
Computer-Aided Design, Volume 108, March 2019, Pages 19-29.
[PDF][doi:10.1016/j.cad.2018.10.004]

Abstract:
Statistical learning of human body shape can be used for reconstructing or estimating body shapes from incomplete data, semantic parametric design, modifying images or videos, or simulation.  A digital human body is normally represented in a high-dimensional space, and the number of vertices in a mesh is far larger than the number of human bodies in publicly available databases, which results in a model learned by Principle Component Analysis (PCA) can hardly reflect the true variety in human body shapes. While deep learning have been most successful on data with an underlying Euclidean or grid-like structure, the geometric nature of human body is non-Euclidean, it will be very challenging to perform deep learning techniques directly on such non-Euclidean domain. This paper presents a deep neural network (DNN) based hierarchical method for statistical learning of human body by using feature wireframe as one of the layers to separate the whole problem into smaller and more solvable sub-problems. The feature wireframe is a collection of feature curves which are semantically defined on the mesh of human body, and it is consistent to all human bodies. A set of patches can then be generated by clustering the whole mesh surface to separated ones that interpolate the feature wireframe. Since the surface is separated into patches, PCA only needs to be conducted on each patch but not on the whole surface. The spatial relationship between the semantic parameter, the wireframe and the patches are learned by DNN and linear regression respectively.  An application of semantic parametric design is used to demonstrate the capability of the method, where the semantic parameters are linked to the feature wireframe instead of the mesh directly. Under this hierarchy, the feature wireframe acts like an agent between semantic parameters and the mesh, and also contains semantic meaning by itself. The proposed method of learning human body statistically with the help of feature wireframe is scalable and has a better quality.

Challenges and Status on Design and Computation for Emerging Additive Manufacturing Technologies

Yuen-Shan Leung, Tsz-Ho Kwok, Xiangjia Li, Yang Yang, Charlie C.L. Wang, and Yong Chen
ASME Transactions - Journal of Computing and Information Science in Engineering, 19(2), 021013 (Mar 18, 2019).
[PDF][doi:10.1115/1.4041913]

Abstract:
The revolution of additive manufacturing (AM) has led to many opportunities in fabricating complex and novel products. The increase of the printable materials and the emergence of the various fabricating processes continuously expand the capability of manufacturing. Our products are no longer limited to be single material, single scale or single function. In fact, a paradigm shift is taking place in the industries from geometry-centered usage to support functional demands, and hence it is expected to resolve wide range of complex and difficult problems. Although AM provides us higher design degree of freedom beyond the geometry to fabricate new objects with tailored properties and functions, there are only very few approaches for computational design in this new domain enabled by AM. The objectives of this study are to provide an overview on the current computer-aided design methodologies that are applied to multi-material, multi-scale, multi-form and multi-functional AM technologies. We summarize the difficulties encountered in the design approaches and emphasize the need for the future development. The study also introduces the related manufacturing processes, lists their present applications, and discusses their potential future trends.

Adaptive Slicing Based on Efficient Profile Analysis

Huachao Mao, Tsz-Ho Kwok, Yong Chen, and Charlie C.L. Wang
Computer-Aided Design, Volume 107, February 2019, Pages 89-101.
[PDF][doi:10.1016/j.cad.2018.09.006]

Abstract:
Adaptive slicing is an important computational task required in the layer-based manufacturing process. Its purpose is to find an optimal trade-off between the fabrication time (number of layers) and the surface quality (geometric deviation error). Most of the traditional adaptive slicing algorithms are computationally expensive or only based on local evaluation of errors. To tackle these problems, we introduce a method to efficiently generate the slicing plans by a new metric profile that can characterize the distribution of deviation errors along the building direction. By generalizing the conventional error metrics, the proposed metric profile is a density function of deviation errors, which measures the global deviation errors rather than the in-plane local geometry errors used in most prior methods. Slicing can be efficiently evaluated based on metric profiles in contrast to the expensive computation on  models in boundary-representation. An efficient algorithm based on dynamic programming is proposed to find the best slicing plan. Our adaptive slicing method can also be applied to models with weighted features and can serve as the inner loop to search the best building direction. The performance of our approach is demonstrated by experimental tests on different examples.

DNSS: Dual-Normal Space Sampling for 3D ICP Registration

Tsz-Ho Kwok
IEEE Transactions on Automation Science and Engineering, vol. 16, no. 1, pp. 241-252, Jan. 2019.
[PDF][doi:10.1109/TASE.2018.2802725][code]

Abstract:
Rigid registration is a fundamental process in many applications that require alignment of different datasets. Iterative Closest Point (ICP) is a widely used algorithm that iteratively finds point correspondences and updates the rigid transformation. One of the key variants of ICP to its success is the selection of points, which is directly related to the convergence and robustness of the ICP algorithm. Besides uniform sampling, there are a number of normal-based and feature-based approaches that consider normal, curvature, and/or other signals in the point selection. Among them, Normal Space Sampling (NSS) is one of the most popular techniques due to its simplicity and low computational cost. The rationale of NSS is to sample enough constraints to determine all the components of transformation, but this study finds that NSS actually can constrain the translational normal space only. This paper extends the fundamental idea of NSS and proposes Dual-Normal Space Sampling (DNSS) to sample points in both translational and rotational normal spaces. Compared with NSS, this approach has similar simplicity and efficiency without any need of additional information, but has a much better effectiveness. Experimental results show that DNSS can outperform the normal-based and feature-based methods in terms of convergence and robustness. For example, DNSS can achieve convergence from an orthogonal initial position while no other methods can achieve.

In-situ Droplet Inspection and Closed-Loop Control System using Machine Learning for Liquid Metal Jet Printing

Tianjiao Wang, Tsz-Ho Kwok, Chi Zhou, and Scott Vader
Journal of Manufacturing Systems, Volume 47, April 2018, Pages 83-92.
[PDF][doi:10.1016/j.jmsy.2018.04.003][3DPI]

Abstract:
Liquid Metal Jet Printing (LMJP) is a revolutionary 3D printing technique in fast but low-cost additive manufacturing. The driving force is produced by magneto-hydrodynamic property of liquid metal in an alternating magnetic field. Due to its integrated melting and ink-jetting process, it can achieve 10x faster at 1/10th of the cost as compared to current metal 3D printing techniques. However, the jetting process are influenced by many uncertain factors, which imposes a significant challenge to its process stability and product quality. To address this challenge, we present a closed-loop control mechanism using vision technique integrated with neural network to inspect droplet behaviours. This system automatically tunes the drive voltage applied to compensate the uncertain influence based on vision inspection result. To realize this, we first extract multiple features and properties from images to capture the droplet behaviour. Second, we use a neural network together with PID control process to determine how the drive voltage should be adjusted. We test this system on a piezoelectric-based ink-jetting emulator, which has very similar jetting mechanism to the LMJP. Results show that significantly more stable jetting behaviour can be obtained in real-time. This system can also be applied to other droplet related applications owing to its universally applicable characteristics. 

Geometry-based Direct Simulation for Multi-Material Soft Robots

Guoxin Fang, Christopher-Denny Matte, Tsz-Ho Kwok, and Charlie C.L. Wang
IEEE International Conference on Robotics and Automation (ICRA), Brisbane, Australia, May 21-25, 2018.
[PDF][video][doi:10.1109/ICRA.2018.8461088]

Abstract:
Robots fabricated by soft materials can provide higher flexibility and thus better safety while interacting with natural objects with low stiffness such as food and human beings. However, as many more degrees of freedom are introduced, the motion simulation of a soft robot becomes cumbersome, especially when large deformations are presented. Moreover, when the actuation is defined by geometry variation, it is not easy to obtain the exact loads and material properties to be used in the conventional methods of deformation simulation. In this paper, we present a direct approach to take the geometric actuation as input and compute the deformed shape of soft robots by numerical optimization using a geometry-based algorithm. By a simple calibration, the properties of multiple materials can be modeled geometrically in the framework. Numerical and experimental tests have been conducted to demonstrate the performance of our approach on both cable-driven and pneumatic actuators in soft robotics.

V4PCS: Volumetric 4PCS Algorithm for Global Registration

Jida Huang, Tsz-Ho Kwok, and Chi Zhou
ASME Transactions - Journal of Mechanical Design, 139(11), 111403 (Oct 02, 2017).
[PDF][doi:10.1115/1.4037477]

Abstract:
With the advances in three-dimensional (3D) scanning and sensing technologies, massive human-related data are now available and create many applications in data-driven design. Similarity identification is one of basic problems in data-driven design and can facilitate many engineering applications and product paradigm such as quality control and mass customization. Therefore, reusing information can create unprecedented opportunities in advancing the theory, method, and practice of product design. To enable information reuse, different models have to be aligned so that their similarity can be identified. This alignment is commonly known as the global registration that finds an optimal rigid transformation to align two 3D shapes (scene and model) without any assumptions on their initial positions. The Super 4-Points Congruent Sets (S4PCS) is a popular algorithm used for this shape registration. While S4PCS performs the registration using a set of 4 coplanar points, we find that incorporating the volumetric information of the models can improve the robustness and the efficiency of the algorithm, which are particularly important for mass customization. In this paper, we propose a novel algorithm, Volumetric 4PCS (V4PCS), to extend the 4 coplanar points to non-coplanar ones for global registration, and theoretically demonstrate the computational complexity is significantly reduced. Experimental tests are conducted on a number of models such as tooth aligner and hearing aid to compare with S4PCS. The experimental results show that the proposed V4PCS can achieve a maximum of 20 times speedup and can successfully compute the valid transformation with very limited number of sample points. An application of the proposed method in mass customization is also investigated.

4D Printing: Design and Fabrication of Smooth Curved Surface Using Controlled Self-Folding

Dongping Deng, Tsz-Ho Kwok, and Yong Chen
ASME Transactions - Journal of Mechanical Design, 139(8), 081702 (Jun 22, 2017).
[PDF][doi:10.1115/1.4036996]

Abstract:
Traditional origami structures fold along pre-defined hinges, and the neighboring facets of the hinges are folded to transform planar surfaces into three-dimensional (3D) shapes. In this study, we present a new self-folding design and fabrication approach that has no folding hinges and can build 3D structures with smooth curved surfaces. This four-dimensional (4D) printing method uses a thermal-response control mechanism, where a thermo shrink film is used as the active material and a photocurable material is used as the constraint material for the film. When the structure is heated, the two sides of the film will shrink differently due to the distribution of the constraint material on the film. Consequently, the structure will deform over time to a 3D surface that has no folding hinges. By properly designing the coated constraint patterns, the film can be self-folded into different shapes. The relationship between the constraint patterns and their correspondingly self-folded surfaces has been studied in the paper. Our 4D printing method presents a simple approach to quickly fabricate a 3D shell structure with smooth curved surfaces by fabricating a structure with accordingly designed material distribution.

Isogeometric Computation Reuse Method for Complex Objects with Topology-Consistent Volumetric Parameterization

Gang Xu, Tsz-Ho Kwok, and Charlie C.L. Wang
Computer-Aided Design, Volume 91, October 2017, Pages 1-13.
[PDF][doi:10.1016/j.cad.2017.04.002]

Abstract:
Volumetric spline parameterization and computational efficiency are two main challenges in isogeometric analysis (IGA). To tackle this problem, we propose a framework of computation reuse in IGA on a set of three-dimensional models with similar semantic features. Given a template domain, B-spline based consistent volumetric parameterization is first constructed for a set of models with similar semantic features. An efficient quadrature-free method is investigated in our framework to compute the entries of stiffness matrix by Bezier extraction and polynomial approximation. In our approach, evaluation on the stiffness matrix and imposition of the boundary conditions can be pre-computed and reused during IGA on a set of CAD models. Examples with complex geometry are presented to show the effectiveness of our methods, and efficiency similar to the computation in linear finite element analysis can be achieved for IGA taken on a set of models.

GDFE: Geometry-Driven Finite Element for Four-Dimensional Printing

Tsz-Ho Kwok, Yong Chen
ASME Journal of Manufacturing Science and Engineering, 139(11), 111006 (Sep 13, 2017).
[PDF][doi:10.1115/1.4037429]

Abstract:
Four-dimensional (4D) printing is a new category of printing that expands the fabrication process to include time as the forth dimension, and its process planning and simulation have to take time into consideration as well. The common tool to estimating the behavior of a deformable object is the finite element method (FEM). Although FEM is powerful, there are various sources of deformation from hardware, environment, and process, just to name a few, which are too complex to model by FEM. This paper introduces Geometry-Driven Finite Element (GDFE) as a solution to this problem. Based on the study on geometry changes, the deformation principles can be drawn to predict the relationship between the 4D-printing process and the shape transformation. Similar to FEM, the design domain is subdivided into a set of GDFEs, and the principles are applied on each GDFE, which are then assembled to a larger system that describes the overall shape. The proposed method converts the complex sources of deformation to a geometric optimization problem, which is intuitive and effective. The usages and applications of the GDFE framework have also been presented in this paper, including freeform design, reserve design, and design validation.

An Interactive Product Customization Framework for Freeform Shapes

Yunbo Zhang, and Tsz-Ho Kwok
Rapid Prototyping Journal, Vol. 23 Issue: 6, pp. 1136-1145, 2017.
[PDF][doi:10.1108/RPJ-08-2016-0129][video][program]

Abstract:
Additive Manufacturing (AM) enables the fabrication of three-dimensional (3D) objects with complex shapes without additional tools and refixturing. However, it is difficult for user to use traditional computer-aided design tools to design custom products. In this paper, we presented a design system to help user design custom 3D printable products on top of some freeform shapes. Users can define and edit styling curves on the reference model using our interactive geometric operations for styling curves. Incorporating with the reference models, these curves can be converted into 3D printable models through our fabrication interface. We tested our system with four design applications including a hollow-patterned bicycle helmet, a T-rex with skin frame structures, a face mask with Voronoi patterns, and an AM-specific night dress with hollow patterns. The executable prototype of the presented design framework used in the customization process is publicly available. 

Mass Customization: Reuse of Digital Slicing for Additive Manufacturing

Tsz-Ho Kwok, Hang Ye, Yong Chen, Chi Zhou, and Wenyao Xu
ASME Transactions - Journal of Computing and Information Science in Engineering, 17(2), 021009 (Feb 16, 2017).
[PDF][doi:10.1115/1.4034010]

Abstract:
Additive manufacturing, also known as 3D printing, enables production of complex customized shapes without requiring specialized tooling and fixture, and mass customization can then be realized with larger adoption. The slicing procedure is one of the fundamental tasks for 3D printing, and the slicing resolution has to be very high for fine fabrication, especially in the recent developed Continuous Liquid Interface Production (CLIP) process. The slicing procedure is then becoming the bottleneck in the pre-fabrication process, which could take hours for one model. This becomes even more significant in mass customization, where hundreds or thousands of models have to be fabricated. We observe that the customized products are generally in a same homogeneous class of shape with just a little variation. Our study finds that the slicing information of one model can be reused for other models in the same homogeneous group under a properly defined parameterization. Experimental results show that the reuse of slicing information have a maximum of 50 times speedup, and its utilization is dropped from more than 90% to less than 50% in the pre-fabrication process.

A Reverse Compensation Framework for Shape Deformation in Additive Manufacturing

Kai Xu, Tsz-Ho Kwok, and Yong Chen
ASME Transactions - Journal of Computing and Information Science in Engineering, 17(2), 021012 (Feb 16, 2017).
[PDF][doi:10.1115/1.4034874]

Abstract:
Shape deformation is one of the important issues in additive manufacturing such as the projection Stereolithography process. Volumetric shrinkage combined with thermal cooling during the photopolymerization and other factors such as support-constrained layer building process, leads to complex part deformation that is hard to predict and control.  In this paper, a general computation framework based on a reverse compensation approach is presented to reduce the shape deformation of fabricated parts. During the reverse compensation process, the shape deformation is first calculated by physical measurements. A novel method is presented with added markers for identifying the optimal correspondence between the deformed shape and the given nominal CAD model.  Accordingly, a new CAD model based on the determined compensation can be constructed. The intelligently modified CAD model, when used in fabrication, can significantly reduce the part deformation when compared to the nominal CAD model. Two test cases have been designed to demonstrate the effectiveness of the presented computation framework. Future work is also discussed in the paper.