Difference between revisions of "Projects:2019s2-20001 Using Machine Learning to Determine Deposit Height and Defects for Wire + Arc Additive Manufacture (3D printing)"

From Projects
Jump to: navigation, search
(Preprocessing)
 
(4 intermediate revisions by 2 users not shown)
Line 3: Line 3:
 
[[Category:2019s2|24501]]
 
[[Category:2019s2|24501]]
 
== Introduction ==
 
== Introduction ==
AML3D is one of the leading company in the Wire Arc Additive Manufacturing (WAAM) industry. In short, WAAM is the Metal 3D printing. The technology has the ability to reduce up to 75% of manufacture time, cost, and material. Currently, WAAM is benefiting other industry such as: mining, defence, marine, and aviation.
+
3D  printing  is an  emerging  technology  that  has  the  potential  to  significantly  reduce  material  usage  through  the production of near net-shape parts. Many of the systems for 3D printing are based on lasers and powders; however the  deposition  rate  with  such  systems  is  very  low  making  the  production  of  large-scale  parts  difficult. AML Technologies  specialises  in the use  of  Wire Arc Additive Manufacture  (WAAM) where  deposition  is  based  on  arc welding processes and the deposition rates are an order of magnitude greater. When building 3D printed parts, even a relatively small layer height error of only 0.1 mm can produce large build height errors when multiplied across the many layers of a typical build.  This can make path planning difficult, so in-process layer height measurement is an essential building block of any production 3D printing system. A variety of techniques can be used for monitoring the layer height including laser scanners, and arc monitoring. It is the latter technique that will be explored in this project due to its robustness, and low cost of implementation – it only requires the measurement of arc current and voltage. Furthermore, it can potentially be used to detect defects by identifying waveform irregularities. This project is sponsored by AML3D.
 
 
<gallery mode="slideshow">
 
File:Welding baby.gif|center|Welding using robotic arm
 
File:Laser baby.gif|center|User laser sensor to find the CTWD
 
</gallery>
 
 
 
[[File:aml3d_logo.jpg|center|100px]]
 
 
=== Project team ===
 
=== Project team ===
 
==== Project students ====
 
==== Project students ====
Line 17: Line 10:
 
==== Supervisors ====
 
==== Supervisors ====
 
* Dr. Brian Ng
 
* Dr. Brian Ng
* Dr. Paul Colegrove (AML3D, sponsored company)
+
* Dr. Paul Colegrove (AML3D)
=== Objectives ===
 
The objective of this project is to increase the efficiency of the manufacture process at AML3D. In order to do so, the team will investigate into the possibility of automating and optimising the quality control processes. The two quality control processes that are currently being implemented at AML3D are measuring layer height using laser sensors, and human supervision for detecting defects. These processes add overhead into production time and usage of human resource, which is not desired. To achieve the goal, machine learning methods will be used extensively to analyse the electrical signatures of the weld process.
 
  
== Background ==
+
== References ==
=== Wire Arc Additive Manufacturing ===
+
[1] a, b, c, "Simple page", In Proceedings of the Conference of Simpleness, 2010.
Wire and Arc Additive Manufacturing (WAAM) is a type of additive manufacturing that uses electric arc as the heat source and material wire to feed the manufacture process <ref name="WAAM"> S. W. Williams, F. Martina, A. C. Addison, J. Ding, G. Pardal & P. Colegrove (2016) Wire + Arc Additive Manufacturing, Materials Science and Technology, 32:7, 641-647, DOI: 10.1179/1743284715Y.0000000073 </ref>. WAAM has been investigated since the 1990s <ref name="WAAM" />, but only recently that it received more attention from the manufacture world.
 
 
 
Its significant comes from the ability to manufacture complex model with less time and less material. Figure 1a and 1b show real parts that was manufactured by AML3D. Such custom made parts might takes months before be ready to be shipped, but with WAAM, the production time can reduce down to weeks. Currently, the industries that benefit the most from WAAM are maritime and aerospace.
 
 
 
Similar to other additive manufacture methods, WAAM achieves such results by sliding the models into multiple layers, and then build the model layer by layer. The movement control is normally handled by a robotic arm (AML3D uses ABB's Arc Welder robot), and the welding path is generated by a Computer Aid Manufacture (CAM) software.
 
 
 
[[File:welding_part1.JPG|thumb|Figure 1a: A propeller]]
 
[[File:welding_part2.jpg|thumb|Figure 1b: Another part of the ship]]
 
[[File:abb_robot.jpg|thumb|Figure 2: ABB's IRB 1520ID Arc Welder]]
 
 
 
=== Gas metal arc welding ===
 
<div><ul>
 
<li style="display: inline-block;"> [[File:gmaw_welding.png|thumb|500px|none|Figure 2: GMAW welding process <ref name="welding_book"> Norrish, J. (2006). Advanced welding processes. Elsevier. </ref>]] </li>
 
</ul></div>
 
 
 
Gas metal arc welding (GMAW), or also known as metal inert gas (MIG), is the welding process used at AML3D for WAAM. Due to its high deposition rate and economic benefits, GMAW has became more popular. We will explore two variants of GMAW, which are Pulse Multi Control and Cold Metal Transfer. Both processes are developed by Fronius, an Austrian welding company. Note that it is not required to understand the welding physics to follow this wiki. The next two following sections' purpose is to highlight the high variability, high dynamic nature in welding.
 
 
 
[[File:fronius.png|thumb|Figure 3: Fronius logo]]
 
 
 
==== Pulse Multi Control ====
 
Pulse Multi Control (PMC) welding is Fronius' modified Pulsed GMAW. The advantage of Pulsed GMAW is the ability to control the metal droplet transfer in welding. Note that from figure 4, the metal droplet is characterised by a downward slope of the current pulse. Figure 5 shows the current signal captured from experiments conducted at AML3D (PMC is used).
 
 
 
<div><ul>
 
<li style="display: inline-block;"> [[File:Pulsed_gmaw_transfer_mode.png|thumb|500px|none|Figure 4: Relationship between pulse current and droplet transfer<ref name="welding_book" />]] </li>
 
<li style="display: inline-block;"> [[File:Pmc_current_in_time_domain.png|thumb|650px|none|Figure 5: Current signal captured from experiments conducted at AML3D (PMC process)]] </li>
 
</ul></div>
 
==== Cold Metal Transfer ====
 
Cold Metal Transfer (CMT) is a complex welding process, also developed by Fronius. By detecting a short circuit (mode C and D in figure 8), CMT can make adjustment such as retracting the welding material to cool down, and therefore create a smoother, more stable weld. The complexity of CMT can be seen in the current signal of the process (figure 9). Compare to PMC, CMT's signal has more variation during one signal period.
 
 
 
<div><ul>
 
<li style="display: inline-block;"> [[File:Transfer_mode.png|thumb|800px|none|Figure 8: Mechanism of metal droplet transfer mode]] </li>
 
<li style="display: inline-block;"> [[File:Cmt1_current_in_time_domain.png|thumb|735px|none|Figure 9: Current signal captured from experiments conducted at AML3D (CMT process)]] </li>
 
</ul></div>
 
=== Machine Learning ===
 
Machine learning (or statistical learning) refer to a set of tools to give data scientists an insight into the data and make better decisions based on those information <ref name="introduction_ml_book"> James, G., Witten, D., Hastie, T., & Tibshirani, R. (2013). An introduction to statistical learning (Vol. 112, p. 18). New York: Springer. </ref>. In this project, we will explore the capabilities of classical machine learning methods (i.e anything but Deep Learning) due to the limitation of our available data. By the time of writing this wiki, we have only explored Support Vector Machine.
 
 
 
==== Support Vector Machine ====
 
The main idea of Support Vector Machine (SVM) is to draw hyperplanes that best separate multiple classes of data. The original SVM judges best decision hyperplane based on the separation margin between data classes (figure 10). However, there are multiple variants of SVM, such as hard/soft margin SVM, Nu-SVM, One class SVM (to solve anomaly detection problem). In our project, we choose to use a soft margin implementation of SVM. The benefit of soft margin SVM (as oppose to hard margin SVM) is that by allowing some misclassifications, we get a wider margin and therefore the solution becomes more "generalise" (i.e work better with a new set of dataset that is independent from the training dataset).
 
 
<div><ul>
 
<li style="display: inline-block;"> [[File:svm_margin.png|thumb|400px|none|Figure 10: Separation margin <ref name="bishop_book"> Bishop, C. M. (2006). Pattern recognition and machine learning. Springer. </ref>]] </li>
 
</ul></div>
 
 
 
==== Kernel tricks ====
 
Figure 10 is of linearly separable cases for SVM. For dataset that is not easy to separate with a hyperplane in their original features space (such as figure 11), the data often get projected into a higher dimension space where it is easier to separate (figure 14). Such technique is called the Kernel Tricks. It is important to note that Kernel Tricks does not actually "map" the data from '''X''' dimension to '''Z''' dimension, but rather pairwise compare the similarity of the input space in '''Z''' dimension.
 
 
 
<div><ul>
 
<li style="display: inline-block;"> [[File:Svm_nonseparable.png |thumb|350px|none|Figure 11: Nonseparable dataset <ref name="bishop_book"></ref>]] </li>
 
<li style="display: inline-block;"> [[File:Svm_kernel_trick.png |thumb|650px|none|Figure 12: Simplified example of the Kernel tricks]] </li>
 
</ul></div>
 
 
 
== Previous studies ==
 
There are many researches into defect detection in GMAW process. The three most dominant analysis methods are spectroscopic analysis, acoustic analysis, and electrical signal analysis.
 
 
 
=== Spectroscopic analysis ===
 
In <ref name="spectroscopic_analysis">D. Bebiano and S. Alfaro, “A weld defects detection system based on a spectrometer,” Sensors, vol. 9, no. 4, pp. 2851–2861, 2009.</ref>, the authors captured the intensity of radiation emission of electric arc. It is obvious from figure 13 that good weld's intensity stays stable while defect one's is characterised by a sudden peak. Therefore, a threshold is set to detect the defect welds.
 
 
 
<div><ul>
 
<li style="display: inline-block;"> [[File:spectroscopic_analysis.png|thumb|400px|none|Figure 13: Spectroscopic analysis <ref name="spectroscopic_analysis"></ref>]] </li>
 
</ul></div>
 
 
 
Other research into using spectroscopic data to monitor that can be of interest is <ref>D. Naso, B. Turchiano, and P. Pantaleo, “A fuzzy-logic based optical sensor for online weld defect-detection,” IEEE transactions on Industrial Informatics, vol. 1, no. 4, pp. 259–273, 2005.</ref>.
 
 
 
=== Acoustic analysis ===
 
With <ref name="acoustic_analysis">E. Cayo and S. C. Alfaro, “A non-intrusive GMA welding process quality monitoring system using acoustic sensing,” Sensors, vol. 9, no. 9, pp. 7150–7166, 2009.</ref>, the author discovered that arc ignition is characterised by a distinct sound and therefore it is possible to capture the frequency of ignition through acoustic sensors. A tolerance band was set and both ignition frequency and sound pressure level were used to monitor the quality of the weld.
 
 
 
<div><ul>
 
<li style="display: inline-block;"> [[File:acoustic_analysis.png|thumb|400px|none|Figure 14: Acoustic analysis <ref name="acoustic_analysis"></ref>]] </li>
 
</ul></div>
 
 
 
Other research into using acoustic signal to monitor that can be of interest are <ref>M. Fidali, “Detection of welding process instabilities using acoustic signals,” in International Congress on Technical Diagnostic, pp. 191–201, Springer, 2016.</ref>, <ref>L. Zhang, A. C. Basantes-Defaz, D. Ozevin, and E. Indacochea, “Real-time monitoring of welding process using air-coupled ultrasonics and acoustic emission,” The International Journal of Advanced Manufacturing Technology, vol. 101, no. 5-8, pp. 1623–1634, 2019.</ref>.
 
  
=== Electrical signal analysis ===
+
[2] ...
With <ref name="electrical_analysis_1">A. Sumesh, K. Rameshkumar, A. Raja, K. Mohandas, A. Santhakumari, and R. Shyambabu, “Establishing correlation between current and voltage signatures of the arc and weld defects in GMAW process,” Arabian Journal for Science and Engineering, vol. 42, no. 11, pp. 4649–4665, 2017.</ref>, the author plot the probability density distribution of voltage signal and discovered that the stable weld's signal concentrate in one region while unstable signal spread out. While in the paper, the authors did not developed a monitoring method using their findings, it shows that there is a significant differences between stable and unstable weld's electrical signature.
 
 
 
<div><ul>
 
<li style="display: inline-block;"> [[File:Electrical analysis pdd.png|thumb|400px|none|Figure 15: Voltage PDD <ref name="electrical_analysis_1"></ref>]] </li>
 
</ul></div>
 
 
 
In <ref name="electrical_analysis_2">S. Simpson, “Signature images for arc welding fault detection,” Science and Technology of Welding and Joining, vol. 12, no. 6, pp. 481–486, 2007.</ref>, the authors shows that by plotting the signature image of voltage and current scatter plot, both arcing and short-circuiting region's signature image can notify a defects welds. A more visual representation of short circuiting and arcing region can be found in [[#Gas metal arc welding|Gas metal arc welding section]].
 
 
 
<div><ul>
 
<li style="display: inline-block;"> [[File:Electrical voltage signature.png|thumb|400px|none|Figure 16a: Electrical voltage signature of stable weld <ref name="electrical_analysis_2"></ref>]] </li>
 
<li style="display: inline-block;"> [[File:Electrical signature 2.png|thumb|400px|none|Figure 16b: Electrical voltage signature of unstable weld <ref name="electrical_analysis_2"></ref>]] </li>
 
</ul></div>
 
 
 
Other research into using electrical signal to monitor that can be of interest are <ref>R. Madigan, “Arc sensing for defects in constant-voltage gas metal arc welding,” Welding Journal, vol. 78, pp. 322S–328S, 1999.</ref>, <ref>Y. Huang, K. Wang, Z. Zhou, X. Zhou, and J. Fang, “Stability evaluation of short-circuiting gas metal arc welding based on ensemble empirical mode decomposition,” Measurement Science and Technology, vol. 28, no. 3, p. 035006, 2017.</ref>,<ref>Z. Zhang, X. Chen, H. Chen, J. Zhong, and S. Chen, “Online welding quality monitoring based on feature extraction of arc voltage signal,” The International Journal of Advanced Manufacturing Technology, vol. 70, no. 9-12, pp. 1661–1671, 2014</ref>,<ref>X. Li and S. Simpson, “Parametric approach to positional fault detection in short arc welding,” Science and Technology of welding and joining, vol. 14, no. 2, pp. 146–151, 2009.</ref>, and <ref>E. Wei, D. Farson, R. Richardson, and H. Ludewig, “Detection of weld surface porosity by statistical analysis of arc current in gas metal arc welding,” Journal of Manufacturing Processes, vol. 3, no. 1, pp. 50–59, 2001.</ref>.
 
 
 
== Experiment setup ==
 
The welding system uses TPS 320i C Pulse (figure 15a), produced by Fronius, to supply power, feed wire, and system cooling. For movement control of the welding torch, the system use ABB’s IRB 1520ID (figure 15b), which is a dedicated arc welding robot. The Data Acquisition device is NI's DAQ. Each channel (voltage and current) is sampled at 25kHz while the dominant frequency for voltage and current signal are around 130Hz (for CMT process) and 190Hz (for PMC process).
 
 
 
[[File:Fronius_power_supply.jpg |thumb|Figure 17a: Fronius' Power Supply]]
 
[[File:Welding_robot2.jpg |thumb|Figure 17b: ABB's welding robot]]
 
 
 
[[File:Ni_daq.jpg|thumb|Figure 16: NI's DAQ device]]
 
 
 
== Statistical Analysis ==
 
 
 
=== Preprocessing ===
 
As the captured signal coming from Fronius' power supply, the signals also pick up switching power noise. The noise will interfere with the accuracy of the analysis if not filtered. In this project, we applied a 1000Hz digital Low Pass Butterworth filter. The effect of the filter can be seen in figure 18, while the comparation of using different filters can be seen in the gallery.
 
 
 
<div><ul>
 
<li style="display: inline-block;"> [[File:Filter_effect.png |thumb|750px|none|Figure 18: Effect of 1000Hz low pass filter]] </li>
 
<li style="display: inline-block;"> [[File:Freq_response.png |thumb|750px|none|Figure 19: Frequency response of the in-use filter]] </li>
 
</ul></div>
 
 
 
<gallery mode="packed-overlay" caption="Gallery: Comparison of different filtering method">
 
File:Effect_of_filtering2.png|widths:75px|heights:75px|In use filter vs 300Hz low pass filter
 
File:Effect_of_filtering3.png|widths:75px|heights:75px|In use filter vs 500Hz low pass filter
 
File:Effect_of_filtering4.png|widths:75px|heights:75px|In use filter vs 750Hz low pass filter
 
File:Effect_of_filtering5.png|widths:75px|heights:75px|In use filter vs 2000Hz low pass filter
 
</gallery>
 
 
 
=== Power Spectral Density ===
 
Our goal for this project is to detect the defect welds and predict the layer heights (the contact tip to work piece distance, CTWD, to be more accurate) in real time (refer to [[#Relating Contact Tip to Work-piece Distance to layer height|this section]] to understand the relationship between Contact Tip to Work-piece Distance and Layer height). An analysis of the current power spectral density (PSD) shows that there is an inverse proportional relationship between the CTWD of a weld and the frequency where its '''current signal''' PSD reach the peak, and also the magnitude of the peak. Since the peak of PSD can be fairly sensitive, we only consider the frequency of the peak PSD.
 
 
 
Figure 20 shows the PSD plot of voltage, current, and power signal of the weld using PMC process. In this experiment, we created multiple one-line, 8 seconds welds. These eight-second welds then get segmented into smaller two-second chunk to increase the number of data and decrease the processing time.
 
 
 
<div><ul>
 
<li style="display: inline-block;"> [[File:Psd pmc good bad all lowfreq.png |thumb|750px|none|Figure 20: Power spectral density of PMC process]] </li>
 
<li style="display: inline-block;"> [[File:One line weld.jpg |thumb|578px|none|Figure 21: Simple one-line weld experiment]] </li>
 
<li style="display: inline-block;"> [[File:Cmt_psd_stable_allCTWD_zoomed.png |thumb|750px|none|Figure 22: Simple one-line weld experiment]] </li>
 
 
 
</ul></div>
 
 
 
It seems like the inverse proportional relationship holds true for most cases. Other experiments showed that for a short period at the beginning and ending of the weld, the signal can behave differently relative to the rest of the weld. Currently, to migrate with this problem, data will not be collected and analysed (both offline and online) at these periods. However, the above results seem to only hold true for PMC processes. With CMT process, the current PSD plot indicates no relationship between the CTWD and the frequency at peak (figure 24).
 
 
 
For the next stage of the project, our plan is to develop a linear regression model to predict the CTWD for PMC process. With CMT process, we will have to look into different analysis techniques.
 
 
 
=== Support Vector Machine ===
 
By looking at the average voltage and average current of each segment of weld while making a simple straight path (PMC process), we realised there is a visible separation margin between stable and unstable welds. Using SVM with RBF kernel, we were able to correctly classify the quality of the weld with accuracy of 98%.
 
 
 
However, with CMT process, the separation cannot be observed.
 
 
 
<div><ul>
 
<li style="display: inline-block;"> [[File:Svm_pmcNoOxide_rbf.png |thumb|750px|none|Figure 23: Support Vector Machine classifying unstable data (PMC process)]] </li>
 
<li style="display: inline-block;"> [[File:CmtNoOxide_average_voltage_current.png |thumb|750px|none|Figure 24: Average voltage vs Average current (CMT process)]] </li>
 
</ul></div>
 
 
 
=== CTWD Regression ===
 
With CTWD prediction, the result will only be useful if it is done on-the-line while making the part. And therefore, as oppose to defect detection, we cannot have a short calibration process every constant time to check for worn contact tip. By analysing the data while building a real part, we found that the average voltage (for PMC process) and average current (for CMT process) seems to have the strongest linear relationship with the CTWD. The acceptable error for CTWD prediction is +/- 1 mm (according to AML3D requirement). For both PMC and CMT process, our root means square error is less than 1 (PMC: 0.68 and CMT: 0.83), which satisfied the requirement.
 
 
 
<div><ul>
 
<li style="display: inline-block;"> [[File:Linear_regression_pmc_wall.png |thumb|750px|none|Figure 25: Support Vector Machine classifying unstable data (PMC process)]] </li>
 
<li style="display: inline-block;"> [[File:Linear_regression_cmt_wall.png |thumb|750px|none|Figure 26: Average voltage vs Average current (CMT process)]] </li>
 
</ul></div>
 
 
 
== Result discussion ==
 
These results show that there is a strong possibility of defect detection and CTWD prediction in welding. However, these initial findings are still a proof of concept. In the next stage of our research, we will refine the algorithm and integrate into AML's pipeline.
 
 
 
== References ==
 
<references />
 

Latest revision as of 12:15, 2 June 2020

Introduction

3D printing is an emerging technology that has the potential to significantly reduce material usage through the production of near net-shape parts. Many of the systems for 3D printing are based on lasers and powders; however the deposition rate with such systems is very low making the production of large-scale parts difficult. AML Technologies specialises in the use of Wire + Arc Additive Manufacture (WAAM) where deposition is based on arc welding processes and the deposition rates are an order of magnitude greater. When building 3D printed parts, even a relatively small layer height error of only 0.1 mm can produce large build height errors when multiplied across the many layers of a typical build. This can make path planning difficult, so in-process layer height measurement is an essential building block of any production 3D printing system. A variety of techniques can be used for monitoring the layer height including laser scanners, and arc monitoring. It is the latter technique that will be explored in this project due to its robustness, and low cost of implementation – it only requires the measurement of arc current and voltage. Furthermore, it can potentially be used to detect defects by identifying waveform irregularities. This project is sponsored by AML3D.

Project team

Project students

  • Anh Tran
  • Nhat Nguyen

Supervisors

  • Dr. Brian Ng
  • Dr. Paul Colegrove (AML3D)

References

[1] a, b, c, "Simple page", In Proceedings of the Conference of Simpleness, 2010.

[2] ...