Improving Innovation from Science Using Kernel Tree Methods as a Precursor to Designed Experimentation
Source abstract
Abstract
A key challenge in applied science when planning a designed experiment is to determine the aliasing structure of the interaction effects and selecting the appropriate levels for the factors. In this study, kernel tree methods are used as precursors to identify significant interactions and levels of the factors useful for developing a designed experiment. This approach is aligned with integrating data science with the applied sciences to reduce the time from innovation in research and development to the advancement of new products, a very important consideration in today’s world of rapid advancements in industries such as pharmaceutical, medicine, aerospace, etc. Significant interaction effects for six common independent variables using boosted trees and random forests of k = 1000 and k = 10,000 bootstraps were identified from industrial databases. The four common variables were related to speed, pressing time, pressing temperature, and fiber refining. These common variables maximized tensile strength of medium density fiberboard (MDF) and the ultimate static load of oriented strand board (OSB), both widely-used industrial products. Given the results of the kernel tree methods, four possible designs with interaction effects were developed: full factorial, fractional factorial Resolution IV, Box–Behnken, and Central Composite Designs (CCD).
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Plant Surface Properties and Treatments · Textile materials and evaluations · Statistical Methods and Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Center for Renewable Carbon, The University of Tennessee, 2506 Jacob Drive, Knoxville, TN 37996-4570, USA
Georgia-Pacific Chemicals, 2883 Miller Rd., Decatur, GA 30035, USA
Huber Engineered Wood, 1442 State Rd 334, Commerce, GA 30530, USA
Fachhochschule Salzburg, GmbH, Salzburg University of Applied Sciences, Holztechnologie & Holzbau, Markt 136a, 5431 Kuchl, Austria
Funding
U.S. Department of Agriculture
References (48)
Show source-provided references
1. Some new three level designs for the study of quantitative variables10.1080/00401706.1960.10489912 ↗
2. Binary segmentation: The automatic detector and related techniques for exploring data structure
3. Significance testing in automatic interaction detection (A.I.D.)10.2307/2346565 ↗
4. Regression trees with unbiased variable selection and interaction detection
5. Problems in the analysis of survey data and a proposal10.1080/01621459.1963.10500855 ↗
6. Greedy function approximation: A gradient booting machine10.1214/aos/1013203451 ↗
7. Stochastic gradient boosting10.1016/S0167-9473(01)00065-2 ↗
8. Multiple additive regression trees with application in epidemiology10.1002/sim.1501 ↗
9. Classification trees with unbiased multiway splits10.1198/016214501753168271 ↗
10. Classification trees with bivariate linear discriminant node models10.1198/1061860032049 ↗
11. Using data mining tools of decision trees in reliability applications
12. Stoma, P., Stoma, M., Dudziak, A., and Caban, J. (2019). Bootstrap analysis of the production processes capability assessment. Appl. Sci., 9.10.3390/app9245360 ↗
13. A new look at the statistical model identification10.1109/TAC.1974.1100705 ↗
14. Estimating the dimension of a model10.1214/aos/1176344136 ↗
15. Buschow, K.H.J., Cahn, R.W., Flemings, M.C., Ilschner, B., Kramer, E.J., Mahajan, S., and Veyssière, P. (2001). Wood: Structural Panel Processes. Encyclopedia of Materials: Science and Technology, Elsevier.
16. Buschow, K.H.J., Cahn, R.W., Flemings, M.C., Ilschner, B., Kramer, E.J., Mahajan, S., and Veyssière, P. (2001). Wood: Nonstructural panel processes. Encyclopedia of Materials: Science and Technology, Elsevier.
17. Piecewise-polynomial regression trees
18. Classification and regression trees: A powerful yet simple technique for ecological data analysis10.1890/0012-9658(2000)081[3178:CARTAP]2.0.CO;2 ↗
19. Tree-structured classification via generalized discriminant analysis10.1080/01621459.1988.10478652 ↗
20. Hand, D.J., Mannila, H., and Smyth, P. (2001). Principles of Data Mining (Adaptive Computation and Machine Learning), MIT Press. [3rd ed.].
21. Real-time process modeling of particleboard manufacture using variable selection and regression methods ensemble10.1007/s00107-013-0689-0 ↗
22. Predicting the strength properties of wood composites using boosted regression trees10.13073/FPJ-D-12-00085 ↗
23. Cherkassky, V.S., and Mulier, F. (1998). Learning from Data: Concepts, Theory, and Methods, John Wiley & Sons, Inc.
24. Fayyad, U.M., Piatetsky-Shapiro, G., and Smyth, P. (1996). From Data Mining to Knowledge Discovery: An Overview of Advances in Knowledge Discovery and Data Mining, The MIT Press.
25. Classification and regression trees10.1002/widm.8 ↗
26. Robustly estimating lower percentiles when observations are costly10.1080/08982112.2014.968667 ↗
27. Predicting key reliability response with limited response data10.1080/08982112.2013.807930 ↗
28. Case studies: A study of missing data imputation in predictive modeling of a wood composite manufacturing process10.1080/00224065.2016.11918167 ↗
29. Breiman, L., Friedman, J.H., Olshen, R.A., and Stone, C.I. (1984). Classification and Regression Trees, Wadsworth.
30. Building more accurate decision trees with the additive tree10.1073/pnas.1816748116 ↗
31. Denison, D.D., Hansen, M.H., Holmes, C., Mallick, B., and Yu, B. (2003). The boosting approach to machine learning: An overview. MSRI Workshop on Nonlinear Estimation and Classification, Springer.10.1007/978-0-387-21579-2 ↗
32. Feng, J., Yu, Y., and Zhou, Z.-H. (2018, January 3–8). Multi-layered gradient boosting decision trees. Proceedings of the 32nd Conference on Neural Information Processing Systems (NeurIPS), Montréal, QC, Canada.
33. Ensemble of optimal trees, random forest and random projection ensemble classification10.1007/s11634-019-00364-9 ↗
34. Khuri, N. (April, January 30). Mining environmental chemicals with boosted trees. Proceedings of the 35th Annual ACM Symposium on Applied Computing, Brno, Czech Republic.
35. A working guide to boosted regression trees10.1111/j.1365-2656.2008.01390.x ↗
36. Random forests10.1023/A:1010933404324 ↗
37. Random forests: From early developments to recent advancements
38. Shape quantization and recognition with randomized trees10.1162/neco.1997.9.7.1545 ↗
39. The random subspace method for constructing decision forests10.1109/34.709601 ↗
40. Meta random forests
41. Correlation and variable importance in random forests10.1007/s11222-016-9646-1 ↗
42. Jaiswal, J.K., and Samikannu, R. (2017, January 2–4). Application of Random Forest Algorithm on Feature Subset Selection and Classification and Regression. Proceedings of the World Congress on Computing and Communication Technologies (WCCCT), Tiruchirappalli, India.10.1109/WCCCT.2016.25 ↗
43. Classification and regression by randomforest
44. Attewell, P., and Monaghan, D. (2015). Data Mining for the Social Cciences: An Introduction, University of California Press.
45. Fisher, R.A. (1971). The Design of Experiments, Hafner Publishing Company.
46. Science and statistics10.1080/01621459.1976.10480949 ↗
47. Batzoglou, S. (2009). How Many Bootstrap Replicates Are Necessary, Springer. RECOMB, LNCS 5541.
48. Box, G.E.P., and Draper, N.R. (1987). Empirical Model Building and Response Surfaces, John Wiley and Sons.