journal article·2025-05-20

Bitumen optical microscopy as a quality assurance tool through deployment of trained Siamese neural network model

Nazmus Sakib, Nafis Tahmid, Shattik Islam Rhythm, Md. Shamsuzzoha Bayzid, Amit Bhasin

Road Materials and Pavement Design· Volume 26· Issue sup1
Publisher page

Abstract

Complexity of bitumen chemistry creates challenges in ensuring consistent bitumen quality and integrity during the selection, design, and construction phases of a project. Traditional methods for bitumen fingerprinting are often time-consuming, expensive, and require specialised equipment or proficiency, making them less suitable for frequent use in field setups. The present study focuses on developing a machine learning-based tool that utilises optical microscopy for imaging bitumen samples to verify their source. In this research, microscopic images of 31 bitumen samples from 12 producers were captured and used to train a deep learning model. The Siamese neural network model, trained on images taken on unaged bitumen samples at 100× magnification, achieved good performance metrics regarding same source identification and distinguishing among disparate sources. Specifically, the model demonstrated an accuracy of 93.17% with F1 scores of 73.08% for unaged samples, indicating that the bitumen source(s) can be viably identified through the model. On the other hand, when short-term aged 100× images were used for testing the model, the results did not show good correspondence with any (unaged) sources. The lack of similarity shows that major physicochemical change and corresponding change in microstructure can be identified through the machine learning model. It should be noted that the actual modification of bitumen and intrinsic chemical changes are not known beforehand and there is possibility of multiple refineries using the same crude source, while variability might be imparted due to differing processes. It can be concluded that the machine learning model, based on bitumen optical microscopy, has the potential for being used as a rapid source verification utility.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Infrastructure Maintenance and Monitoring · Asphalt Pavement Performance Evaluation · Surface Roughness and Optical Measurements

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Islamic University of Technology (IUT)

Bangladesh University of Engineering and Technology

The University of Texas at Austin

Funding

National Science Foundation · Texas Department of Transportation funds

References (51)

Show source-provided references
1. 10.1061/JMCEE7.MTENG-1745010.1061/JMCEE7.MTENG-17450 ↗
2. ASTM D4124 (2009). Standard test methods for separation of asphalt into four fractions. ASTM International.
3. 10.1088/1757-899X/236/1/01200110.1088/1757-899X/236/1/012001 ↗
4. 10.1016/j.fuel.2021.12126510.1016/j.fuel.2021.121265 ↗
5. Boysen R. & Schabron J. (2015). Automated HPLC SAR-AD separation (Tech. Rep. FP01). Western Research Institute.
6. Bromley J. Guyon I. LeCun Y. Säckinger E. & Shah R. (1993). Signature verification using a ‘siamese’ time delay neural network. In Advances in Neural Information Processing Systems 6 [7th NIPS Conference Denver Colorado USA 1993]. Morgan Kaufmann 1994. ISBN 1-55860-322-0.
7. Cebolla, V. L. (1997). TLC-FID in quantitative hydrocarbon group type analysis of asphaltenes and other heavy fossil fuels. Fuel and Energy Abstracts, 4(38), 220.
8. 10.1021/ac60273a00410.1021/ac60273a004 ↗
9. 10.1080/14680629.2009.969023610.1080/14680629.2009.9690236 ↗
10. 10.1109/JPROC.2019.294957510.1109/JPROC.2019.2949575 ↗
11. Delgadillo R. (2008). Nonlinearity of asphalt binders and the relationship with asphalt mixture permanent deformation [PhD thesis]. University of Wisconsin.
12. 10.3390/buildings1212211010.3390/buildings12122110 ↗
13. 10.3390/biomimetics501000810.3390/biomimetics5010008 ↗
14. 10.3141/2632-0510.3141/2632-05 ↗
15. 10.1016/j.conbuildmat.2021.12548110.1016/j.conbuildmat.2021.125481 ↗
16. 10.1617/s11527-015-0541-610.1617/s11527-015-0541-6 ↗
17. Hure R. (2017). Beyond the PG Specification for Asphalt Binders. The University of Texas at Austin.
18. IP469 (2006). Determination of saturated, aromatic and polar compounds in petroleum products by thin layer chromatography and flame ionisation detector. Energy Institute.
19. 10.1201/9781003402541-1210.1201/9781003402541-12 ↗
20. 10.1021/ef700393a10.1021/ef700393a ↗
21. Kingma D. P. & Ba J. (2017). Adam: A method for stochastic optimization. arXiv:1412.6980.
22. 10.1046/j.1365-2818.1996.134416.x10.1046/j.1365-2818.1996.134416.x ↗
23. 10.1080/14680629.2023.218100810.1080/14680629.2023.2181008 ↗
24. 10.1109/ICPR.2016.789966310.1109/ICPR.2016.7899663 ↗
25. 10.1016/j.micron.2022.10329410.1016/j.micron.2022.103294 ↗
26. 10.1617/s11527-022-01884-110.1617/s11527-022-01884-1 ↗
27. 10.1016/j.conbuildmat.2020.11957710.1016/j.conbuildmat.2020.119577 ↗
28. 10.1016/j.conbuildmat.2020.11880910.1016/j.conbuildmat.2020.118809 ↗
29. Nahar S. (2016). Phase-separation characteristics of bitumen and their relation to damage-healing [PhD Thesis]. Delft University of Technology.
30. 10.1016/j.eurpolymj.2013.03.02710.1016/j.eurpolymj.2013.03.027 ↗
31. Petersen, J., Robertson, R., Branthaver, J., Harnsberger, P., Duvall, J., Kim, S., Anderson, D., Christiansen, D., & Bahia, H. (1994). Binder characterization and evaluation (Vol. 1). Strategic Highway Research Program, National Research Council.
32. 10.1016/j.micron.2021.10308310.1016/j.micron.2021.103083 ↗
33. 10.1016/j.matdes.2024.11315710.1016/j.matdes.2024.113157 ↗
34. 10.1016/j.conbuildmat.2022.13020210.1016/j.conbuildmat.2022.130202 ↗
35. 10.1016/j.conbuildmat.2023.13395610.1016/j.conbuildmat.2023.133956 ↗
36. 10.1111/jmi.v276.310.1111/jmi.v276.3 ↗
37. 10.1111/jmi.2016.262.issue-310.1111/jmi.2016.262.issue-3 ↗
38. 10.1016/j.fuel.2014.09.04410.1016/j.fuel.2014.09.044 ↗
39. Russell, S. J., & Norvig, P. (2021). Artificial intelligence: A modern approach (4th ed.). Pearson.
40. Sakib N. (2018). Towards a better understanding of bitumen chemistry microstructure and rheology [PhD thesis]. The Univeristy of Texas at Austin.
41. 10.1080/10298436.2018.142897210.1080/10298436.2018.1428972 ↗
42. 10.1080/14680629.2024.242965110.1080/14680629.2024.2429651 ↗
43. 10.1061/(ASCE)MT.1943-5533.000319710.1061/(ASCE)MT.1943-5533.0003197 ↗
44. 10.1557/mrc.2020.5510.1557/mrc.2020.55 ↗
45. 10.1080/14680629.2008.969010910.1080/14680629.2008.9690109 ↗
46. 10.3390/a1604020510.3390/a16040205 ↗
47. 10.1016/j.conbuildmat.2014.09.02210.1016/j.conbuildmat.2014.09.022 ↗
48. Tex-553c (2024). Determination of Re-refined engine oil bottoms Polyphosphoric acid Tire rubber content and Trichloroethylene in asphalt binders using X-ray Florescence spectroscopy.
49. 10.1617/s11527-016-0957-710.1617/s11527-016-0957-7 ↗
50. 10.1617/s11527-018-1252-610.1617/s11527-018-1252-6 ↗
51. 10.3390/ma1405127310.3390/ma14051273 ↗