Analyzing Supervised Machine Learning Models for Classifying Astronomical Objects Using Gaia DR3 Spectral Features
Source abstract
Abstract
In this paper, we present an analysis of the effectiveness of various machine learning algorithms in classifying astronomical objects using data from the third release (DR3) of the Gaia space mission. The dataset used includes spectral information from the satellite’s red and blue spectrophotometers. The primary goal is to achieve reliable classification with high confidence for symbiotic stars, planetary nebulae, and red giants. Symbiotic stars are binary systems formed by a high-temperature star (a white dwarf in most cases) and an evolved star (Mira type or red giant star); their spectra varies between the typical for these objects (depending on the orbital phase of the object) and present emission lines similar to those observed in PN spectra, which is the reason for this first selection. Several classification algorithms are evaluated, including Random Forest (RF), Support Vector Machine (SVM), Artificial Neural Networks (ANN), Gradient Boosting (GB), and Naive Bayes classifier. The evaluation is based on different metrics such as Precision, Recall, F1-Score, and the Kappa index. The study confirms the effectiveness of classifying the mentioned stars using only their spectral information. The models trained with Artificial Neural Networks and Random Forest demonstrated superior performance, surpassing an accuracy rate of 94.67%.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Stellar, planetary, and galactic studies · Astronomy and Astrophysical Research · Gamma-ray bursts and supernovae
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Tecnológico Nacional de México, Instituto Tecnológico de Ciudad Guzmán, Av. Tecnológico #100, Ciudad Guzmán 49000, Mexico
Instituto de Astronomía y Meteorología, Universidad de Guadalajara, Av. Vallarta 2602, Guadalajara 44100, Mexico
Departamento de Ciencias de la Computación y Tecnologías de la Información, Universidad Da Coruña, Paseo de Ronda 51, 15001 A Coruña, Spain
References (33)
Show source-provided references
1. The Gaia mission10.1051/0004-6361/201629272 ↗
2. Information content of BP/RP spectra in Gaia DR310.1093/mnras/stac2273 ↗
3. Gaia Data Release 3—Catalogue validation10.1051/0004-6361/202243790 ↗
4. Internal calibration of Gaia BP/RP low-resolution spectra10.1051/0004-6361/202141249 ↗
5. (2022, November 23). Gaia Data Release 3 Contents Summary—Gaia-Cosmos. Available online: https://www.cosmos.esa.int/web/gaia/dr3.
6. Karttunen, H., Kröger, P., Oja, H., Poutanen, M., and Donner, K.J. (2017). Fundamental Astronomy, Springer.10.1007/978-3-662-53045-0 ↗
7. Jastrow, R. (1990). Red Giants and White Dwarfs, W. W. Norton & Company.
8. Very late thermal pulses influenced by accretion in planetary nebulae10.1016/j.newast.2009.03.006 ↗
9. Kwok, S. (2000). The Origin and Evolution of Planetary Nebulae, Cambridge University Press.10.1017/CBO9780511529504 ↗
10. Mikolajewska, J. (2012). Symbiotic stars: Observations confront theory. arXiv.10.1515/astro-2017-0352 ↗
11. Carroll, B.W., and Ostlie, D.A. (2019). An Introduction to Modern Astrophysics, Cambridge University Press (CUP). [2nd ed.].
12. Gaia Collaboration, Vallenari, A., Brown, A., and Prusti, T. (2022). Gaia Data Release 3: Summary of the content and survey properties. Astron. Astrophys., 674, A1.
13. The SIMBAD astronomical database—The CDS reference database for astronomical objects10.1051/aas:2000332 ↗
14. Normalization: A Preprocessing Stage
15. Sampling Approaches for Imbalanced Data Classification Problem in Machine Learning10.1007/978-3-030-29407-6_17 ↗
16. Dynamically Weighted Balanced Loss: Class Imbalanced Learning and Confidence Calibration of Deep Neural Networks10.1109/TNNLS.2020.3047335 ↗
17. Sample Size Determination for Survey Research and Non-Probability Sampling Techniques: A Review and Set of Recommendations
18. Visualizing data using t-SNE
19. The Proportion for Splitting Data into Training and Test Set for the Bootstrap in Classification Problems
20. Random Forests10.1023/A:1010933404324 ↗
21. What is a support vector machine?10.1038/nbt1206-1565 ↗
22. Neural networks and their applications10.1063/1.1144830 ↗
23. Greedy function approximation: A gradient boosting machine10.1214/aos/1013203451 ↗
24. Yang, F.J. (2018, January 12–14). An implementation of naive bayes classifier. Proceedings of the 2018 International Conference on Computational Science and Computational Intelligence, CSCI, Las Vegas, NV, USA.10.1109/CSCI46756.2018.00065 ↗
25. Powers, D.M.W. (2020). Evaluation: From precision, recall and F-measure to ROC, informedness, markedness and correlation. arXiv.
26. The Matthews Correlation Coefficient (MCC) is More Informative Than Cohen’s Kappa and Brier Score in Binary Classification Assessment10.1109/ACCESS.2021.3084050 ↗
27. Farhadpour, S., Warner, T.A., and Maxwell, A.E. (2024). Selecting and Interpreting Multiclass Loss and Accuracy Assessment Metrics for Classifications with Class Imbalance: Guidance and Best Practices. Remote Sens., 16.10.3390/rs16030533 ↗
28. A catalogue of symbiotic stars10.1051/aas:2000280 ↗
29. A machine learning approach for identification and classification of symbiotic stars using 2MASS and WISE10.1093/mnras/sty3359 ↗
30. SDSS-DR12 bulk stellar spectral classification: Artificial neural networks approach10.1007/s10509-016-2880-3 ↗
31. Stellar Classification by Machine Learning10.1051/shsconf/202214403006 ↗
32. Automated Stellar Spectra Classification with Ensemble Convolutional Neural Network10.1155/2022/4489359 ↗
33. Villarreal, J.T., and Barton, S. (2023). Stellar Classification based on Various Star Characteristics using Machine Learning Algorithms. J. Stud. Res., 12.10.47611/jsrhs.v12i1.4375 ↗