Training a Small Model to Classify 200+ Vulnerability Types — and Beating LLMs
I fine-tuned a 125M parameter RoBERTa model on 234K CVE descriptions to classify vulnerabilities into 205 CWE categories. It hits 87.4% accuracy and matches models 64x its size on CTI-Bench.
Read article