Academy notes
Articles and updates from SoloQuant Academy.
Tag: transformers
Hugging Face Transformers for finance after work: classify a toy headline with pipeline()—not alpha. Educational only. Not investment advice.
Hugging Face Transformers v5.17.0 (9 Sep 2026) adds HYV4/Hy4-Preview MoE, VibeVoice, NeoMME + Retriever, Fun-ASR-Nano, KimiLinear (KDA), and NVIDIA Canary-1B-v2. After-work model checklist—not a CVE post. Not investment advice.
Wen, Zhou, Zhang, Chen, Ma, Yan and Sun (IJCAI 2023; arXiv:2202.07125) survey Transformers for time series. Taxonomy: module tweaks (positional encodings, sparse/low-rank attention) vs architecture (hierarchical). Applications: forecasting, anomaly, classification. Their ETTm2 checks: longer inputs often hurt; 3–6 layers beat 48; seasonal-trend decomposition can cut MSE 50–80%. Map before you pick Informer vs PatchTST. Plain-language intro. Not investment advice.
