Research
Transformer Jarang bagi Pemodelan Generatif
AI-generated brief Disclosure
Listen to Brief
AI audio in English, based on the NadiAI brief and original source.
Daily Audio Digest
Get daily AI news audio on your device.
Install NadiAI for quick access to the 5 latest AI stories each day.
- Tap Enable Alerts and allow notifications from NadiAI.
- If the Install App option appears in the address bar, install NadiAI for faster access.
- If it does not appear, bookmark this page or pin the NadiAI tab.
Brief
OpenAI membangunkan Sparse Transformer, rangkaian neural yang mencatat rekod baharu dalam meramal elemen seterusnya bagi teks, imej dan bunyi. Model ini menggunakan peningkatan algoritma pada mekanisme perhatian untuk mengekstrak corak dalam urutan sehingga 30 kali lebih panjang daripada sebelum ini.
Why It Matters
Ia membolehkan model generatif memproses konteks lebih panjang dan berpotensi meningkatkan kualiti ramalan rentas modaliti seperti teks, imej dan audio.
Reader Pulse
How do you see this development?
Sign in by email to join the reader pulse.
Reader discussion
Add insight, not noise
Structured contributions from verified readers. Downvoted posts are collapsed; reported posts may be hidden for review.
This discussion is closed, but published contributions remain readable.
No contributions yet. Start with a useful question or insight.