[2410.00907] Addition is All You Need for Energy-efficient Language Models
Large neural networks spend most computation on floating point tensor multiplications. In this work, we find that a floating point multiplier can be approximated by one integer adder with high precision. We propose the linear-complexity multiplication L-Mul algorithm that approximates floating point number multiplication with integer addition operations. The new algorithm costs significantly less computation resource than 8-bit floating point multiplication but achieves higher precision. Compared to 8-bit floating point multiplications, the proposed method achieves higher precision but consumes significantly less bit-level computation. Since multiplying floating point numbers requires substantially higher energy compared to integer addition operations, applying the L-Mul operation in tensor processing hardware can potentially reduce 95% energy cost by element-wise floating point tensor multiplications and 80% energy cost of dot products.
Tech Cyborg reshared this.
Here we go.
Via Kyle Griffin:
The #Trump campaign is dragging its feet on beginning the formal process allowing for a smooth transition of power.
The campaign has missed two major deadlines to sign required federal documents and has failed to file an ethics plan for his prospective admin.
The delay allows him to circumvent fundraising rules and ethics rules. nytimes.com/2024/10/09/us/poli…
Debbie Goldsmith 🏳️⚧️♾️🇺🇦 reshared this.
3 Scenarios for the Supreme Court to Intervene in the Election (Aziz Huq/Politico)
politico.com/news/magazine/202…
memeorandum.com/241009/p84#a24…
Democrats can't make Georgia governor investigate State Election Board, judge says (Mark Niesse/Atlanta Journal-Constitution)
ajc.com/politics/ethics-case-a…
memeorandum.com/241009/p83#a24…
Day 9 of
#hARToween
Prompt: Sinister Shadow
#Halloween #artchallenge #SpookySeason #Shadow #KleineKunstklasse
You are absolutely right. Thank you! I tried to paint the picture a few months ago, but couldn't find the original picture again. Thank you for sharing it.
#YouTube - youtube.com/@SwitchedtoLinux
#Odysee - odysee.com/@switchedtolinux:0
#Rumble - rumble.com/c/SwitchedToLinux
#Bitchute - bitchute.com/channel/uf9hzD216…
!!! NOTE !!! Switched To Linux is, “written by a broad spectrum computer consultant to help people learn more about the Linux platform.” This account is a supporter of @switchedtolinux and provides convenience posts of thumbnails art, videos and streams.
«This post may contain hashtags as content may pertain to many distributions. Offended Discretion is advised»
#SwitchedToLinux #STL #Linux #Windows #Mac #AltTech #FOSS #YouTube #Odysee #Rumble #BitChute #Locals #DLive #Twitch #GUI #Desktop #Laptop #FactCheckTrue #Fediverse #Fedi22 #Fedi23 #Fedi24 #ewaste
Having a bad day. Annoyed that I seemingly haven't been given the vacation time I wanted at work and right before I left to get to work today something to do with Plasma Desktop ate itself. There was just a big Plasma Desktop update, though until now it was working fine.
Monitors went to sleep, one wouldn't wake. So I poked my monitor settings to wake it up and KDE Plasma poked me back. Persisted after a reboot too.
Computer otherwise works besides wallpaper not displaying and my task bar looking a bit glitchy.
Probably going to reinstall PD and see what that does for me.
#linux #kde #kdeneon #plasmadesktop
reshared this
9 November 1891 | Czech Jewish woman, Eliška Budlovská, was born in Benešov.
She was deported to Auschwitz from Theresienstadt ghetto on 26 January 1943. She was murdered in a gas chamber after arrival selection.
Exported Natural Gas Is Dirtier Than Coal, Says New Study.
The work challenges the industry line that sending liquefied natural gas around the globe is a cleaner alternative. #ClimateChange
Debbie Goldsmith 🏳️⚧️♾️🇺🇦 reshared this.
fmuc
in reply to nixCraft 🐧 • • •printables.com/model/650932-ca…
My way ;)
Django
in reply to nixCraft 🐧 • • •FilesUnknown
in reply to nixCraft 🐧 • • •