{"id":59855,"date":"2024-02-28T04:28:43","date_gmt":"2024-02-28T09:28:43","guid":{"rendered":"http:\/\/pappp.net\/?guid=75b203b311ff0b724789ffea61c9b0ba"},"modified":"2024-02-28T04:28:43","modified_gmt":"2024-02-28T09:28:43","slug":"the-era-of-1-bit-llms-ternary-parameters-for-cost-effective-computing","status":"publish","type":"post","link":"https:\/\/pappp.net\/?p=59855","title":{"rendered":"The Era of 1-bit LLMs: ternary parameters for cost-effective computing"},"content":{"rendered":"<p class=\"syndicated-attribution\">Source: <a href=\"https:\/\/arxiv.org\/abs\/2402.17764\">Hacker News<\/a><\/p>\n<div style=\"background-color : #fff7d5;\n\t\t\tborder-width : 1px; padding : 5px; border-style : dashed; border-color : #e7d796;margin-bottom : 1em; color : #9a8c59;\">Article note: I've been suggesting that most of the shitty floating point formats could be replaced with {-1,0,1,NaN} as a joke about the terribleness of shitty number representations, and the general sloppiness of the current \"AI\" hype cycle... it kind of looks like it's not actually a joke, you _can_ replicate a lot of the \"AI\" models with only {-1,0,1}.  And that definitionally doesn't involve any multiply hardware, so it's _ridiculously_ more power efficient.<\/div><a href=\"https:\/\/news.ycombinator.com\/item?id=39535800\" rel=\"noopener noreferrer\">Comments<\/a>","protected":false},"excerpt":{"rendered":"<p>Comments<\/p>\n<p> <a href=\"https:\/\/pappp.net\/?p=59855\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[226],"tags":[],"class_list":["post-59855","post","type-post","status-publish","format-standard","hentry","category-news-2"],"_links":{"self":[{"href":"https:\/\/pappp.net\/index.php?rest_route=\/wp\/v2\/posts\/59855","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/pappp.net\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/pappp.net\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/pappp.net\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/pappp.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=59855"}],"version-history":[{"count":0,"href":"https:\/\/pappp.net\/index.php?rest_route=\/wp\/v2\/posts\/59855\/revisions"}],"wp:attachment":[{"href":"https:\/\/pappp.net\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=59855"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/pappp.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=59855"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/pappp.net\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=59855"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}