Shatur@discuss.tchncs.de to LocalLLaMA@sh.itjust.worksEnglish · 2 months ago42x Faster Prompt Lookup Drafting in llama.cppjadidbourbaki.github.ioexternal-linkmessage-square1linkfedilinkarrow-up130arrow-down11
arrow-up129arrow-down1external-link42x Faster Prompt Lookup Drafting in llama.cppjadidbourbaki.github.ioShatur@discuss.tchncs.de to LocalLLaMA@sh.itjust.worksEnglish · 2 months agomessage-square1linkfedilink
minus-squareeleitl@lemmy.ziplinkfedilinkEnglisharrow-up2·2 months agoIt’s interesting that neural graphs have locality at all. At least I find it surprising.