Lonewolf 0.3 Released as Standalone XMPP Server Written in Rust

·1 views

A new release of Lonewolf, version 0.3, has been published as a standalone XMPP server implemented in the Rust programming language. The release was announced on GitHub, where its release notes are available to developers and users. The project was shared on Hacker News, where it received 13 points and 4 comments. The source material provides no further detail on the server's specific features, performance, or intended use cases.

Read the full story at Hacker News

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Splitting LLM prefill and decode adds a KV cache transfer cost that can erode gains

Separating prefill and decode onto different GPU pools removes compute stalls, but the design also has to move the KV cache between them. For a 32-layer model with 8 KV heads, each token adds about 64 KB of cache, so an 8,000-token prompt produces roughly 512 MB that must cross the network before decoding begins. On a 10 Gb/s link this transfer takes about 410 ms, longer than the 320 ms prefill it was meant to offload, while 25 Gb/s roughly halves the benefit and 100 Gb/s clearly wins. The author argues that cache size and interconnect bandwidth should be calculated before choosing disaggregation, and that grouped-query attention and KV cache compression can substantially reduce the transfer cost.

0 comments Read more at DEV Community

ProgrammingHacker News ·

Arm CEO Rene Haas Reportedly Approached About Nvidia CEO Role

Rene Haas, the chief executive of chip designer Arm, has reportedly been approached as a candidate to lead Nvidia. The Financial Times article linked in the source suggests Nvidia is considering external options for its top job. The source provides only a link and minimal metadata, so details such as who initiated the approach and the timing are not confirmed. Arm and Nvidia are both major players in the semiconductor industry, which makes the report notable. No official statement from either company is included in the available material.

0 comments Read more at Hacker News

ProgrammingHacker News ·

LibreOffice Highlights Year-Round Availability in Social Media Post

The LibreOffice account posted a message on Twitter noting that the office suite is available every day of the year. The post was shared on Hacker News, where it gathered 13 points. No comments had been posted on the discussion thread at the time of the snippet. The item offers little beyond the social media message itself, with no additional details about new features or announcements. The source material is limited, so the summary cannot elaborate further on context or significance.

0 comments Read more at Hacker News

ProgrammingHacker News ·

FBI says North Korean hackers used fake video calls in $400M crypto heist

The FBI has attributed a cryptocurrency theft worth about $400 million to North Korean hackers. According to the agency, the attackers used fake video calls to deceive their targets. The details are drawn from a BBC report linked in the original post. The source material provided is limited, so further specifics about the victims and timing could not be confirmed here.

0 comments Read more at Hacker News