Not me. Just searched for tests, and found this guy:

Quick recap: He tests glm5.2(744gb version) on a mac m2, and a rtx5090 workstation. The very short context tests are not completely the same, he does no warm tests, and he doesn’t test the cluster feature, or any multi ssd setups etc.

M2 32gb external drive: cold start: ~2minutes ttft (time to first token), 0.1 tps. PC 64gb internal drive + rtx5090: cold start: ~17 seconds ttft, 0.8 tps

His conclusion is that the amount of memory is still the most important thing as warm runs should cache all experts etc.

This guy compare simple colibri with llama.cpp with a hidden flag ‘-nr’, and as soon as the context gets longer than ‘What is the Capitol of yadayada’, llama.cpp are much faster, and rising with context length. At 3K context, llama.cpp is 8+ * faster. Std. Colibri stays at same low tps no matter context length, but have a quicker ttft. He has a few links to similar projects in description.

end of test-vid recap…

I’m not sure how it stacks up with the rest, but for web: https://mapcarta.com/

“Explore the globe with Mapcarta—the open map that unites the world through the collective knowledge of OpenStreetMap, Wikipedia, Wikidata, and other open projects.”

I kind of hope they’ll out-compete the archaic Western Nobel foundation. Nobel neo-liberals don’t do much good for Science at all, and the whole thing is soaked - ‘reaked’ - in classical western elitist wrappings…

‘it is always nice to support the home team.’

It’s a nice sentiment on the surface, but it’s a huge fundamental mistake to think that EU elite is not the same as the US elite. That means he is not escaping anything.

EU (+Nato) have all been US vassal-states since WW2, and while we have had a few socialist societies/movements around the 70’es, US Epstein class have been attacking them relentlessly in every way possible; militarily on Yugoslavia (the main socialist nation) and the rest of it, + information war on everyone from academia to media, to politicians, + support of local fascist Oligarchs + right-wing ‘free market’ belief-systems (free markets Capitalism are the most profitable ideological substrate for the Epstein Class - also in EU). All NGO’s are propaganda outlets for the Epstein Empire. They won’t change or touch the fundamental problem of rich pschopaths running our ‘free’ world through violence.

In fact, EU/Nato elite scum sold out their nations to the US elite - pure treason, but no-body knows, and no Capitalist right-wing politicians or journalists/media are telling the story, so people are happily ignorant, getting manipulated/nudged around and every day supporting all the US oligarch wars all around the world against pro-claimed ‘Red Dictators’, while living in the most controlled and unfree and violent nations in the world.

WE are the ‘Baddies’ - and have been so for around 500 years - We are still colonising and killing of pro-social people and nations around the world !!

The fact is that everything US tells our elite to do, is happening, and all this ‘Bad Trump’ + ‘Let’s isolate from US’ business is just a standard surface scam (a bit more this time, but irrelevant). US elite do this good cop/bad cop ALL the time, and then apologise/shame the bad cop and promises change in a ‘reset’, but it never comes. It’s a switcheroo routine. EU (and rest of Nato) have been ideologically, politically and economically colonised completely for approx. 35 years. There’s even a map from Soro’s ‘open society’ where they show how the information/conversion campaign have went. Nordic nations WAS very pro-social once, but are now just small mini-US pro-Epstein nations, and Baltic citizens are the newest addition, very propagandised, and everyone have little to zero understanding of who/how their nations and their lives are run, or even where to find critical information (Oligarchs own/can manipulate ALL the search/information portals in the western sphere - yes, also wikipedia!). There’s no Democracy in US (never really were), and that goes for EU/Nato nations also.

But worst of all, is that all EU citizens still think they receive real unbiased information from their media and their unbiased ‘Journalists’, but real critical journalists are not hired in a media-sphere owned/controlled by Oligarchs. Public media are hi-jacked by people placed there by the Oligarchs, so same rule apply. Result is that EU citizens are extremely ignorant, gullible, follows the Epsteins (+Trump+Biden+all the others) narrative to the letter, and as seen in this article, still believe their nations are more ‘Democratic’, ‘free’, and have more ‘free speech’ than the hyper controlled US - pure nonsense ignorance, and interestingly enough by its own, are all societal marketing-words from the Epstein class that doesn’t give a shit about any of that.

So, the main way to get out of the Western Epstein/Trump/Oligarch grip, is actually to use Chinese, or Russian server providers, but oc, our western Oligarchy have gone for a full scale information war on those ‘wevil autocracies’ = other nations that refuse to surrender/succumb to the western fascist elite - our top psychopaths. So all the EU/Nato manipulated citizens refuse to use servers from ‘those pesky evil nations with dictators’ - sigh…

Oc, none of the above is recognisable for someone who is living in the suburbs of the Epstein Empire - why should it ? Our western Epstein-elite overlords controls the Western citizens opinions by controlling access to information. ‘Control the information’ topples any ‘democratic’ or rational thought, and are one part of what is called “Manufacturing Consent” (the other being ‘control the key power-positions’). Because of that, they can then allow these mock-up ‘elections’ that doesn’t really threaten the capitalist substrate, or change anything fundamentally, and get the citizens to hate or love whatever the rich Epstein class wants them to hate or love.

This works great for them. The Western investigative/critical ‘Journalistic’ media sphere is gone, any pro-social political movement is gone, all ‘Cause-Activists’ are suppressed, and Symptom-activists: climate, color, sexuality, unions etc, allowed, and every part of our society are semi, to fully controlled by rich pigs in the same top-down hierarchical (dictatorial) Oligarch fashion as in US. All our infra-structure - from politics to information to data-centers and corps are the same Pschopath power structure as in the US, and no-one, not this article guy either, can escape it without understanding how it all works, and how insanely manipulated they are.

All information that describes the above DOES still exist, ARE still available, and ARE often shown by all those that have fought the Epstein fckers forever and ever. But these are often the ‘well-known’ wevil ‘far-left conspiracy-theorists’ (socialists and communists usually), so the now manipulated mob hates these anti-Epstein activists, and refuse to listen to them. Pity, that these tireless cause-activists are silenced and ignored by those that are most manipulated and therefore need it the information the most…

Are you beginning to see how it all works? …probably not, but someone has to try explaining once in a while. Good luck ‘rebelling’ by sucking rectum on EU ‘Epsteins’ instead of US ‘Epstein’ rectums… Go go, you manipulated EU/Nato symptom-activists, you will change …nothing…

Notice that these ridiculous ‘news’ are NOT immediately pulled apart by ‘The Guardian’ - even when it is completely obvious.

The Guardian are NOT an unbiased ‘lefty’ news-paper, but just a standard western/UK for-profit oligarch owned propaganda outlet. They regurgitate what they are paid to say.

If their articles have absolutely NO relation to current geo-politics, or western power structure, we might get an almost unbiased article, but there are no ‘journalism’ or journalistic standards from that outlet - at all.

a source familiar with the matter told Reuters

Reuters are NOT an unbiased news outlet. They are the information outlet of the UK Oligarchy/elite, and they almost always use these wishywashy ‘sources’ when they are paid to lie/influence societal opinions on behalf of their rich-man club.

Not saying this couldn’t have some truth (propaganda often have a small seed of truth), but JPMorgan Chase and Leopold are in the same pro-Epstein/pro-Empire club and the Leopold kid’s losses doesn’t matter - at all…

Yes baby ! What a great page. Thank you, to this Brennan dude(tte) for creating it, and quick apolls to others for me primitively raging against every sign of this nazi/fascist club/product, and the whole nazi/fascist enshittification/normalization of ‘open source’.

One nasty surprise in secondary list: ‘suckless’ - oh well, can’t win them all :-(

Let’s post this great page as a standard reply to all posts/mentions of omacom/omarchy going forward, so all those not knowing, can be warned about what it really is !

[ait] (warning - AI topic tag) Dear anti-ai, if you can muster it, then please lower defences slightly for just a sec: It’s really time and energy consuming to follow and document this yucky movement as they are now heavily funded and work/move constantly 24/7. Brennan is a super cool Human, but can’t work on this always, all the time. We might need an active agentic system that also work constantly 24/7 to track the whole fascist/nazi network, all its players, update the lists and make it easier for ordinary good peeps to reject and boycott it all. Supervised by a human oc.

‘revolution’ 🙃

If AI Capitalism can effectively steal the work of others, and claim it as its own,

That’s just how Capitalism works. No need to attack the tool Capitalists use to do it. The ideology is a complete endowment of Psychopathic behaviour - suppress others to promote your self - win-lose.

Edit: To be fair:

However, it is important to recognize the villain in this story. It is Sam Altman and his company, not the AI

So almost there, but ffs - say it out loud: CAPITALISM is perpetual economic war and causes this behaviour always !

Anthropic is turning out to be an eager volunteer voice for the most harmful Fascist Empire in human history. Boycott those Uckers and everyone working for, or associated with them…

If you have used their product and it doesn’t contain any private identifiable info, then share the whole session-log/thinking to the netz ! F’ the Fascist Dario pig…

I’m sure nobody needs to verify US tech lords private/for-profit claims/info-war - being an openly biased detective and judge at the same time, but in this case I can just LOL all over, and hope it’s true.

What a ridiculous Cnt Corporation that apparently are completely ignorant of how ALL Market behaviour works - It’s WAR you childish m*rons - expect War from others while you go steal some more data, Anthropic Uckers…

wtf want to know what those Nazis and Capitalist enshittifiers do…

What happened to the github account ? I also currently use Hermes with a kanban as a ‘shared workspace’, so were curios how you tied it all together.

Since Nix have had some controversy (tldr), I’m just adding the Gnu Guix distro, as an (FOSS) alternative to Nix.

Both are ‘declarative’ systems that are build/configured from a configuration file - amongst other goodness.

Don’t mind the anti-ai votes - people are frustrated af. Your p2p sharing mindset are great, thank you !

A few ideas from the top of my head: Git service ?: Radicle is a p2p distributed Git service. You can seed your fave projects.

Deeper search ?: Yacy is a mature/advanced distributed p2p search engine, but I don’t know how it compares to mwmble.

[AIT] (AI topic, tag rule for this sub) Inference service ?: AIhorde is a distributed p2p inference network where you can help out with a smaller machine/model and draw on the network when you need large models. Works with pics/txt. Not sure how its going though.

…Oh, and perhaps skip Claude - Anthropic et al. are Fscist Ucks, and for 90% of your projects, you get 90% the same quality for 90% reduced price elsewhere (claimed on a ‘trust me bro’ basis ;-) ). aihorde sounds like something for you and its self-hosted.

https://mwmbl.org/ https://github.com/mwmbl/mwmbl

“Mwmbl is a non-profit, open source search engine where the community determines the rankings. We aim to be a replacement for commercial search engines such as Google and Bing. We have our own index powered by our community - while the index itself is centralised, the crawling is distributed…”

Damn, are we watching live growth of digital Fascist cancer here ? We all get spammed with this worthless, non-special OS in every information outlet, YT, SN’s and other for-profit junk outlets. People are getting paid to keep posting about it everywhere.

Pretty disgusting to see how rich Pschos think and act, and pretty disheartening to see our ‘non-enshittified’ world be enshittified in front of our eyes! Enshittification = Capitalization.

Boycott Omarchy by all means necessary, and help not spreading this Capitalist/Fascist cancer project anywhere.

USB is not good as its a huge bottleneck, and most external accelerators are (was?) passive without any ram onboard. Google Coral was/is ‘passive’ in that it resends all data all the time over the interface - Npu<->system ram.

I were going to recommend these: https://shop.geniatech.com/product/m2-ai-inference-acceleration-module/

40tops, ARM + Npu + 16gb ddr4 - a whole little Inference computer on a NVME interface. Kinara (Ara240) is a homegrown Chinese chip. While they are usually selling b2b, you can ask anyway. YMMW atmo. Also note that some NPU’s are less efficient at llm’s vs vision.

…but I see that they also rose almost 4* in price since I asked for, and were offered the price of 179$ ~7M ago, which is already a long time in this space. Not sure how the current ~650$ stacks up to the rest of the offers out there at the moment, but these small active AI systems on NVME are a great way of upgrading a piss-old server, enhance a new cheap 4-8port NVME mini-NAS or similar, and there’s no clear bottleneck in the interface.

Look for something like this instead of Nvidia Coral and other ‘passive’ sticks, that are all - imho - overpriced/underperforming.

The whole Alphabet group are one big mis-information hub. They also support Genocide and ‘The Trump’. Wether it is censoring sites/people that disagree with US elites, or if they are pushing information seekers to their own controlled information garden, or western corporate eco-systems, we all need to get rid of them.

You cruel monster - I love you !