Isn't 5090 FE (roughly 2500 USD in my country) pretty good FLOP value? 32 GB VRAM (and flash attention pushes it even faster compared to apple/mps relatively cheap "vram")
One of the reasons they removed NVLink from consumer cards (they supported it before). There’s also an issue with power consumption (1xB200 vs 10x5090)
Curious what issues you were having. The kernel should compile natively if you pass nvcc the correct arch flags, although it probably won't take advantage of any new hardware features.
> And flash attention doesn't work on 5090 yet, right?
Flash attention works with GPT-OSS + llama.cpp (tested on 1d72c8418) and other Blackwell card (RTX Pro 6000) so I think it should work on 5090 as well, it's the same architecture after all.
I also have this feeling that I'm 2-10x more productive. But isn't it curious how a lot of devs feel this way, but no devs that I know have the experience that any of their colleagues have become 2-10x more productive?
<raises hand> Our automated test folks were chronically behind, struggling to keep up with feature development. I got the two assigned to the team that was the most behind set up with Claude Code. Six weeks later they are fully caught up, expanding coverage, and integrating AI code review into our build pipeline.
It's not 10x, but those guys do seem like they've hit somewhere around 2x improvement overall.
Sometimes 10x can mean that I start things that I would have never started before, knowing it would take a long time. Or that I can have any of the agentic stuff "explore" libs, stacks and frameworks I wanted to look at, but had no time. Or distill some vague docs and blog posts to find common use cases for tech x. And so on.
It's not always a literal 10x time for taskA w/ AI vs taskA w/o AI...
Yeah, was super quick and easy to set up using Ollama. I had to kill some processes first to avoid memory swap though (even with 128gb memory). So a slightly more quantized version is maybe ideal, for me at least.
It offers searching in transcriptions of all Norwegian podcasts in (roughly) real-time. Also offers subscribing to alerts, for example if anyone mentions your business name. Launched some days ago
As a Norwegian, it is absolutely baffling how someone can seriously utter the words "I am in full support of Israel's actions in Gaza". Is the media coverage that different in USA than in Europe? How is it possible?
I try very hard to find credible primary and secondary sources of what's true on the ground. For Gaza, but also for Ukraine, Myanmar, Sudan, I am basically a nerd about conflict zones. From all of my research, I believe the IDF gets a bad rap but is no worse in Gaza than any Western army would be in the same situation. And indeed we can see that in dug in cities like the coalition forces vs ISIS in Mosul, civilian casulaties happened at quite similar rates to Gaza.
The United States occupation of Iraq was like a trip to an amusement park compared to Gaza. Please don't compare the IDF to the US military. At least the US military and its soldiers had RoE that they respected. Any breaking of those rules did not get ignored like they do in the IDF.
As someone from the USA what I see from media coverage is genocide in Gaza. They would have to be truly ignorant and intentionally uninformed to say something like that or be in favor of genocide.
did you ever consider that media coverage is very selective and biased ?
i remember half an year ago, during ceasefire when gaza was swamped in aid and food was rotting on the streets, laura coates at prime time said that "hundreds of gazans die from starvation daily". never happened. not even dozens.
or when at abby phillips show yesterday, somebody tried to say that presenting images of children with genetic diseases as image of children who are dying from starvation is manipulative, abby phillips stopped this person and said that it's not important.
you must have seen numerous mentions that 500 trucks of food to gaza is minimum (and actually needed even more), because it's the number of trucks that were entering gaza before war ? but did you see even once mention that 500 is total number of trucks that included construction materials, animal feed, etc.. etc.. and maximum of trucks of food that entered gaza in 1 day before war was 72(82?)
Struggle harder to explain how 10's of thousands of civilian deaths out of a population of 2 million and which has been increasing during the "genocide" can possibly be a "genocide".
Well, that's also something they said. We may or may not find the final numbers after the war. Remember the official death count is frozen since March 2024, since they killed the people who were counting the deaths.
I really have no idea what you are talking about. There's a genocide. The people who are doing the genocide told us they were doing a genocide, so there's no need to read the tea leaves. Genocides are bad.
