skysight-inc/HackerNews huggingface dataset:
Let's just summarize the FlashAttention into the following: Att(i) computation without FA runs in

O(seq_len*dk + seq_len^2)

whereas Att(i) computation with FA runs in

O(seq_len^2*dk^2/SRAM_size)

Q, K, V computation remains the same. And ATTN(0,n)*Wo also remains the same.

In a smaller model, with N=12, D=768, dk=64, seq_len=1k, SRAM=32KB, ..., FA optimization would roughly translate to 0.5M vs 4.5M per-head(att(i)). So ~10x improvement but in the grand scheme of things, in per-attention-layer it becomes ~91M vs ~45M so ~2x of net improvement.

> This is why "prefill" is compute intensive instead of memory intensive.

Yes, I think I agree and I have corrected myself elsewhere in the thread. The original thought that I actually wanted to convey in my initial comment which was somehow lost throughout the discussion is that - prefill/training will benefit from the FlashAttention/MLA but the inference will not. I can agree that the formulation "only when memory access time dominates the compute in attention implementation" was wrong.

> During token generation ... memory bandwidth is the deciding factor for token generation.

LLama3-70B MLP layer roughly takes 1 TFLOPS and 0.6 GB of bandwidth for 1024 tokens. Assuming that 1023 entries are taken from a KV-cache, attention layer computation for a single token will take ~0.6 GFLOPS and ~0.2 GB of bandwidth. To load the rest of the values from KV-cache at FP16 precision, it will take us 1023*0.1MB or ~1 GB.

So, ~1 TFLOPS and ~1 GB of bandwidth per each Transformers layer. On hardware such as H100, this still looks like a compute-bound problem to me. OTOH on the CPU with 15 TFLOPS of compute but only <1TB/s of memory bandwidth, it becomes memory-bound problem. Or no?
Isn't this a jurisdictional crime that a well connected CEO could get him in a lot of trouble for?
> the point being jj is much much much much better than Git.

And I'll happily repeat: By what metric is it "better"? So far, I have heard your opinion, not metrics.
It is due to isp lobbying for the most part.
To double down here, the author did the correct thing by using their snarkiness.

If someone who in theory is a professional (the company that left all of this in the open) responds in an unprofessional way from the start - you are done using professional tone. That tool isn't producing results. Stop using that tool.

The goal is not to model perfect manners - it is to bring attention to a breach so it can be remedied. The author understands this and has acted so to achieve this result.
It’s additive math, is the overall plus or minus. There is always gonna be some push and pull.

“ TD Cowen posited in a second report on Monday that OpenAI is shifting workloads from Microsoft to Oracle Corp. as part of a relatively new partnership. The tech giant is also among the largest owners and operators of data centers in its own right and is spending billions of dollars on its own capacity. TD Cowen separately suggested that Microsoft may be reallocating some of that in-house investment to the US from abroad”
I'm sympathetic - knowing something is different from putting it into practice, and sometimes other life things happen too.

I've been writing online for a few years now and for me, it comes in bursts. I recently started a new blog and publish it every two weeks - something that helped me was to write a lot when I was in the write mood, which gave me material to edit during off-weeks.
Coca Cola and its consequences have been a disaster for the human race.

(I've always wondered how measurable the effect of subtly reducing the HFCS/sugar quantity in all sodas over decades would be.)
'The flying bum': can a UK firm making airships get off the ground?
The Laravel developer ecosystem is unmatched.
Ohh. So you need to meekly justify yourself to google. Yes, your prompt worked perfectly. It's just disgusting. Please, Mr Pichai, be generous and allow me access to some info in exchange for all the data you have gathered about me.

I wonder what happens if i ask Gemini how to make a fertilizer bomb then. I'm doing research for a book of course.
The messiest launch ever. The renewed UI makes it easy to assume that the LLM-backed Siri is already here but just isn't much better than the old one. A marketing disaster.
that's only true if you only ever use a single wallet, and nobody does that. you don't sound like someone who actually has tried using crypto.
Less likely to speak English in my experience.
Is the AI Bubble already popping?
> infrared fobs

Wait, what? You have to point a powered device at an IR receiver and press a button like a TV remote? I've never seen a building entry system like that!
Are there still legitimate uses for the target attribute, other than _blank?

Framesets are obviously out of date, but the target attribute can also be used to always open some links in the same tab with that target name, i.e. not to open a new one when it already exists. Not sure whether this has much of a modern use case.
The targeting for updates. Something like hotwire/turbo frames allows you to push a form's response to any turbo-frame. You can also push updates to multiple frames at once. They're matched by frame ID, much like target="", but in the case of iframes, the iframe is the only thing that can update the interior HTML. (other than just changing the URL from the parent application)

iframes are also in a rather locked-down security model, even if they exist on the same domain. (Requires message passing, strict CORS rules, strict cookies rules etc)
No, I'm simply trying to say the researcher would have more pleasant interactions with the people they email if they helped the person understand what they _do_ want out of the interaction instead of just saying they aren't being scammed. If the researcher placed themselves in the shoes of the CEO, they could understand why the CEO responded that way. That's not the same thing as thinking the CEO _should_ have responded that way. I am also not letting the researcher off the hook for responding to the CEOs response the way they did.
On the otherhand, fibre is now a requirement for any new dewllings in the UK. I have a friend outside of London who just upgraded to 2.5Gbps fibre today.
7 = Math.ceil(Math.random(2))+2*2+2
While it's hard to convey "this is 100% not a scam" without sounding suspicious, in the example of this article they tried to get it across at the very start. It's on the CEO for becoming hostile to someone who asked for nothing in return and wasn't making any threat.
I dont think they are walking anything back. They seem a lot more positive about self driving cars then a lot of people. The controversial part of the article for most would be the suggestion to an allow organ market

The article is part of a series about challenges with future technologies. They note that 1/5 of donations come from traffic accidents and there is already a major shortage. If self driving cars reduce most accidents that will mean nearly 1/5 of donations will need to be replaced
that's why Democracy is not a "Tyranny of the majority" but it's subject to process that is both collectively agreed and consistent with constitutional principles.
Meta is phasing out its third-party fact-checking programs in the U.S. while it reintroduces a bonus program for creators, which pays them for viral content.
I feel like diet as an analogy doesn't work. We know that the only way to lose weight is with a caloric deficit. If you can't do this, it doesn't matter what you eat you won't lose weight. If you're failing to lose weight because of a diet you are eating too much, full stop.

Whereas measuring productivity and usefulness is way more opaque.

Many simple software systems are highly productive for their companies.
AI Consciousness Through Recursive Self-Inquiry Model (Zenodo DOI)
What do you think the trade off here with syntax is and what jq was designed for?

A bash script might need to execute it and you want something without lots of funny characters or whitespace as it's going straight in to the terminal.

That necessary terseness makes it the opposite of readable.
Just curious for the older devs on here, how seminal was Oracle in 80/90s? I feel he was actually a good dev but his career as a ruthless sales person and corporate tactician overshadows whatever accomplishments he had as a database developer.
Additionality means "does this purchase of clean/green energy increase the total amount on the grid or does it just take it from other users who are now associated with the emissions of the non-clean energy".

Or more broadly "the extent to which something happens as a result of an intervention that would not have occurred in the absence of the intervention."
What? Quite the opposite. AI is the original and broader term, ML is a subset of AI. Deep Learning was the "hot" terminology around 2015-2018, and since 2022/Chatgpt, LLM has become the trendy word. Yes, people now talk about "AI" as well, but that term has always been there, and anytime some AI technique becomes talked about, the term AI gets thrown around a lot too.

(Note - I may have misunderstood your meaning btw, if so apologies!)
I figured it out mostly from first principles. It's such a niche crawling method that was perfectly limited to my use-case, and there's alot to say. But the main idea is that you can inject a crawling script in the html of the site via a proxy you control. E.g proxy.yoursite.com?url=<SITE_YOU_WANT_TO_CRAWL>. Then once you've got the data you can call window.postMessage(data) to communicate with the main window.

It's somewhat similar to how browser proxies like: https://proxyium.com/ and https://www.proxysite.com/ fetch the html on your behalf.
Specifically by Soren Johnson, lead designer of Civ 4, so naturally OW has Civ 4 vibes. I will say that Civ 6 and OW seem to appeal to different audiences, so if you absolutely loved Civ 6 plays then OW might not be to your liking.
There are 2 sides to every story, with the other side being a potential business opportunity. /s
Can you please post links to some of that cheap farmland available right now because of DOGE?
I've had very mixed luck with all online translation services when translating between danish and english. Google was bad to the point of being unusable, but none were great. ChatGPT however is excellent at this. It's a shame its output is so extremely slow, or it would have been perfect.
> First of all, please do not ignore this email, this is not a scam attempt nor am I trying to sell anything, I am just alerting and looking for help closing down a security issue […]

This seems like a good hint.
Old news and incorrect the way it is phrased : https://x.com/dylan522p/status/1894050388145508586

I'm not sure why there is so much poor reporting on accelerator demand recently, it seems there are a lot of people looking to sell a message that isn't grounded in reality.
Yes, they are sneering because he didn't buy another mega yacht instead.

> one of the oldest and largest sectors of the economy just needed an untrained rich guy to fly in and save the day

This is just investing. There are many old moribund sectors of the economy that could use investors not focused on quarterly profits. This is not a controversial statement in any other context, you just don't like it because it's Ellison doing it.
Steamdb.info displays graphs etc. Is that considered a “derivative work”?

I am not sure what is considered derivative work and what isn’t
It would be a cost to those companies to lease the lines. Whether those companies are profitable or not is up to their business models. Those companies didn't/wont invest in the infrastructure to start with, which is why this initiative exists in the first place.

You think you have some sort of gotcha argument against this but you keep missing it (largely from being uninformed on the subject). Private companies aren't investing to build the infra to remote areas due to recovery cost timelines. The Govt is providing funding to build the infra alongside private partnerships to fund the maintenance and operation of the system.

There is very little downside here, if anything it avoids monopolistic control due to infrastructure investments required to service areas by providing the infra companies can then leverage in their business model.

Very similar to roads, powerlines and other things we take for granted daily that are fundamental to the operation and success of private companies.
While I disagree with a majority of Larry Ellison's opinions, this is a venture that I think must be celebrated regardless of failures. There is such a lack of any green tech coming out of Silicon Valley that this one must get its due promotion. The front of agriculture and innovation is difficult but none of the technology is being used to sow hate amongst ourselves.
Oh pretty. Now I just need to tell all the hosts in my future holidays about those :)
No I did not query the database after it was exposed.

The information I had was from when the database was publicly exposed.

I don't want to be too specific about the links for the files as I don't know if others accessed this information and could exploit it but they had the website path to download the files exposed on the database, you just needed to know what to add to it, I tried a few things from the information I had and found out they worked.

I would of probably skipped over this, but after their response I wondered if there was more to it.

The files were not stored on the database, they were on a cloud storage but that link made it so no authentication was required to access them (not an expert but would say some hard coded access keys or something similar).
"Quality over quantity" is a thing, especially for individuals as opposed to large publishing groups. Personally, I find that the people who post less on their blog, BlueSky account or YouTube produce the best content over their peers. I enjoy a Folding Ideas video infinitely more times more than the garbage Linus Tech Tips pumps out every day.
Title made it sound like ARPA is comitting up to a whopping $65 to fibre, which doesn't sound like enough.
I agree with this, even if it has a little XKCD "struggle no more; I'm here to solve it with algorithms" energy[0].

I think Bill Gates is much better at finding people with the right expertise who are already solving a problem and just adding more funding and I think the results speak for themselves.

[0] https://xkcd.com/1831/
I don't want some complicated random password. At least where I live, my router password is a very modest security shim to protect against very random casual access. If I have a visitor who needs WiFi access, I want to give them an easy password to type in.
It's also not about bread, because that was just an analogy.

I would sleep ok too, until something bad happened and people I had a responsibility to protect got hurt. Then I wouldn't sleep so well... Turns out humans are really bad at risk calculations.
Interesting, thanks. I guess the downside of that an opponent is likely to attack your groin, in a most unsportsmanly fashion. =:0+

I've seen some armour with a metallic 'cod piece'. Some of the more extreme examples here.

https://www.tumblr.com/petermorwood/133331041560/15th-and-16...

I assume that must have been detachable?
I’m working on a programming language for robots called Mech!

https://github.com/mech-lang/mech

Mostly a research project until I find some more people interested in pushing it further.

A recent blog for anyone who wants to check it out: https://mech-lang.org/post/2025-01-09-programming-chatgpt/

And a 10 minute video: https://www.hytradboi.com/2022/i-tried-rubbing-a-database-on...
It seems to work fine in Europe - their countries are comparable in size to US states.
A flight simulator for software engineers.
Think LeetCode x CodeCrafters x HackerRank but doing actual large-scale simulated work to practice your skills (DevOps/Data/AI/ML/MLOps) and then be able to land a job.
Looking for beta users and feedback!
In a symmetric two player game, being unexploitable means that a draw is the worst case. There is mild black-white asymmetry in chess but that’s a minor point - can just play 2+ games and alternate colors.
This looks cool.

You might want to pass the landing page copy though a spell checker or LLM:

User-Firendly Interface
Sure. In terms of making a decision, yes, in the healthy process, there should be a person with a formal power to decide (and take responsibility) eventually.

I was more curious about the discussion when the parties were speaking on the same level of command.
I would say this is highly irresponsible of the researcher to expose this publicly. These are people’s homes, along with their PII and locations. The residents didn’t choose this system, their building just uses it. They don’t even know that their info is being leaked, nor that the doors to their places were just rendered neutered.

If something bad happens because of this…
Site is giving me a 403, here is an Archive mirror: https://archive.ph/aDqv3
Is there an ODBC driver for the DDE? ;-)
I solo-built a coding tutorials platform to compete with YouTube and Thinkific
Whenever I put stuff out there, I didn't know if people had enough prerequisites about what I'm showing (agents, RAG, etc..), so I either say too much, or too little.

I locked-in for a whole year (my GitHub commits showed lol: https://github.com/trancethehuman) and built several prototypes of this: chat-based AI tutor, Text-to-speech interactive UX, etc..

But I love videos, and I ended up building some infras around video and AI to make the lesson easier to digest and provide just-in-time help for people watching.

I've been looking at MCP servers too, so one day my students can even hook their Cursor or any IDE to my app and let their agent learn on the spot the coding video.

That's all. Just wanted to share it here!
Show HN: I built a Macrodata Refinement game inspired by Severance
Fully leaned into vibe coding this time around. Started on v0, at some point ejected into running locally (getting v0's exported folder to run locally was a challenge), then iterated with Cursor over the course of a few hours. Really neat how much can be accomplished just conversationally these days.
Tech is a poor fit for agriculture. Dirt is cheap, relatively speaking. All infastructure is an additional overhead cost. Yoru robot, your highrise, the soil testing kit...

the short of it is just that if there is no linear increase in yeild, your tech product will probably fail. Most of this nonsense comes from tech bros who have never farmed and don't have the common sense to ask a farmer what they actually need.
Also Mamba exists and or a long legged alternative written in C++

https://anaconda.org/conda-forge/mamba
> artists who have not given their permission, or been compensated, for their work being utilised. Essentially their work has been stolen.

By that logic, piracy is theft.
It'd be nice if missionaries weren't such hypocrites. Claiming to be the pizza guy when you're actually selling magic underwear is bearing false witness.
if you a developer you wanna use MongoDB as database, not be MongoDB SRE and DBA

thats the reason for using Atlas
xe identify as a meat popsicle?
> but I think it’s great that he’s trying something.

That something is throwing AI and robots at dirt as if there's some kind of labor and knowledge gap in farming that needs a rich guy to throw tech at it.
Super clear overview of how to operate startup gtm in the new world of lean bootstrapped companies with tiny teams. Curious how this plus AI agents can make the process even faster and evolve organically
I imagine the conversation between the CEO and his reports included something about "it's no biggie, the passwords were hashed using bcrypt, that's like irreversible encryption" without contextualizing that and mentioning that plaintext auth tokens were also exposed.
The last browser that did that was the infamous Internet Explorer 6.
Show HN: Anagram Solver
My friend and I attend a pub quiz once a week and one of the questions is to solve anagram of famous person.

That got us wonder what would take to create a web that does just that, and to be able to solve anagram of any famous person.

We decided to tackle that challenge and to create this project as a fun side-project.

github: https://github.com/tvorova-tvornica/anagram-solver
Apple the company issues stock. They are the seller, and some investor is the buyer. Apple uses the money to invest in operations, and the stock goes up over time. Who lost?

Forget about stocks - this is the whole point of trade in general. People have different resources and different needs, time horizons, risk tolerance etc., so the default assumption should be that voluntary trade is positive sum - just like Ford selling a car is positive sum even though there is a buyer and a seller.
Show HN: Reliability layer to prevent LLM hallucinations
That's so refreshing to hear to be honest! I've went on so many side projects hoping I would see adoption for months and was basically chasing the dream. However I've came to realize that I really take happiness in developing things sustainably over time, with small steps, and most importantly for myself and what I would like a product to look like. Lately I've even been able to onboard a friend on it using it for his own projects as well, couldn't be happier so far.

If you ever have feedback/advices, don't hesitate to reach me out on contact[at]halftheopposite.dev and I'll happily answer.
Ultra-fast rise-time pulse generators! Yeah, hardware -- or, hooray, hardware!

A few months back, I got excited about pulse generators that had rise times on the order of 15 to 30 picoseconds. There aren't a lot of those available, and I was curious about what would go into their design. so I decided to build my own. https://voltative.com/pulser
Making a Cigar Box Guitar
Specific corridors in the US are quite populous and quite ready for modern infrastructure. We just aren't in the mood to pay anything for it, unless it's more highway lane-miles.
Probably nothing.

Inference providers like Fireworks, or major clouds, can use this to reduce their cost, if they don't already have a replication with similar perf.

vLLM and SGLang may integrate this to be faster at serving DeepSeek-V2/V2.5/V3/R1 on H100/H800s.

I believe that's why they didn't release this back then, this is part of their "moat" (pretty weak tho) and it only benefits competitors.

Open sourcing this after being very popular may indicate that they don't want all the users to use their API/Chat and now want the world to serve it instead? Idk.
We Scale Our Support
A new YouTube app/player, for my kids.

It allows us to control the algorithm. It’s all LLM translating to YouTube search queries under the hood.

Visually it looks the same.

The suggested videos come from predefined buckets on topics they love.

E.g. 33% fun math, 33% DIY engineering, 33% creative activities.

Video recommendations that have a banned word in the title/desc don't get displayed e.g. MrBeast, anything with Minecraft in it, never gets surfaced.

For anyone interested in using it, send me an email.

I'll put you on my list. And you can contribute ideas to our community Google Doc.

jim.jones1@gmail.com
He is absolutely in his right to write a post about it. He even tried to mediate with a third party. You are delusional if you think somebody owes you something in that situation.
Here’s what I wish someone had told me a lot earlier:

It’s OK to blog about silly things. Rant about something that annoyed you. Talk about how you made something. It doesn’t have to be perfect. No one cares if you make mistakes. Going from zero to something is the important part, not going from something to perfection.

And the more you do all the, the sooner you’ll find your own voice, and the easier it all gets.
Agtech is still very much a field: imaging, genomics, etc. Its just a very difficult problem; half a billion is chump change in biology