skysight-inc/HackerNews huggingface dataset:
These links are a little different to the GP comment, though. Both of these cases (which I agree show LLMs being an excellent choice for improving fuzzing coverage) are static analysis, going from the project source code to a new harness.

Some issues with that are that the model probably doesn't have enough context to be given all the project source code, so you have to work out which subset to share, including definitions of all relevant symbols (but not too many).

It helps a bit that the foundation models were already pre-trained on these large open source projects in oss-fuzz, so they already know something about the project's symbols and definitions from their original training sets -- and even from public discussions about the code! -- but that wouldn't work for a private codebase or for recent changes to a large public one.

Then the harness source that the LLM writes might have syntax errors/fail to compile, and you have to deal with that somehow, and the harness source that the LLM writes might be valid but not generate any coverage improvement and you have to deal with that, and so on.

GP seems to be talking about instead some form of LLM-aided dynamic analysis, where you are probably using some kind of symbolic execution to generate new seeds, not new harnesses.

That's important work too, because I think in this case (disagreeing with the blog post author) the vulnerable function was actually reachable by existing harnesses, just not through the seed corpora (at least the public ones).

One approach could be for the LLM to become a kind of a symbolic execution constraint solver, using the debugger as a form of path instrumentation and producing new seeds by predicting what a new input would look like when you invert each interesting constraint that the fuzzing coverage is blocked by, as the debugger hits the test for that constraint (which is difficult because it can require actual computation, not pattern matching, and because of path explosion).

Or perhaps more plausibly, the LLM could generate Z3 or other SAT-solver code to define and solve for those constraints to generate new seeds, replacing what is currently extremely tedious and time-consuming work when done by humans.
For what it's worth, it doesn't seem like TikTok would be any less addictive if there was a way to summarize it.
I agree with you that Netflix's architecture in the cloud is incredibly complex. I know they do a lot of cool things with cloud storage, for example, but also scale breeds complexity. However, complexity is not scale.

Netflix users reportedly stream about 200 million hours per day, and at 1 GB/hour, that's an egress of 200 Petabytes/hour, or about 5 exabytes per day. There is no reason for Netflix to pay AWS to handle that, and they don't. That would be $100 million per day from CloudFront. You can read about their data plane online:

https://openconnect.netflix.com/en/

If you count how much data goes to their cloud vs their CDN appliances, I would be surprised if the cloud gets very much of their actual scale at all.
I don't want to be that guy, but every single business has a "Competitve Intel" department. They generally fall under PM or PMM.

Their activities range from comparing datasheets to digging into pricing to actually playing with competitors software after buying a license via a shell or a partner (very common practice done by startups)
I wanted to see if AI could code me a complex app
Coming soon to a Mars mission [1] near you: unscheduled disassembly due to faulty mission control input when someone forgets to include a variable in the dependencies list of a `useCallback` hook.

[1] https://en.wikipedia.org/wiki/Mars_Climate_Orbiter
Ah, I had missed that it effectively forces you to one CPU. Although I already would not use it for anything but testing account of it intentionally on unrandomizing things - I suspect, for instance, that it's unsafe to run any sort of cryptography that would create keys under this.
Tesla is a study in irony, imo.

They never would have made the waves they did without Elon Musk, and they never would have found themselves in the sinkhole they are in now, without Elon Musk.

They need to eject Elon, so he can return to making twit the largest collection of Nazis, Right-Wing clowns and scambots ever and stop hosing Telsa with his oversized Id.
Can't wait to play with this in llama.cpp; the 8B results look impressive.
It’s complicated.

There are some amazing people at Google genuinely and passionately working to make the web better and more open.

I personally could not work there, but I don’t question the ethics of someone just because they are at Google. I’m trying to think in my head what other organization they could be employed at still doing the same high-quality work.
I agree, baking is way more difficult.

It's like a longer feedback loop. A lot of cooking is like a really tight repl - maybe even with unit tests (tasting midway through). You can see results and modify on the fly. Baking is like hardware - you might not know where the bugs are until the thing comes back from the pcb print (comes out of the oven).
Hey guys! Abhi here

I am the co-founder of Pixie (www.pixieapp.xyz); we are building a workspace to streamline the research-driven content creation workflow through multimodal AI.
Pixie integrates content research and creation in one seamless workspace and helps you produce informative content efficiently while maintaining your ingenuity in any content format.

Imagine being able to create informational and well-researched stories like Johnny Harris, Kurzgesagt, etc., or educational and explanatory content easily. At Pixie, we believe that a content idea becomes viral when it shows the creators' creativity and is well-researched; this kind of content provides maximal value to consumers. Content ideas at Pixie can take any form, and users can conduct deep research for their content with sources that can be in diverse unstructured formats. Our under-the-hood AI engine is designed to be multimodal from the ground up, which we feel is very important for the new age content creation systems.

We are doing a soft launch by introducing a waitlist on our landing page today; feel free to check us out and provide your valuable feedback. We are building our MVP out and would love to know your thoughts and feature requests; feel free to sign up to our waitlist :)
PS: For the ultimate experience, visit our website on desktops. Works great on mobiles, too.
Those demonstrate that they're capable of generating capable ones, which is really cool but also not surpising.

What matters for engineering is how that technique compares to others in the context of specific requirements.

A big part of "falling for hype" is in mistaking a new and capable tool for the being the right or oprimal tool.
Looks like 8K context length. Seems to compare well against Gemini Pro 1.5 and Claude 3 Sonnet according to the included benchmarks.
In the article:

>North Carolina initially wanted to save money by limiting prescriptions to patients who first tried lifestyle management programs to lose weight

This is exactly the kind of diversion program that the manufacturers are holding over the head of insurers. Manufacturers are basically saying "allow everyone to get it or else we take away your discounts."
I just used Reader mode, didn't even need JavaScript.

Do read it. It's a well written and also very affecting insight into the lives of people doing essential work under difficult conditions.
Sounds like an entropy problem.

https://www.youtube.com/watch?v=y8OnoxKotPQ

> Which we get from EKS -- our entropy chaos service.
Can't imagine Redis Ltd will be allowing cloud vendors to undercut their offering long-term.

Even if Azure Redis is cheap now, just wait until the next low-performing quarter at Redis Ltd, and they'll raise Azure's fees to make their offering more attractive.

They are the monopolist now, no one can force them to have fair prices.
Wondering if this is a fake story. I saw it on the news wires this morning.
a) why didn't the subscriber get zillions of SMS warning them they were running up a roaming bill? and b) why did the CSR flatly assert that $100K+ bill is totally legit. Neither seems plausible.
appointment scheduling seems like an ideal consumer of cached audio responses, but how can segments be concatenated into a naturally sounded response?
They've got a console for it as well,
https://www.meta.ai/

And announcing a lot of integration across the Meta product suite,
https://about.fb.com/news/2024/04/meta-ai-assistant-built-wi...

Neglected to include comparisons against GPT-4-Turbo or Claude Opus, so I guess it's far from being a frontier model. We'll see how it fares in the LLM Arena.
In my opinion there’s a general fundamental misunderstanding on the purpose of theories. I see it all the time — attempts to explain why something is useful simply because it exists (re: popular science evolution). There are loads of suboptimal traits that are counterbalanced by something else.
On a holiday with friends I once spent some time on a beach trying to demonstrate a computer could be built with sandcastles and tennis balls.

IIRC, we managed to get AND, OR, NOT, XOR working and I set about building a half adder. It needed a lot of beach space, since it was a fairly shallow slope and you needed the balls to get up enough speed to work the logic.

The end result was, unfortunately, that the sea started washing away my design before I quite managed to debug it.

Ultimately I'd have needed to find a way to build a bigger chunk of logic and keep the balls circulating around it - didn't get that far but felt ready to do so if a post-apocalyptic scenario called for it.
Please practice what you preach and delete your comment about how great GPT-5 will be.
TL;DR—couldn’t exactly replicate their results, but broadly confirmed their findings. They agree that the optimal range is 5–40 tokens per parameter, and close to 20 for the “chinchilla” model from the original paper.

Very unusual choice to reconstruct the dataset by eyeballing the graph in the source paper (why not just ask for it…?) and it’s not really clear why the result is dressed up behind the salacious-seeming abstract.
Meta AI
I am curious if that medical plan has done cost benefit analysis of impact of ozempic etc will have on downstream diabetes and heart disease costs for people who would otherwise be morbidly obese.
I suddenly want to learn Kubernetes.
A c&d is a nice way of asking you to shutdown before they sue you. Most companies will not bother unless they think they have a case against you. Your choices are shut down or stay up and hire a lawyer to defend you in the coming case against you. Even if they do not have a strong case you will end up being in court a while. Keep in mind you have a source of income now but what may happen is they sue you then release their own api and cut your revenue at the same time. It's risky to build products on other peoples businesses especially if they dont want you to. I am not just talking out my ass. I was in the same situation on one of my projects and chose to shut down when I saw others going through lawsuits. At the very least you need to speak to a lawyer and make sure you can win a case.

In this specific instance you are providing a product that interfaces with their product. Your product allowing breaking TOS is likely grounds for their lawsuit. For similar cases look up bot manufacturers in World of Warcraft vs Blizzard. They won all their cases by saying the code that is in the ram is their property.

Edit: I also wanted to add that even if you are somehow not against their tos right now they can always update their tos to not allow your type of service..
I saw some coverage saying Wegovy and Ozempic have basically no downside a long time ago, but I'm now hearing those two have serious psychological effects. I'm not sure what's true at this point
The model card has the benchmark results relative to other Llama models including Llama 2: https://github.com/meta-llama/llama3/blob/main/MODEL_CARD.md...

The dramatic performance increase of Llama 3 relative to Llama 2 (even Llama 2 13B!) is very impressive. Doubling the context window to 8k will open a lot of new oppertunities too.
I personally see this as a potential of drones being used to shoot down other drones or missiles, and the inevitable drones trying to shoot down those drones.
> in general we should assume it is always impossible to exhaustively test programs

The whole program? Yes.

For testing individual components, there's no need to assume. The answer is very likely either clearly yes (the input is a handful of booleans) or clearly no (the input is several integers or even unbounded) and for those cases where it's not immediately clear (one i16? Three u8s?) it's probably still not hard to think through for your particular case in your particular context.
Interesting to see that their model comparisons don’t include OpenAI models.
Ever since I learned of bittorrent V2, I've been hoping for some per-file index to show up online. I'd love to be able to tag most or all of the bulk media files on my drives with how many copies exist in bittorrent swarms at any time. That way, I could more easily pick out big files for deletion knowing I could easily get another identical copy back later.

I tried doing something like this in the past using ipfs, but I wasn't very successful and didn't find any duplicates.
Is this really going to increase conversion rate of a website? And what percentage of users is even seeing a cursor anymore, since most people are accessing the web on mobile devices now?

Also, what exactly does this even do? Can I not just add
cursor: url(myimageurl)
to my css and have my cursor for free?
I'm so surprised that Meta is actually leading the open source AI landscape?! I've used llama2 extensively and can't wait to try out llama3 now. I can't believe that it does better than Claude 3 in benchmarks (though admittedly claude 3 seems to have been nerfed recently)

I sure do wish there was more info about how its trained and its training data.
When I was with Kaiser (admittedly a ~decade ago), they offered all sorts of classes and services around this. They were VERY proactive about preventative stuff and reminding you what was available.

Edit: looks like they still have a great program, including mental health, obesity and weight loss counseling, and a variety of other great services! https://healthy.kaiserpermanente.org/southern-california/lea...
> Health care is just too expensive to give to everyone for free. It would require taxation roughly equal to the cost of insurance premiums to be extracted from everyone

I don’t see the problem. Insurance companies aren’t charities, they exist to make a profit. How do insurance companies make profits? By paying out less than they charge. In other words, by ripping you off. Government can provide these services at cost. The evidence for this is: every other developed country.

It’s not an accident that Canadians live longer than Americans. Canadians get healthcare, Americans get propaganda and excuses for why it’s not possible. And propaganda doesn’t help you when you’re sick.
> They often pass the cost increases to the employees

Up to a limit.

In well compensated white collar industries like Software, Life Sciences, and even Hardware, a good health plan can be a major differentiator or ensure strong employee retention, because a $20-30k raise is basically $12-18k after tax (not bad, but not worth the amount of headaches)

I know some larger companies in the Bay Area that don't pay as competitive as Netflix but provide BCBS at a very low cost.
> We’re rolling out Meta AI in English in more than a dozen countries outside of the US. Now, people will have access to Meta AI in Australia, Canada, Ghana, Jamaica, Malawi, New Zealand, Nigeria, Pakistan, Singapore, South Africa, Uganda, Zambia and Zimbabwe — and we’re just getting started.
New Assistant: Meta AI, Built with Llama 3
Facebook is the scum of the earth, but you don't HAVE to use Facebook. If you don't like their terms don't use it. I can see a case where you must be allowed to end the contract with Facebook and have them delete your data or whatever, but I can not figure out why people think that Facebook is some publicly owned entity. Should I be able to go to my neighbors house and say they don't get to set the rules on the tools I borrow from them? Their my neighbors tools, they don't even have to let me use them.

Facebook isn't paywalling privacy unless they are actively spying on you without you using their products, which would be a completely different situation.

Or if they were outright lying to you about what data they collect and what they do with it, again though completely different situation.

They are paywalling their product, you know, like how walmart "paywalls" milk.
Novell – If at first you don't succeed
A refutation of Metcalfe's Law (2005) [pdf]
I'm guessing the cold winters is a factor, but just a guess.
Bad Kerning is what drives me nuts, like how can the person that did it look at it and think, "we're good!"... le rage

edit: ahh.. a vote for bad kerning. lol
Funnily enough, I've done this for a paper I wrote as well. Emailing authors is kind of a crapshoot. It's normal to get no response if it's been several years since the paper came out. In this case, a pdf plot is essentially lossless, and it's much faster than waiting for authors to maybe respond.
For me, .NET Core has been largely solving this problem over time. In classic .NET Framework it was nearly impossible to make something without Visual Studio's arcane templates. The `dotnet` command simplifies a lot of that, and projects have a lot less boilerplate.
Good news everyone, we've solved the self-driving car problem by adding the z axis
Gerby: Online tag-based view for large LaTeX documents
* 8k context length

* Llama3 8B beats Mistral 7B

* Llama3 70B beats Claude 3 Sonnet and Gemini Pro 1.5
Maybe not the reason, but claude sonnet obliterates gpt3.5 and there isn't a direct llama competitor to gpt4.
> Halo 2 was the most innovative online game of all time

In what ways exactly? Competitive online FPSs with strong modding communities were already more than a decade in full swing on the PC.
> costs could balloon to more than $1 billion over the next six years.

How much will they save from obesity-related diseases?
Here is an HN thread I had with him [0]. He claimed that 90% of those who were job seeking got placed. The key point was the definition of “job seeking”, of course. I'm happy to hear that authorities took action.

[0] https://news.ycombinator.com/item?id=33827202
They claimed that they did ask several times in one of the replies.
Why do people keep saying that Claude3 has been nerfed? Their CTO has said on Twitter multiple times that not a single byte has been changed since its launch, so I'm curious why I keep hearing this.

edit: having trouble finding the tweet I saw recently, it might have been from their lead engineer and not the CTO.
Every time IBM's name gets mentioned the FAANG-bangers bring up the Holocaust and with good reason. But the more that comes out, the more we see just how dirty and evil modern big tech as a whole is. It's just the tip of the iceberg.

Beware those telling you what you want to hear.
Do you think hallucinations will be solved with GPT-5? If so, that would be an amazing breakthrough. If not, it still won't be suitable for medical advice.
Better than Claude 3 Sonnet but Claude 3 Opus is significantly more powerful, albeit I'm not sure how they compare accounting for parameter size.
I tried it last year. Went great the first four months, but as the dose increased I found myself having vaguely suicidal thoughts and rumination. I have no history of that kind of thing.

I also realized I was having a full blown panic attack every Friday night (the day after my injections), waking up and throwing up and crying thinking I was going to die. It’s dumb but it took me about a month to realize it was related to the Wegovy. I’ve been off it for about nine months now.

It did keep me from gaining weight, I’m up 30 pounds since I stopped taking it, back to where I was, but hey if it does work for you I’d say go nuts.
That's propagation.
There's a huge gap between different ARM chip makers. Apple makes chips for laptops and desktops which are really competitive, Qualcomm doesn't, despite trying for a decade.

The phone market is so big, however, that it can support multiple manufacturers which have their own IP.
What novelty did Halo 2 introduce? At a high level, it is just another shooter preceded by all sorts of experiments: Quake, Counterstrike, Team Fortress, Unreal Tournament, etc.

Sure, it had tons of polish and was on consoles, but I never thought of it as genre defining.
Awesome, but I am surprised by the constrained context window as it balloons everywhere else.

Am I missing something? 8k seems quite low in current landscape.
This makes me want to make an Excel worksheet with each element on a row, and columns for mono-atomic, 1-d single-atom filaments, and 2-d ___ene sheets.

It would be interesting to research (Google) how many of them we can reliably make.
It's fine to have LLM skepticism as a default, but here it's not justified. Google is showing here that the LLM-written harnesses improve massively on the harnesses in oss-fuzz that were written over many years by the combined sum of open source security researchers. Most dramatically, they improved tinyxml2 fuzzing coverage by 31% compared to the existing oss-fuzz harnesses, through an entirely automated flow for harness generation by LLMs.

Whatever engineering technique you are imagining would be better is not one that humanity actually applied to the problem before the automated LLM harnesses were written. In general, writing and improving fuzzing harnesses is extremely tedious work that is not being done (or paid for) by nearly enough people to adequately protect critical open source software. The LLM approach is a legitimate breakthrough in the field of open source fuzzing.
You probably haven't spent much time calling organizations these days. They're told to click this and that and report.

There's no reason why 100% of the population answering phones couldn't be replaced with GPT at this point.
And easy way to fix the situation is to forbid this. Gas station should not track you, the same should happen for charger.
It may not have mattered.

A response of "A cancerous pheochromocytoma is incredibly rare. I don't see any other signs of cancer, so I didn't think to analyze those scans."

That would be a completely reasonable response.

But a deer-in-headlights, "I had no idea" type of look, is sad.

She is a gland expert.

Probably getting paid $500/hour for the consultation.

The least she could do is know the bare minimum of my history outlined in the report.

That is not an unreasonable standard.
200 miles? My cheap EV will be a second car to supplement a gas one. I really only need it to get like 70-100 miles.
If it's limited to 8k context length then it's not competing with sonnet at all IMO. Sonnet has a 200k context length and it's decent at pulling stuff from it, with just an 8k context length this model won't be great for RAG applications, instead it'll be used for chat and transforming data from one type to another.