skysight-inc/HackerNews huggingface dataset:
The Ishtar gate of Babylon is in the Pergamon Museum in Berlin:
https://en.m.wikipedia.org/wiki/Ishtar_Gate
> Regulatory agencies have been green lit to use brute force investigations, prosecutions, intimidation, and threats to hobble new industries, such as Blockchain.

"New industries such as Blockchain."

> Regulatory agencies are punitively blocking startups from being acquired by the same big companies the government is preferencing in so many other ways.

So Big Tech is bad except when it gives us a lucrative exit.
"Just" an indemnity clause.

First, you don't really know whether that'll hold up in court until it happens.

Second, by the time you're done with the court case, you'll have spent a tremendous amount of time and energy. Not only is that stressful by itself, it's also a big distraction from running the business, and every day you are busy with the court case you'll wish you were spending time working your business. The smaller you are, the more impactful distractions are.
Run DBT 2x Faster
is there a #2 to llamaguard? Meta seems curiously alone in doing this kind of, lets call it, "practical safety" work
The only way to make that much of money is with dating apps, IMHO. There’s a million out there and some of them make really good money in certain niches.
Okay. Well "they would decline" is pretty far from fighting tooth and nail.
Thanks, I came across some of Erik's videos in my research but I didn't realize they were part of a bigger series focused on ranges. Cascading methods are exactly the kind of ideas I'm thinking about.
It's different because this is windows hyper-v (or something related) crashing and bringing down your WSL session with it. A native Linux is far more stable.
Is Digital Cash Perfect for Micromobility?
Imagine if they made a data center with 1957 electronics that cost $279 million.

They probably won't be using it now because the phone in your pocket is likely more powerful. Moore law did end but data center stuff are still evolving order of magnitudes faster than forging presses.
Your Guide to Identifying AI Agent Applications Today
No, but if you are thinking about edge compute for LLMs, you quantize. Models are getting more efficient, and there are plenty of SLMs and smaller LLMs (like phi-2 or phi-3) that are plenty capable even on a tiny arm device like the current range of RPi "clones".

I have done experiments with 7B Llama3 Q8 models on a M3 MBP. They run faster than I can read, and only occasionally fall off the rails.

3B Phi-3 mini is almost instantaneous in simple responses on my MBP.

When I want longer context windows, I use a hosted service somewhere else, but if I only need 8000 tokens (99% of the time that is MORE than I need), any of my computers from the last 3 years are working just fine for it.
Ah yes. Except most software the US Government uses was developed by contractors .
All the big providers should have it up by end of day. They just change their API configs (they're just reselling you AWS Bedrock).
...it's a bit of a shame that the same upper/lowercase trick doesn't apply to all UNICODE codepoints (at least those that have upper/lower variants).

It seems to work for codepoints up to U+00FF, for instance:

- Å (U+00C5) vs å (U+00E5)

...but above 0xFF lowercase follows uppercase:

- Ă (U+0102) vs ă (U+0103)

Typical for UNICODE though, nothing makes sense ;)
amusing. (not) solving a "snake oil" https://en.wikipedia.org/wiki/Snake_oil problem with a patent miracle solution!
> these are usually serial entrepreneurs who just love to be in charge because they have no problems with risk/stress tolerance (mostly).

More accurately, they have made enough money from a successful venture that they can afford to fail and their risk/stress is lowered. I know serial entrepreneurs who failed several times in a row. Without some form of safety net along the way (an exit, taking money off the table in a later round, simply nice cashflows they were able to bank for a few years), they all seem to burn out.
Musing about a secure computer for sensitive data
That was some of the arguments behind the interesting but failed experiment that was Swatch Internet Time: https://en.wikipedia.org/wiki/Swatch_Internet_Time
> Why do people keep mislabeling this as Open Source? The whole point of calling something Open Source is that the "magic sauce" of how to build something is publicly available, so I could built it myself if I have the means. But without the training data publicly available, could I train Llama 3.1 if I had the means?

I don't think not releasing the commit history of a project makes it not Open Source, this seems like that to me. What's important is you can download it, run it, modify it, and re-release it. Being able to see how the sausage was made would be interesting, but I don't think Meta have to show their training data any more than they are obligated to release their planning meeting notes for React development.

Edit: I think the restrictions in the license itself are good cause for saying it shouldn't be called Open Source, fwiw.
Thanks for the great write up.

What is MMW on the flowchart?
So the argument is that yes Rust would have helped mitigate this specific bug, but bugs exist in all languages so therefore it doesn't matter the language.

I see the logic, but I don't think anyone is saying using Rust would make it bug free, people are just correctly pointing out Rust would have helped this bug, or in other words there is the potential for less bugs with Rust.

So yes, and.
Open Source Initiative (kind of a de-facto authority on what's open source and what not) is spending a whole lot of time figuring out what it means for an AI system to be open source. In other words, they're basically trying to come up with a new license because the existing ones can't easily apply.

I believe this is the current draft: https://opensource.org/deepdive/drafts/the-open-source-ai-de...
> We use synthetic data generation to produce the vast majority of our SFT examples, iterating multiple times to produce higher and higher quality synthetic data across all capabilities. Additionally, we invest in multiple data processing techniques to filter this synthetic data to the highest quality. This enables us to scale the amount of fine-tuning data across capabilities. [0]

Have other major models explicitly communicated that they're trained on synthetic data?

[0]. https://ai.meta.com/blog/meta-llama-3-1/
Jobsworth
> terms that have specific, widely accepted definitions

OSF's definition is far from the only one [1]. Switzerland is currently implementing CH Open's definition, the EU another one, et cetera.

> I don't get why you think it would be useful to call LLMs with published weights "open source"

I don't. I'm saying that if the choice is between open weights or open weights + open training data, open weights will win because the useful definition will outcompete the pristine one in a public context.

[1] https://en.wikipedia.org/wiki/Open-source_software#Definitio...
I would guess women catching up from planned pregnancies that were delayed due to 2008 recession.
It was only 100Mbps service, per the agreement, but yeah... >smile<

They do have cameras at each intersection, as well as networked audio at many (for all the speakers hanging from light poles that blare annoying instrumental covers of old popular songs).
There absolutely are, but they aren't startups.
No. Speak for yourself.
Genuine Lemo connectors are about $40.

XLR connectors are huge.

But yeah, you're not wrong, just tilting at windmills. I look forward to the demise of barrel jacks in particular, but USB is what will replace them.
Open-weights is not open-source, for sure, but I don't mind it being stated as an aspiration goal, the moment it is legally possible to publish a source without shooting themselves in the foot they should do it.

They could release 50% of their best data but that would only stop them from attracting the best talent.
> Why do people keep mislabeling this as Open Source?

I guess this is a rhetorical question, but this is a press release from Meta itself. It's just a marketing ploy, of course.
Well, the "locked" cabinet generally uses the same key everywhere in North America, which isn't a great start :)

A number of agencies put these controllers directly on the Internet (a search on Shodan for some telltale strings produces concerning numbers of hits).

Others will use one giant flat network across their entire city - so if you get access at once location, you have access to the entire network. This could mean accessing a "rural" or quiet location, but then actually attacking a much busier one.
Halt the Olympics to save the planet, pleads a sports historian
I will steelman the idea that a tokenizer and weights are all you need for the "source" of an LLM. They are components that can be modified, redistributed and when put together, reproduce the full experience intended.

If we insist upon the release of training data with Open models, you might as well kiss the idea of usable Open LLMs out the door. Most of the content in training datasets like The Pile are not licensed for redistribution in any way shape or form. It would jeopardize projects that do use transparent training data while not offering anything of value to the community compared to the training code. Republishing all training data is an absolute trap.
I think 40k is way more than most UBI proponents are aiming for. It's certainly 3 times as much as I have bean mentally considering in UBI discussions.

When I think UBI, I think paying for a shared living space and food. A minimum budget, not necessarily a comfortable budget.
I don't get the OCSP Stampling protocol: if the server needs / is able to to contact the CA frequently anyway, why not simply use very short-lived certificates?
Stress level has very unclear correlation with compensation. My very personal experience was that higher the compensation, less stressful the job was.
Discussion (174 points, 23 hours ago, 59 comments) https://news.ycombinator.com/item?id=41036526
i was thinking along the same. A lot of content generated by LLMs is going to end up on Facebook or Instagram. The easier it is to create AI generated content the more content ends up on those applications.
Amazing work by a colleague of mine. Incredibly useful to have a metric and formula for how to decide when to apply AI agent technology.
$250 Color E-ink phone: Bigme Hibreak [video]
A lot of folks at HN liked the idea of the Boox Palma, a phone sized E-ink device for book reading on the go, but since it wasn't actually a cellphone, they felt it was a hassle carrying two devices.

Well this one is a Android 11 phone with Google Playstore and a single Sim, and has the Kaleido Colour E-ink, so in theory it could replace your regular phone.

At the 12:15 mark you can see the device along size a regular phone in the sun, and I think that is the major selling point.
Thanks! I did try a 1-dimension R-tree but the performance tended to be much worse than an ordered map.

Priority trees could be really interesting. I did consider them early on but wasn't sure how well they'd apply here, so I'll take another look.
> The training data contains most likely insane amounts of copyrighted material.

If that is the case then the weights must inherit all these copyrights. It has been shown (at least in image processing) that you can extract many training images from the weights, almost verbatim. Hiding the training data does not solve this issue.

But regardless of copyright issues, people here are complaining about the malicious use of the term "open source", to signify a completely different thing (more like "open api").
>A manifesto, how retro.

Somewhat unrelated, but it's a shame that manifestos have such a bad rap, most often associated with terrorists and such. There is something sorta nice about sitting down and clearly declaring your thoughts on a subject. It makes sense that people pushed to the edge want to let us know why they are behaving they way they are, but it's a shame that normal people aren't encouraged to reflect upon their thoughts and write them down. Being able to think about a topic and put on paper that these are my thoughts and feelings about $x brings a certain amount of clarity to your thinking and can help other people understand your thinking in a way that has a lot of power. Consider historical documents like the Declaration of Independence, the points are laid out in a way that even if you disagree with them, there is no denying what they are declaring.
I think it’s hard to say. We simply don’t know much from the outside. Microsoft has had some pretty bad security lapses, for example around guarding access to Windows source code. I don’t think we’ve seen a bad security break-in at Google in quite a few years? It would surprise me if Anthropic and OpenAI had good security since they’re pretty new, and fast-growing startups have a lot of organizational challenges.

It seems safe to assume that not all the companies doing leading-edge LLM’s have good security and that the industry as a whole isn’t set up to keep secrets for long. Things aren’t locked down to the level of classified research. And it sounds like Zuckerberg doesn’t want to play the game that way.

At the state level, China has independent AI research efforts and they’re going to figure it out. It’s largely a matter of timing, which could matter a lot.

There’s still an argument to be made against making proliferation too easy. Just because states have powerful weapons doesn’t mean you want them in the hands of people on the street.
This is the cost of building a proprietary distribution network. Now they need to monetize it.
I've bought a couple things from Aliexpress, and payment processing is such a hassle[1], I don't know why you would use it to buy things that are easily found from domestic sources? Especially SD cards which are widely counterfeited.

[1] This was a couple years ago, maybe things got streamlined? Of my cards that don't have a foreign transaction fee, Aliexpress wants the phone number off the back of one, which is sketchy; no thanks. The second one, charges don't go through, and the issuer customer service can't even see the attempts; I have to ask them to disable security on my card for ~ 30 minutes, and then the charges go through. Billing showed from England, IIRC. Doesn't (edit: Didn't! thanks) support any intermediates I do (paypal/amazon pay) which is usually my goto for low trust transactions.
[dupe]

Some more discussion earlier this month: https://news.ycombinator.com/item?id=40852084
This competes against terrible to nonexistent CRL checking on clients, but there are generally more clients than servers.
Sometimes, and suddenly modular monoliths become a thing, as the microservices generation learns why we weren't doing SUN RPC, TOOL, DCOM and CORBA for every little piece of application functionality.
The irony of copyright is that it demands copied design.

Want an online menu for your restaurant? Well, you can't just go copying someone else's design; so you must create your own from scratch. Will yours look and behave practically identically to the other? Yes. Will both websites be overall worse quality than if everyone just collaborated on a standard design? Yes. Would it save the world an incredible amount of redundant work to just allow people to copy each others' work? Yes. Who wins in this arrangement? Only those who have already won.

Keep looking at this pattern, and you will enter a deep cavernous rabbit-hole. At the bottom, you will find yourself at the very core of design itself: the goals, philosophies, and systemic failures of every design we use today can be traced back to this point: collaboration must be avoided at all costs. Compatibility is the cardinal sin, and it must be punished.

So we go on, building silos upon silos. When will we ever learn?

---

There is a lot of talk lately for change. They say, "AI will be the end of copyright. It's too important to hold back the potential of AI over a petty argument for intellectual property." I don't believe for a minute that LLMs will ever reach the lofty goal of "General Intelligence". I don't believe for a minute that megacorps like OpenAI, Google, and Meta deserve a free pass to siphon data for profit. So why is it that these words ring true? AI has nothing to do with it: it's design itself that has incredible potential, and we should absolutely stop holding it back. Intellectual Property is nothing more than a demand against progress.
Microsoft licensing is prohibitive for small teams and indie/open-source projects, Windows runs on less hardware (it can run on Arm now, but x86 gets emulated), it has a smaller open-source ecosystem of command-line tools, it generally costs more in VMs, and generally just doesn't have the developer mindshare of the FOSS stuff.

Pricing isn't something you can just ignore. Anyone can get started with a free LEMP stack in a few minutes. Windows Server starts at $500 and goes up from there, and you have to pay more the more instances you have. If you start with it, you get locked into it, and it can get very expensive at enterprise scale.

Some enterprises still use Windows Server, especially if the rest of their stack is Microsoft and they can negotiate a bundled license with everything they need. But web startups typically want to avoid the Microsoft tax. Their apps' business value tends to be at the level of a webpage anyway, so the underlying stack doesn't matter as much – it's not like Windows Server gives them any significant advantages over spinning up a standard VM or some managed databases and CDNs, etc. Windows doesn't do anything especially worthwhile to justify that additional cost unless you're an all-Microsoft shop. And these days, when you're typically deploying to web + apps, Microsoft matters even less. .NET is popular in Europe, but in the US it's generally Electron or React Native, etc.

As for external packages, it's a philosophical/historical difference. Microsoft has traditionally favored first-party monoliths (the "kitchen sink" approach) that they can sell as a whole solution at a high price. GNU/Linux is traditionally clobbered together from a bunch of small free utilities, each with different authors, and each managing only their own little sphere of concern. It favors modular utilities that can be piped together or little daemons that run on their own ports. It allows very fast iterations (since any one tool can be reinvented and modularly replaced), but yes, it isn't as batteries-included as a Microsoft stack.

But at the end of the day, free matters a LOT. Microsoft is perfectly capable of making/acquiring popular tools as long as they're free, like VSCode or Github.
Tips That Shaped My Path to CTO
You've misunderstood the claim, which is not that socioeconomic effects contribute, but that they dominate.
Lets take the iphone. Secured by the industries best security teams I am sure. Closed source, yet teenagers in eastern europe have cracked into it dozens of times making jailbreaks. Every law enforcement agency can crack into it. Closed source is not a security moat, but a trade protection moat.
This is a lot of complication for in what most OOP languages with interfaces would simply be something like:

interface Timestamped {
timestamp: UTCTime;
}
interface Msg {
sender: PlayerId;
}
class Quote implements Timestamped, Msg {
timestamp: UTCTime;
sender: PlayerId;
}

Why is this so hard in Haskell? It doesn't have interface polymorphism?
> due to a poor format (YAML).

That's just your opinion. I'll take YAML whitespaces over Makefile whitespaces any day.

> Compare with Makefile that does exactly the same thing

Good example in favor of Task, I prefer the explicitness :) Especially when the file starts to get big. You forgot the .PHONY by the way, I hope for you there's no build/ or assets/ folder where your Makefile is.

For a more useful comparison, with actual source dependencies and build target:

Makefile:

GO_FILES = $(shell find . -type f -name '*.go')

./myapp: $(GO_FILES)
go build -trimpath -o $@

.PHONY: build
build: ./myapp

Taskfile:

tasks:
build:
cmds:
- go build -trimpath -o ./myapp
sources:
- '**/*.go'
generates:
- ./myapp

Makefiles are incredibly terse, but that's not an advantage. I read my code more than I write it, so I favor explicitness .
Issuing a certificate has significantly more overhead (e.g. Certificate Transparency logs) than signing a statement that an existing certificate is still valid.
I personally think a folding phone with a colour E-ink screen on the outside and an OLED on the inside would be the perfect combo.

Outside screen for visibility/ low battery usage, and inside screen for when you want to enjoy.
> Developers can run inference on Llama 3.1 405B on their own infra at roughly 50% the cost of using closed models like GPT-4o

Does anyone have details on exactly what this means or where/how this metric gets derived?
man 7 ascii
> In any case, if a program was built by training against a dataset, the whole dataset is part of the source code.

I'm not sure why I keep seeing this. What is the equivalent of the training data for something like the Linux kernel?
"Resume" has been a feature of cruise control since the dawn of electronic memory. The Motorola MC14460 integrated circuit and the even older and hilariously complicated Zemco CompuCruise had resume features.
World logs hottest day since records began
Delayed fungal evolution did not cause the Paleozoic peak in coal production (2016)
8200 veterans are highly sought after, and you can probably get a blank check from any VC if you have that on your resume.
> > you can tell it was designed before XML/JSON were "hot

> or you can tell it was designed by people who care more about performance.

I doubt parsing iCal is significantly more performant than JSON for most use cases. In fact I can image it being less so in more cases than it is more so, and as close to the same as makes no odds in the vast majority of cases.
there are many things i think are more capital constrained, if the government is trying to subsidize things.
Show HN: YRecombinator, a Pun Website
hello, I've come up with the silly yrecombinator pun and then I made this website

it randomly retrieves a made up startup built by combining two existing startups from ycombinator

it has access to 1000 generated startups
You don't need to have the commit history to see "how it works". ML that works well does so in huge part due to the training data used. The leading models today aren't distinguished by the way they're trained, but what they're trained on.
Sometimes they use ammonia instead!
Unfortunately those fears are well-founded.

The majority of MMUs on the market that I have had a close look at implement safety-critical functionality on a microcontroller with updatable firmware. Some can even be updated over IP. I haven't had the opportunity to dig into if those firmware upgrades are signed or otherwise integrity-protected.

The standard unfortunately does not specify a functional safety standard or other measures to ensure absolute safety.

In theory it would be possible to implement it in discrete logic (or an FPGA or other formally-verifiable process), but as far as I know no manufacturer has done so (I'd love to be wrong!)
Interesting, but I think the VLAN in your explanation is equivalent to the "network" I'm asking about. The V is mostly immaterial, I think.
Just added Llama 3.1 405B/70B/8B to https://double.bot (VSCode coding assistant) if anyone would like to try it.

---

Some observations:

* The model is much better at trajectory correcting and putting out a chain of tangential thoughts than other frontier models like Sonnet or GPT-4o. Usually, these models are limited to outputting "one thought", no matter how verbose that thought might be.

* I remember in Dec of 2022 telling famous "tier 1" VCs that frontier models would eventually be like databases: extremely hard to build, but the best ones will eventually be open and win as it's too important to too many large players. I remember the confidence in their ridicule at the time but it seems increasingly more likely that this will be true.