skysight-inc/HackerNews huggingface dataset:
I had a DevOps engineer describe their deployment automation system as a "Giant Rube Goldberg Machine". Which of course, all programming is a giant Rube Goldberg machine, if you think about it. If you take the "Goldberg" analogy to mean "Haphazard" and not well-thought out intentional structuring, I suppose it'd be more appropriate to compare a well-written application to a mechanical swiss watch.

Living beings are more "Rube Goldberg" than "Swiss Watch" - by virtue that they came to being guided not by intention, but circumstance.
I don't think MS has a special sauce here, just a willingness to publish. To the extent MS has disclosed the bulk of what they are doing with Phi, it's a combination of really nice initial idea "Use written texts + GPT-4 to generate high quality prompts where we know the answer is great because it's written down" and engineering.

To me this is advancing the state of the art as to the impact of data quality, but it doesn't look to me like the phi series have some magical special sauce otherwise. Data of quality and synthetic data creation are not magical moats that Apple can't cross.

I'll say too that I'm psyched to try Phi-3; the sweet spot for me is a model that can be a local coding assistant and still answer random q&a questions with some sophistication. I'm skeptical that 3-8b parameter models will bring the high-level of sophistication sometimes needed in this cycle; there's still a very large gap with the larger models in daily use, despite some often close benchmark scores.

Anyway, Apple-Phi-3 is in no way an impossibility.
Cheese can be a problem for gout; yoghurt not so much because it isn't as protein dense. The "biggies" for gout are seafood, red meat and turkey, red wine and beer (generally best to avoid alcohol) and legumes. I've also found that high sugar diets are bad including fresh fruit and juices.
I don't know how people can blindly take Telegraph headlines at face value.
Cool Continuum – Make Your Mark in the Arts
>They just don't have anyone with the knowledge nor the capital to hire the people who then know who else to hire.
Doesn't seem to be true. They pay celebrities (for their boring bs books that no one read) enough to build a dozen online platforms
Another nice benefit of paper is that the company that sold it can't just bust down your door, steal the book, drop off a few bucks, and then go back along their merry way. Amazon did exactly this with, amongst other books, 1984. Such a perfectly appropriate book.
They'd get a cease&desist instantly if they sold a T-shirt with Galactus (an IP they don't own)
They have something like 140 billion dollars in cash.

They’ll be fine.
Actually the original Phi papers did talk about their synthetic data strategy, and it's very cool -- essentially invert high quality textbook text using GPT-4 to create prompts, where the textbooks supply the answers. There may be more undisclosed, but it remains in my mind as one of the best ideas of the last twelve months -- so smart, and interesting, and apparently, it works well.
I listen to an audio book while eating breakfast and lunch (prep time + meal time). I usually watch TV while eating dinner.
I'll bet good money that this gets turned into a timing attack soon - it's a prototypical address-dependent delay.
Oh my god! Rate limiting for RAM. The realities of security sure are harsh.
For that to work, holds would need to be ordered, which isn’t the case for Overdrive/Libby.

The book I place On Hold today might be more important to me than the one I added two weeks ago.
> The worst offender (so far) is the JBIG2 format (several major libraries, including jbig2dec), a very popular format that gets EXTREMELY high compression ratios on bilevel images of types typical to scanned pdfs. But: it's also a format that's pretty slow to decompress—not something you want in a UI loop, like a PDF reader is! And, there's no way around that—if you look at the hot loop, which is arithmetic coding, it's a mess of highly branchy code that's purely serial and cannot be thread- nor SIMD- parallelized.

Looking at the jbig2dec code, there appears to be some room for improvement. If my observations are correct, each segment has its own arithmetic decoder state, and thus can be decoded in its own thread. The main reader loop[1] is basically a state machine which attempts to load each segment in sequence[2], but it should not need to. The file has segment headers which contains the segments offsets and sizes. It should be possible to first decode the header and populate the segment headers, then spawn N-threads to decode N-segments in parallel. Obviously, you don't want the threads competing for the file resource, so you could load each segment into its own buffer first, or mmap the whole file into memory.

[1]:https://github.com/ArtifexSoftware/jbig2dec/blob/master/jbig...

[2]:https://github.com/ArtifexSoftware/jbig2dec/blob/master/jbig...
Next century.
I think this will not go down well here on HackerNews because I'm going to suggest sticking up to Apple. Here is my experience. I tried with cheaper phones that we can just replace when they lose, drop it, or many other reasons.

Get them on iPhones, Macs, Apple TV, and iPads. They can be used ones or hand-me-downs, but that ecosystem works for them. Here is a setup for the in-laws.

An Apple TV drives as the "Apple Home" Setup while an iPad (the backup) is mounted near the TV. That room/area is the "talking to the kids area" where they just know how to respond or start a video call. The only other button they learned was to switch between their favorite local cable provider and the Apple TV. It did take a lot of repeated practice from "I can see on the iPad but not TV" to "seeing and talking on the big TV".

iPhones/Macs (instead of selling yours, give them your old one) are the easiest to set up and maintain. The contacts sync, and they have stopped complaining about getting back their phone contacts. The father-in-law once hand-wrote about a 5-paged A4 with about 200+ odd numbers and came to me to sync to the new phone. They are not losing their photos anymore and can spend hours browsing photos of their gigantic family members.

Tip: Set up your Apple TV screensaver with a specific Album and keep sharing photos there. Now, watch the grandparents, grand-everyone just sit in front of the screensaver and spend hours talking, laughing, arguing, crying, and sleeping off.
I talked to a friend who is a doctor once, and he started telling me some of the ethical concerns about studies. At some point my mind was reeling from all the implications and I don't know how they do studies in the first place.

I'm sure there are common treatments in use for hundreds of years, but if they were discovered today would never get through the approval process.
5 years? 5 years is a millennia these days.

We’ll have small local models beating gpt-4/Claude opus in 2024. We already have sub 100b models trading blows with former gpt-4 models, and the future is racing toward us. All these little breakthroughs are piling up.
re: final macro

> I would never do this in an actual product

what, why?
Ham radio!

I got into it through wanting some cheap radios to keep in my house, so I wouldn't have to go all the way upstairs when I needed to communicate with my daughter.

Well let me tell you Baofeng radios are extremely cheap but really flexible. I got these things for the simplest possible use case but after realizing their potential I just had to learn more about the space. You can adjust their configuration with a tool called Chirp and you're off to the races!

I attended a local severe weather awareness event where I met some hams who were part of an emergency response network. It's really cool to learn about how these communities operate. It's legal to receive even without a license - you only need the license to transmit.

I plan to take the technician test soon and get my license so I can help out at a nearby bike event. The area is incredibly rural so there's no cell coverage and the ham operators are really helpful in coordinating things.

Anyway, I feel like the hobby is a bit of a dying art, but it's something that seems like it would have a lot of appeal to the programmer crowd.
The opposite is the case, with all the advancements, even by doing nothing, Apple (like everyone, including hobbyists) is moving closer to the frontier. Hopefully this trend stays alive!
It's easy to miss: select English in the dropdown.
The scores are quite different in Overall and in English for LMSYS.

As I've stated in other comments, yeah... Agreed, I'm stretching it a bit. It's just that any indication of a 3.8B model being in the vicinity of GPT-4 is huge.

I'm sure that when things are properly measured by third-parties it will show a more sober picture. But still, with good fine-tunes, we'll probably get close.

It's a very significant demonstration of what could be possible soon.
The difference here being that those enhancement carts would likely cost less then 20$ to manufacture and would either cost a little more then that when sold individually or cost a little bit above the price of a full game when sold bundled with a game.

I can see how this would create some confusion when buying games (which may be a deal-breaker for nintendo), but I also see more potential in this approach since these carts would be "seeded" by Nintendo's own high volume and highly sought after games, thus getting much more traction than the big console accessories of the competition, which cost around (not 100% sure) 150$. Also, as another poster noted, the n64 had the expansion pak (not too far from the idea of an enhancement cart) introduced a few years into it's life which would end up being bundled with a few games and get fairly wide support on many newer releases, tough most of the games opted for optional support to unlock extra features.
I know which stores that happens at and which it doesn't happen at, still making it my choice whether or not I consent to my ID being in that DB.
Yeah it's also lots of linear algebra. Which also reminds me, graphics programming? Linear algebra everywhere.
> EIEIO, like on Old Macs

This is what we should reserve Nobel prizes in computer science for
How does that work then if a model trained on that data is used outside of Japan and some rights holder makes a claim then (in another country)?
To dedicate a device to one app, iOS/macOS has single-app / kiosk mode via Apple Configurator.
- "If my observations are correct, each segment has its own arithmetic decoder state, and thus can be decoded in its own thread."

Yeah, but real-world PDF JBIG2's seem to usually have one segment! One of the first things I checked—they wouldn't have made it that easy, the world's too cruel.

It's sort of a generic problem with compression formats—lots of files could easily be multiple segments that decompress in parallel, but aren't—if people don't encode them in multiple segments, you can't decompress them in multiple segments. Most formats support something like that in the spec, but most tools either don't implement that, or don't have it as the default.

e.g. https://news.ycombinator.com/item?id=33238283 ("pigz: A parallel implementation of gzip for multi-core machines" —fully compatible the gzip format and with gzip(1)! No one uses it).
EURISKO Lives
Mushrooms are what gave me the confidence to try tissue culturing! I’d grown mycelium from spores, made liquid cultures, and generally figured out the sterile workflows and understood the gist of things. I figured it shouldn’t be too different or difficult.

Plants have been slightly more challenging, but not as much as I expected. If you aren’t optimizing for profits to keep a facility open, mediocre results are still awesome and you’ve got plenty of time to keep experimenting. I guess it’s much the same with mushrooms. If you don’t get 5 pounds on your first flush, it’s still great fun. The beauty of mycelium is that turn around times are an order of magnitude shorter. Tissue cultures are very, very slow.
Redirect is slow tonight, so here's the original URL: https://medium.com/@coolcontinuum/the-composer-continuum-353...
Protein is listed in the nutrition facts all over the world. What GP is saying is that for Solein to be advertised and labeled as a protein it has to be a complete protein. This seems fairly accurate believable, but I know there are protein powders that are not complete proteins (typically not sold in grocery stores though)

If it has a similar profile to soy or algae like they claim it is a complete protein, or else that’s a false statement.
> So we now have an open-source LLM approximately equivalent in quality to GPT-4 that can run on phones?

No, we don't. LMsys is just one, very flawed benchmark.
You're talking about midwits or whatever. Millions of very intelligent people still get most of their knowledge from books. Books remain the highest octane fuel.
The title is provocative clickbait, but the actual point is this:

> These two market categories (celebrity books and repeat bestsellers from the backlist) make up the entirety of the publishing industry and even fund their vanity project: publishing all the rest of the books we think about when we think about book publishing (which make no money at all and typically sell less than 1,000 copies).

Given that spending per capita, adjusted for intlation is only a couple of percent higher than they were 20 years ago, the "boom" isn't particularly impressive.
No mention of the full self driving only 5 years away.
> is aggravating because it excludes humans who either directly identify as robots

I honestly can't tell if this comment is a parody at this point.
What is this for? What's something you make with it (or do you make stuff with it?)
> Antarctica, perhaps.

Skull Volcano lair on an island. Geothermal energy to power the place. Seawater for liquid cooling.

Then of course, you also need the beautiful but corruptible woman as some high-up part of the organization. And a chief of security in your evil enterprise with some sort of weird deformity or scarring - preferably on the face.

Protip: If you catch a foreign spy on the island, kill them immediately. Do not explain your master plan to them just before you kill them.
I paid $1, which ranked me at 12 out of 21
With 6830 visits that makes conversion rate of 0.31%.

Here's screenshots:
https://imgur.com/26fudCk
https://imgur.com/tETXqbZ
https://imgur.com/Olj2qUm
It's nonsense. They're claiming to be "open" but it's all still vendor controlled proprietary nonsense.

If they really want to be the dominant VR winner, then release it all under GPLv3+ and let us all get to innovate together.
Ah, M5 and ESP32, I bought so many things from both companies and didn't find the time to use them :-) #GAS
The newest Tesla's (eg. The 2024 model 3) don't have indicator or wiper stalks. They have two very non tactile buttons in the steering wheel to indicate. These buttons are impossible to press when you're rotating the wheel (eg. At a roundabout where you're turning but need to exit. In fact I don't think the current design should be legal given how dangerous it is.

I want a new car but cutting nessesities to save a few dollars more than anything else has ruled out 2024 model Tesla's. It may be Musk's insanity that led to this but the end result is the same. The newest models of Tesla are no good.
Agreed, but it's wild that even one benchmark shows this. Based on what we knew just a few months ago, these models should be so far from each other in every benchmark.
This is Espressif competing with its own partners, right?
> Suppose that they can. Then all of those things will be near-free because they can be mass produced with no labor cost

I take issue with this statement. The people who have the robots will be able to set whatever price they like. They could make things super cheap but that is not the inclination of the person in power.

As we've seen in so many "collusion" cases - some deliberately negotiated but many simply naturally settled into - the price of things is determined by "what the market will bear", which I see more cynically as "what the market can extract".
Because it looks pleasant
I'm not an expert, but my understanding in large freight is that Cost >>> Time. Going around probably costs a lot more in fuel etc would be my guess.
This would be terrible for libraries' abilities to keep archives of old books. What would be better is for less popular books to have cheaper (free) licenses for libraries.
"What is Internet Anyway?" (1994) [video]
It's a per-server setting. Ranges from phone verification to email verification to minimum account age.
People have different reactions to different kinds of proteins. So just asking is a good idea to see what the general reaction or opinion is. You don't need to follow it just but information is information bad or good.
Satire has, in many cases, become indistinguishable from reality. In this case I'd wager its satire.
OP said: growth is declining in response to the copy about an “ever growing population”

I said: we will add about 3.5b then level off, implying that the population, for all intents and purposes, is ever growing

You said: but maybe it’s not 3.5b!

I said: in the context of “ever growing” what’s the difference?

I stand by that comment. Adding 2.5b in the next 26 years or 4.5b can both be considered “ever growing”.

That the population level will dramatically level off at that point is not in dispute.

Absent some extinction level event which will render solar foods ability to produce protein irrelevant I really don’t see why the choice of model has an impact on my point.
I often think about their Senior Engineer video before interviews. I simultaneously aspire to match that character's ancient wisdom and am terrified that I might accidentally resemble him personally.
I would imagine they have a small engineering team in Japan to help give the best feedback on localization of the model outputs.

I think the bigger picture is that Japan has promoted strong support for AI companies and OpenAI in particular, and so the company wants to positively reinforce that as a model for other countries to emulate.
It's fun when you get a peek into obscure subcultures' freakishly weird givens.
>Aren't people buying more indie and early-access games than ever?

Yes, but people also make more games than ever, and this "more" is way bigger.
The best part of SPL is you get full digital access to the O'Reilly public library, you don't even need to place holds. Most tech books I've ever needed are a search away. https://www.spl.org/books-and-media/books-and-ebooks/oreilly...
It's from here: https://groups.google.com/g/rec.humor.funny/c/HjP_hKi49Ws/m/...

In other archives:

https://www.usenetarchives.com/view.php?id=rec.humor.funny&m...

and

https://www.netfunny.com/rhf/jokes/90q2/lispcode.html
I'm aware. I'm saying where the data is, to the extent it is available.

I also don't why you think the doctor was giving false hope, or being less than candid. I think it is pretty clear that the author knows phase 1 studies are not well characterized and or proven effective.
Amazing how much time people spend analyzing how Elon is screwing up and the bitter verbiage used at every turn. Just divest and be done with it.
Tech specifically is dependent on venture capital because it requires upfront costs and produces something that is not a valuable asset in liquidation. This basically guarantees that tech will go somewhere with large liquid capital markets... of which the US is the largest by huge margin.

That said, there is ample indication that companies will continue to outsource to foreign talent (eg. Google laying off California workers and hiring Indians). Between outsourcing and remote work, it's increasingly possible to start a business in one location, but employee people globally.

I think the real outcome, which we're already seeing, is that companies pay for their training content. It fully integrates into the existing venture system ("simply" raise more money), integrates into existing laws, and feeds into the existing tech economy.

In order for the startup ecosystem to leave the US, there would need to be either free-flowing checks rivaling the US or a dramatic regulatory change. Japan just doesn't have either, even with this new policy.
It’s not “competition” it’s another protein source being added to the market. I might think it’s a stretch to even say Beyond Burgers are competing with beef.

Adding non-animal protein sources to the market will lower the demand of animal proteins in aggregate when people consume them.
This was absolutely incredible. I was completely immersed. Now sitting back and enjoying the cafe.
Not to be confused with the Sean M Carroll
Cheating.

All of the 6x performance improvement cases seem to be related to using the .net based Kestrel web server instead of IIS web server, which requires marshalling and interprocess communication. Several of the 2x gains appear to be related to using a different database backend. Claims that regex performance has improved a thousand-fold.... seem more troubling than cause for celebration. Were you not precompiling your regex's in the older code? That would be a bug.

Somewhere in there, there might be 30% improvements in .net codegen (it's hard to tell). Profile Guided Optimization (PGO) seems to provide a 35% performance improvement over older versions of .net with PGO disabled. But that's dishonest. PGO was around long before .net Core. And claiming that PGO will provide 10x performance because our code is worse than Microsoft's code insults both our code and our intelligence.
You start by choosing between multiple choice, fill-in-the-blank, or an essay question...
I truly don’t mean to be pedantic, but there’s a giant implicit “for me” in there. I do not want or need to scribble or write in my books for “deep reading”. It’s totally fine if you want to, but that’s your preference and not a general requirement everyone has.

I just finished “Moby Dick” on a Kobo. It’s no “Ulysses”, thank heavens, but I’ve never heard anyone describe it as a long romance or a beach read.
Rev. Cecil Williams has died
Decompiled version of DynamoDB Local (built on SQLite)
I wonder if the author is going to bet against TSLA.
Got a source for that? Billions starving sounds like part of the unscientific alarmism.
None of my ebooks are infected with DRM. Lots of online stores will sell you ebooks without that nonsense.
It's a general purpose programming language who's main paradigm is rule-based pattern matching.

A sample.

<> (-- ?x) ()
-- (Now we can add comments to what we are doing.)
-- (Let's add some alternative syntax for defining rules.)
<> (?x -> ?y) (<> ?x ?y)

-- (Let's add some boolean operators, 'and' and 'or'.)
((true) && (true)) -> true
((true) && (false)) -> false
((false) && (true)) -> false
((false) && (false)) -> false

((true) || (true)) -> true
((true) || (false)) -> true
((false) || (true)) -> true
((false) || (false)) -> false

-- (Some alternative syntax.)
(?x and ?y) -> (?x && ?y)
(?x or ?y) -> (?x || ?y)

-- (Let's build an 'if' statement.)
(quote ?x) -> (quote ?x)
(unwrap (?x)) -> (unwrap ?x)
(unwrap ?x) -> ?x
(
if ?c
?t
else
?f
) -> (
if/else ?c
quote ?t
quote ?f
)
(
if/else (true)
quote ?t
quote ?f
) -> (
unwrap ?t
)
(
if/else (false)
quote ?t
quote ?f
) -> (
unwrap ?f
)

-- (All together.)
if ((true) and ((false) or (true))) (
Hooray!
) else (
Boo!
)
What infrastructure? Whatever it is you're talking about isn't cheaper when you add more labor.

I have a warehouse that's one aisle 4 shelves high. And another that's much bigger.

They come in all sizes and costs.

Labor is by far the greatest of those.

I think you're guessing about things...